2023-10-14T12:20:59.138 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T12:20:59.139 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322 --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi --verbose -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/orig.config.yaml 2023-10-14T12:20:59.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:20:59.315 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322 branch: rishabh-2023oct13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} email: null first_in_suite: false job_id: '7425322' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Reduced data availability - Degraded data redundancy sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_18:04:14 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T12:20:59.316 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa; will attempt to use it 2023-10-14T12:20:59.317 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks 2023-10-14T12:20:59.317 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T12:20:59.319 INFO:teuthology.task.internal:Checking packages... 2023-10-14T12:20:59.343 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-14T12:20:59.343 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T12:20:59.344 INFO:teuthology.packaging:ref: None 2023-10-14T12:20:59.344 INFO:teuthology.packaging:tag: None 2023-10-14T12:20:59.344 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-14T12:20:59.344 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:20:59.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-14T12:20:59.579 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-14T12:20:59.579 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T12:20:59.590 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T12:20:59.591 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T12:20:59.635 INFO:teuthology.task.internal:Saving configuration 2023-10-14T12:20:59.653 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T12:20:59.719 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T12:20:59.744 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:15:32.137236', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T12:20:59.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:15:32.138779', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T12:20:59.769 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T12:20:59.776 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-14T12:20:59.776 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-14T12:20:59.777 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T12:20:59.857 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f407661ab80>, signals=[15]) 2023-10-14T12:20:59.859 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T12:20:59.865 INFO:teuthology.task.internal:Opening connections... 2023-10-14T12:20:59.866 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:20:59.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:20:59.934 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:20:59.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:21:00.002 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T12:21:00.009 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-10-14T12:21:00.030 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-10-14T12:21:00.030 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-14T12:21:00.089 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T12:21:00.089 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T12:21:00.089 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-10-14T12:21:00.090 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-10-14T12:21:00.090 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6" 2023-10-14T12:21:00.090 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-10-14T12:21:00.090 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T12:21:00.090 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-10-14T12:21:00.091 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T12:21:00.091 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T12:21:00.091 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T12:21:00.091 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T12:21:00.092 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:21:00.092 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T12:21:00.092 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T12:21:00.092 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T12:21:00.092 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T12:21:00.093 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-14T12:21:00.120 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-10-14T12:21:00.141 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-10-14T12:21:00.141 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-14T12:21:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T12:21:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T12:21:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-10-14T12:21:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-10-14T12:21:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2023-10-14T12:21:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-10-14T12:21:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T12:21:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-10-14T12:21:00.202 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T12:21:00.203 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T12:21:00.203 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T12:21:00.203 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T12:21:00.203 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:21:00.203 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T12:21:00.204 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T12:21:00.204 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T12:21:00.204 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T12:21:00.204 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-14T12:21:00.229 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T12:21:00.239 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T12:21:00.322 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T12:21:00.323 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-10-14T12:21:00.326 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2023-10-14T12:21:00.345 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T12:21:00.352 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T12:21:00.352 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-10-14T12:21:00.385 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2023-10-14T12:21:00.415 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T12:21:00.465 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T12:21:00.482 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-14T12:21:00.484 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-14T12:21:00.484 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-14T12:21:00.485 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T12:21:00.486 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T12:21:00.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:21:00.505 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-10-14T12:21:00.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:21:00.506 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2023-10-14T12:21:00.565 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-14T12:21:00.565 INFO:teuthology.task.kernel:Running kernel on smithi072: 4.18.0-372.9.1.el8.x86_64 2023-10-14T12:21:00.566 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2023-10-14T12:21:00.567 INFO:teuthology.orchestra.run.smithi123.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-14T12:21:00.567 INFO:teuthology.task.kernel:Running kernel on smithi123: 4.18.0-372.9.1.el8.x86_64 2023-10-14T12:21:00.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum install -y kernel 2023-10-14T12:21:01.867 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2023-10-14T12:21:01.868 INFO:teuthology.orchestra.run.smithi123.stdout:Unable to read consumer identity 2023-10-14T12:21:02.082 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T12:21:02.083 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-10-14T12:21:03.326 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-10-14T12:21:04.119 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-10-14T12:21:04.725 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-14T12:21:05.619 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-14T12:21:07.710 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 245 kB/s | 24 kB 00:00 2023-10-14T12:21:08.421 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-14T12:21:08.484 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-10-14T12:21:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2023-10-14T12:21:08.485 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-10-14T12:21:08.641 DEBUG:teuthology.orchestra.run.smithi123:> echo no | sudo yum reinstall kernel || true 2023-10-14T12:21:08.967 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2023-10-14T12:21:08.968 INFO:teuthology.orchestra.run.smithi123.stdout:Unable to read consumer identity 2023-10-14T12:21:09.080 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 409 kB/s | 24 kB 00:00 2023-10-14T12:21:09.223 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 12:21:07 PM UTC. 2023-10-14T12:21:09.264 INFO:teuthology.orchestra.run.smithi123.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T12:21:09.297 INFO:teuthology.orchestra.run.smithi123.stderr:Error: No packages marked for reinstall. 2023-10-14T12:21:09.343 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum reinstall -y kernel || true 2023-10-14T12:21:09.675 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2023-10-14T12:21:09.676 INFO:teuthology.orchestra.run.smithi123.stdout:Unable to read consumer identity 2023-10-14T12:21:09.850 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-14T12:21:09.926 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 12:21:07 PM UTC. 2023-10-14T12:21:09.939 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-10-14T12:21:09.941 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2023-10-14T12:21:09.941 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-10-14T12:21:09.965 INFO:teuthology.orchestra.run.smithi123.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T12:21:09.988 INFO:teuthology.orchestra.run.smithi123.stderr:Error: No packages marked for reinstall. 2023-10-14T12:21:10.033 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T12:21:10.057 DEBUG:teuthology.orchestra.run.smithi072:> echo no | sudo yum reinstall kernel || true 2023-10-14T12:21:10.114 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-14T12:21:10.114 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-14T12:21:10.114 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-14T12:21:10.115 DEBUG:teuthology.parallel:result is None 2023-10-14T12:21:10.388 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T12:21:10.389 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-10-14T12:21:10.646 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:01 ago on Sat 14 Oct 2023 12:21:09 PM UTC. 2023-10-14T12:21:10.697 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T12:21:10.745 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-10-14T12:21:10.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum reinstall -y kernel || true 2023-10-14T12:21:11.119 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T12:21:11.119 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-10-14T12:21:11.375 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 12:21:09 PM UTC. 2023-10-14T12:21:11.414 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T12:21:11.449 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-10-14T12:21:11.495 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T12:21:11.575 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-14T12:21:11.576 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-14T12:21:11.576 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-14T12:21:11.577 DEBUG:teuthology.parallel:result is None 2023-10-14T12:21:11.577 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T12:21:11.585 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T12:21:11.586 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T12:21:11.588 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T12:21:11.610 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T12:21:11.619 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T12:21:11.629 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T12:21:11.630 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T12:21:11.645 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T12:21:11.677 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T12:21:11.686 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T12:21:11.687 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T12:21:11.702 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T12:21:11.736 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:21:11.751 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:21:11.760 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:21:11.770 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:21:11.771 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T12:21:11.778 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T12:21:11.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T12:21:11.803 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T12:21:11.840 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T12:21:11.850 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T12:21:11.851 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T12:21:11.870 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T12:21:11.897 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:21:11.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:21:12.021 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:21:12.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:21:12.146 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:21:12.147 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T12:21:12.213 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:21:12.260 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:21:12.310 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:21:12.396 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:21:12.439 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:21:12.439 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T12:21:12.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-10-14T12:21:12.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2023-10-14T12:21:12.577 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:21:12.601 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:21:13.027 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T12:21:13.033 INFO:teuthology.task.internal:Starting timer... 2023-10-14T12:21:13.034 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T12:21:13.043 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T12:21:13.052 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-14T12:21:13.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-10-14T12:21:13.108 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2023-10-14T12:21:13.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2023-10-14T12:21:13.170 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2023-10-14T12:21:13.171 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T12:21:13.172 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-10-14T12:21:13.194 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-10-14T12:21:13.195 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2023-10-14T12:21:13.231 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2023-10-14T12:21:13.232 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi123.front.sepia.ceph.com': 'permissive'} 2023-10-14T12:21:13.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:21:13.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:21:13.262 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:21:13.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:21:13.298 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T12:21:13.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-10-14T12:21:13.330 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2023-10-14T12:21:13.367 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T12:21:13.376 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-14T12:21:13.381 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-14T12:21:13.538 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T12:21:13.555 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T12:21:13.557 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi123.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T12:30:15.705 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi123.front.sepia.ceph.com')] 2023-10-14T12:30:15.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-14T12:30:15.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:30:15.776 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-14T12:30:15.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-14T12:30:15.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-14T12:30:15.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:30:15.913 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-10-14T12:30:15.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-14T12:30:15.981 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T12:30:15.993 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T12:30:15.993 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T12:30:15.994 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:30:15.996 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T12:30:15.996 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:30:16.023 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T12:30:16.037 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T12:30:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T12:30:16.067 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T12:30:16.104 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-10-14T12:30:16.116 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-10-14T12:30:16.130 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T12:30:16.141 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2023-10-14T12:30:16.144 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T12:30:16.152 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2023-10-14T12:30:16.166 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T12:30:16.180 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T12:30:16.216 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-10-14T12:30:16.219 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:30:16.219 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-10-14T12:30:16.219 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:30:16.220 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:30:16.220 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:30:16.220 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:30:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:bash: ntpq: command not found 2023-10-14T12:30:16.251 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:30:16.251 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2023-10-14T12:30:16.251 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:30:16.251 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:30:16.252 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:30:16.252 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:30:16.253 INFO:teuthology.run_tasks:Running task install... 2023-10-14T12:30:16.261 DEBUG:teuthology.task.install:project ceph 2023-10-14T12:30:16.262 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-14T12:30:16.262 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-14T12:30:16.262 INFO:teuthology.task.install:Using flavor: default 2023-10-14T12:30:16.268 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T12:30:16.268 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T12:30:16.269 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T12:30:16.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:30:16.271 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T12:30:16.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:30:16.416 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-14T12:30:16.417 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T12:30:16.485 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-14T12:30:16.486 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T12:30:16.581 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T12:30:16.581 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:30:16.581 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T12:30:16.611 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T12:30:16.611 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T12:30:16.679 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T12:30:16.730 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T12:30:16.730 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:30:16.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T12:30:16.756 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T12:30:16.758 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T12:30:16.758 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T12:30:16.822 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2023-10-14T12:30:16.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2023-10-14T12:30:16.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T12:30:16.901 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T12:30:16.967 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-10-14T12:30:16.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-10-14T12:30:17.194 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2023-10-14T12:30:17.340 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T12:30:17.425 INFO:teuthology.orchestra.run.smithi123.stdout:44 files removed 2023-10-14T12:30:17.472 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T12:30:17.593 INFO:teuthology.orchestra.run.smithi072.stdout:44 files removed 2023-10-14T12:30:17.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T12:30:17.801 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2023-10-14T12:30:17.967 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T12:30:18.564 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 197 kB/s | 81 kB 00:00 2023-10-14T12:30:18.937 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 227 kB/s | 81 kB 00:00 2023-10-14T12:30:18.982 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 24 kB/s | 9.4 kB 00:00 2023-10-14T12:30:19.248 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-10-14T12:30:19.299 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-10-14T12:30:19.458 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-14T12:30:19.549 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 5.3 kB/s | 1.5 kB 00:00 2023-10-14T12:30:19.693 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-10-14T12:30:21.311 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 16 MB 00:01 2023-10-14T12:30:21.689 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 16 MB 00:01 2023-10-14T12:30:24.809 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 384 kB/s | 24 kB 00:00 2023-10-14T12:30:25.188 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 397 kB/s | 24 kB 00:00 2023-10-14T12:30:25.752 INFO:teuthology.orchestra.run.smithi123.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-10-14T12:30:26.409 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 MB/s | 47 MB 00:01 2023-10-14T12:30:33.794 INFO:teuthology.orchestra.run.smithi123.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 54 MB/s | 53 MB 00:00 2023-10-14T12:30:34.703 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 53 MB 00:01 2023-10-14T12:30:44.777 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T12:30:44.778 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T12:30:44.792 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-14T12:30:44.793 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-14T12:30:44.795 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-14T12:30:44.796 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T12:30:44.798 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T12:30:44.802 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-14T12:30:44.803 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-14T12:30:44.934 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2023-10-14T12:30:44.946 INFO:teuthology.orchestra.run.smithi123.stdout:=========================================================================================================================== 2023-10-14T12:30:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2023-10-14T12:30:44.946 INFO:teuthology.orchestra.run.smithi123.stdout:=========================================================================================================================== 2023-10-14T12:30:44.947 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2023-10-14T12:30:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-14T12:30:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T12:30:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-14T12:30:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-14T12:30:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-14T12:30:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-14T12:30:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-14T12:30:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-14T12:30:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-14T12:30:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-14T12:30:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-14T12:30:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-14T12:30:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-14T12:30:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-14T12:30:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-14T12:30:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-14T12:30:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-14T12:30:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-14T12:30:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T12:30:44.951 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T12:30:44.951 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-14T12:30:44.951 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-14T12:30:44.951 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-14T12:30:44.952 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T12:30:44.952 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-14T12:30:44.952 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T12:30:44.952 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-14T12:30:44.952 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-14T12:30:44.953 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-14T12:30:44.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-14T12:30:44.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-14T12:30:44.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-14T12:30:44.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-14T12:30:44.954 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-14T12:30:44.954 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-14T12:30:44.954 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-14T12:30:44.954 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-14T12:30:44.954 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2023-10-14T12:30:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-14T12:30:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T12:30:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T12:30:44.955 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2023-10-14T12:30:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T12:30:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-14T12:30:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-14T12:30:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-14T12:30:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-14T12:30:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-14T12:30:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-14T12:30:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-14T12:30:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-14T12:30:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T12:30:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T12:30:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-14T12:30:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T12:30:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-14T12:30:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-14T12:30:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-14T12:30:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-14T12:30:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T12:30:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-14T12:30:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-14T12:30:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T12:30:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-14T12:30:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-14T12:30:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-14T12:30:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T12:30:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-14T12:30:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T12:30:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T12:30:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T12:30:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T12:30:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T12:30:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-14T12:30:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T12:30:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T12:30:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T12:30:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T12:30:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T12:30:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T12:30:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T12:30:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T12:30:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-14T12:30:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-14T12:30:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T12:30:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-14T12:30:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T12:30:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T12:30:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T12:30:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T12:30:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T12:30:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T12:30:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T12:30:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T12:30:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T12:30:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T12:30:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T12:30:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T12:30:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T12:30:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T12:30:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T12:30:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T12:30:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T12:30:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T12:30:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T12:30:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T12:30:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T12:30:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T12:30:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-14T12:30:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T12:30:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T12:30:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-14T12:30:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T12:30:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T12:30:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T12:30:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T12:30:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T12:30:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-14T12:30:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T12:30:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T12:30:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T12:30:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T12:30:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T12:30:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T12:30:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T12:30:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T12:30:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T12:30:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T12:30:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-14T12:30:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T12:30:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-14T12:30:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T12:30:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T12:30:44.974 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling module streams: 2023-10-14T12:30:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql 10 2023-10-14T12:30:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:30:44.974 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2023-10-14T12:30:44.975 INFO:teuthology.orchestra.run.smithi123.stdout:=========================================================================================================================== 2023-10-14T12:30:44.975 INFO:teuthology.orchestra.run.smithi123.stdout:Install 128 Packages 2023-10-14T12:30:44.975 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 3 Packages 2023-10-14T12:30:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:30:44.976 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 209 M 2023-10-14T12:30:44.976 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2023-10-14T12:30:45.428 INFO:teuthology.orchestra.run.smithi123.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-10-14T12:30:45.645 INFO:teuthology.orchestra.run.smithi123.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 4.1 MB/s | 918 kB 00:00 2023-10-14T12:30:45.704 INFO:teuthology.orchestra.run.smithi123.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.8 MB/s | 167 kB 00:00 2023-10-14T12:30:45.870 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T12:30:45.871 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T12:30:45.886 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-14T12:30:45.887 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-14T12:30:45.888 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-14T12:30:45.889 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T12:30:45.891 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T12:30:45.895 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-14T12:30:45.896 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-14T12:30:46.026 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-10-14T12:30:46.038 INFO:teuthology.orchestra.run.smithi072.stdout:=========================================================================================================================== 2023-10-14T12:30:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-10-14T12:30:46.039 INFO:teuthology.orchestra.run.smithi072.stdout:=========================================================================================================================== 2023-10-14T12:30:46.040 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-10-14T12:30:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-14T12:30:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T12:30:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-14T12:30:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-14T12:30:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-14T12:30:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-14T12:30:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-14T12:30:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-14T12:30:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-14T12:30:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-14T12:30:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-14T12:30:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-14T12:30:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-14T12:30:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-14T12:30:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-14T12:30:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-14T12:30:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-14T12:30:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-14T12:30:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T12:30:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T12:30:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-14T12:30:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-14T12:30:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-14T12:30:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T12:30:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-14T12:30:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T12:30:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-14T12:30:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-14T12:30:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-14T12:30:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-14T12:30:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-14T12:30:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-14T12:30:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-14T12:30:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-14T12:30:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-14T12:30:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-14T12:30:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-14T12:30:46.048 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-10-14T12:30:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-14T12:30:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T12:30:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T12:30:46.049 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-10-14T12:30:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T12:30:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-14T12:30:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-14T12:30:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-14T12:30:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-14T12:30:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-14T12:30:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-14T12:30:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-14T12:30:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-14T12:30:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T12:30:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T12:30:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-14T12:30:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T12:30:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-14T12:30:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-14T12:30:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-14T12:30:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-14T12:30:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T12:30:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-14T12:30:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-14T12:30:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T12:30:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-14T12:30:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-14T12:30:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-14T12:30:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T12:30:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-14T12:30:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T12:30:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T12:30:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T12:30:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T12:30:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T12:30:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-14T12:30:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T12:30:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T12:30:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T12:30:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T12:30:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T12:30:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T12:30:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T12:30:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T12:30:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-14T12:30:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-14T12:30:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T12:30:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-14T12:30:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T12:30:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T12:30:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T12:30:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T12:30:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T12:30:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T12:30:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T12:30:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T12:30:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T12:30:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T12:30:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T12:30:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T12:30:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T12:30:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T12:30:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T12:30:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T12:30:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T12:30:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T12:30:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T12:30:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T12:30:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T12:30:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T12:30:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-14T12:30:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T12:30:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T12:30:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-14T12:30:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T12:30:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T12:30:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T12:30:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T12:30:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T12:30:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-14T12:30:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T12:30:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T12:30:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T12:30:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T12:30:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T12:30:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T12:30:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T12:30:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T12:30:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T12:30:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T12:30:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-14T12:30:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T12:30:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-14T12:30:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T12:30:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T12:30:46.073 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling module streams: 2023-10-14T12:30:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql 10 2023-10-14T12:30:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:30:46.074 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-10-14T12:30:46.074 INFO:teuthology.orchestra.run.smithi072.stdout:=========================================================================================================================== 2023-10-14T12:30:46.074 INFO:teuthology.orchestra.run.smithi072.stdout:Install 128 Packages 2023-10-14T12:30:46.075 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 3 Packages 2023-10-14T12:30:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:30:46.076 INFO:teuthology.orchestra.run.smithi123.stdout:(4/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 7.1 MB/s | 5.4 MB 00:00 2023-10-14T12:30:46.076 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 209 M 2023-10-14T12:30:46.076 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-10-14T12:30:46.150 INFO:teuthology.orchestra.run.smithi123.stdout:(5/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 5.2 MB/s | 2.3 MB 00:00 2023-10-14T12:30:46.313 INFO:teuthology.orchestra.run.smithi123.stdout:(6/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 6.5 MB/s | 1.6 MB 00:00 2023-10-14T12:30:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-10-14T12:30:46.955 INFO:teuthology.orchestra.run.smithi123.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 5.7 MB/s | 4.6 MB 00:00 2023-10-14T12:30:47.733 INFO:teuthology.orchestra.run.smithi072.stdout:(2/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 3.4 MB/s | 5.4 MB 00:01 2023-10-14T12:30:47.800 INFO:teuthology.orchestra.run.smithi072.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.4 MB/s | 167 kB 00:00 2023-10-14T12:30:47.884 INFO:teuthology.orchestra.run.smithi072.stdout:(4/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 598 kB/s | 918 kB 00:01 2023-10-14T12:30:47.955 INFO:teuthology.orchestra.run.smithi123.stdout:(8/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 8.5 MB/s | 23 MB 00:02 2023-10-14T12:30:48.047 INFO:teuthology.orchestra.run.smithi123.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 266 kB/s | 24 kB 00:00 2023-10-14T12:30:48.126 INFO:teuthology.orchestra.run.smithi072.stdout:(5/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 7.1 MB/s | 2.3 MB 00:00 2023-10-14T12:30:48.981 INFO:teuthology.orchestra.run.smithi123.stdout:(10/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 6.7 MB/s | 18 MB 00:02 2023-10-14T12:30:49.043 INFO:teuthology.orchestra.run.smithi072.stdout:(6/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 5.0 MB/s | 4.6 MB 00:00 2023-10-14T12:30:49.114 INFO:teuthology.orchestra.run.smithi123.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.9 MB/s | 261 kB 00:00 2023-10-14T12:30:49.198 INFO:teuthology.orchestra.run.smithi123.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 372 kB/s | 31 kB 00:00 2023-10-14T12:30:49.440 INFO:teuthology.orchestra.run.smithi123.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 3.4 MB/s | 839 kB 00:00 2023-10-14T12:30:49.648 INFO:teuthology.orchestra.run.smithi123.stdout:(14/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 5.2 MB/s | 14 MB 00:02 2023-10-14T12:30:49.674 INFO:teuthology.orchestra.run.smithi123.stdout:(15/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 787 kB/s | 184 kB 00:00 2023-10-14T12:30:49.724 INFO:teuthology.orchestra.run.smithi123.stdout:(16/131): librados-devel-18.0.0-6730.g4ba8a190. 1.8 MB/s | 139 kB 00:00 2023-10-14T12:30:49.810 INFO:teuthology.orchestra.run.smithi072.stdout:(7/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 863 kB/s | 1.6 MB 00:01 2023-10-14T12:30:49.841 INFO:teuthology.orchestra.run.smithi123.stdout:(17/131): libradosstriper1-18.0.0-6730.g4ba8a19 3.0 MB/s | 518 kB 00:00 2023-10-14T12:30:49.933 INFO:teuthology.orchestra.run.smithi123.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 488 kB/s | 45 kB 00:00 2023-10-14T12:30:50.041 INFO:teuthology.orchestra.run.smithi123.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.1 MB/s | 126 kB 00:00 2023-10-14T12:30:50.133 INFO:teuthology.orchestra.run.smithi123.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.1 MB/s | 197 kB 00:00 2023-10-14T12:30:50.267 INFO:teuthology.orchestra.run.smithi123.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 2.7 MB/s | 371 kB 00:00 2023-10-14T12:30:50.367 INFO:teuthology.orchestra.run.smithi123.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 3.6 MB/s | 365 kB 00:00 2023-10-14T12:30:50.483 INFO:teuthology.orchestra.run.smithi123.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 921 kB/s | 107 kB 00:00 2023-10-14T12:30:50.585 INFO:teuthology.orchestra.run.smithi123.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 927 kB/s | 94 kB 00:00 2023-10-14T12:30:51.194 INFO:teuthology.orchestra.run.smithi123.stdout:(25/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 4.7 MB/s | 6.9 MB 00:01 2023-10-14T12:30:51.228 INFO:teuthology.orchestra.run.smithi072.stdout:(8/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 4.4 MB/s | 23 MB 00:05 2023-10-14T12:30:51.278 INFO:teuthology.orchestra.run.smithi072.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 485 kB/s | 24 kB 00:00 2023-10-14T12:30:51.289 INFO:teuthology.orchestra.run.smithi123.stdout:(26/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 5.1 MB/s | 3.6 MB 00:00 2023-10-14T12:30:51.319 INFO:teuthology.orchestra.run.smithi123.stdout:(27/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 1.4 MB/s | 179 kB 00:00 2023-10-14T12:30:51.353 INFO:teuthology.orchestra.run.smithi123.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6730.g 361 kB/s | 23 kB 00:00 2023-10-14T12:30:51.378 INFO:teuthology.orchestra.run.smithi123.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.2 MB/s | 132 kB 00:00 2023-10-14T12:30:51.629 INFO:teuthology.orchestra.run.smithi072.stdout:(10/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 6.9 MB/s | 18 MB 00:02 2023-10-14T12:30:51.687 INFO:teuthology.orchestra.run.smithi123.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 5.3 MB/s | 1.8 MB 00:00 2023-10-14T12:30:51.706 INFO:teuthology.orchestra.run.smithi072.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 3.3 MB/s | 261 kB 00:00 2023-10-14T12:30:51.762 INFO:teuthology.orchestra.run.smithi123.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 3.2 MB/s | 242 kB 00:00 2023-10-14T12:30:51.854 INFO:teuthology.orchestra.run.smithi123.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 518 kB/s | 47 kB 00:00 2023-10-14T12:30:51.873 INFO:teuthology.orchestra.run.smithi072.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 185 kB/s | 31 kB 00:00 2023-10-14T12:30:51.929 INFO:teuthology.orchestra.run.smithi123.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 199 kB/s | 15 kB 00:00 2023-10-14T12:30:52.029 INFO:teuthology.orchestra.run.smithi123.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 2.6 MB/s | 261 kB 00:00 2023-10-14T12:30:52.032 INFO:teuthology.orchestra.run.smithi072.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 5.2 MB/s | 839 kB 00:00 2023-10-14T12:30:52.125 INFO:teuthology.orchestra.run.smithi072.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.0 MB/s | 184 kB 00:00 2023-10-14T12:30:52.138 INFO:teuthology.orchestra.run.smithi123.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.7 MB/s | 192 kB 00:00 2023-10-14T12:30:52.193 INFO:teuthology.orchestra.run.smithi072.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 2.0 MB/s | 139 kB 00:00 2023-10-14T12:30:52.214 INFO:teuthology.orchestra.run.smithi123.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 241 kB/s | 18 kB 00:00 2023-10-14T12:30:52.372 INFO:teuthology.orchestra.run.smithi123.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.9 MB/s | 306 kB 00:00 2023-10-14T12:30:52.373 INFO:teuthology.orchestra.run.smithi072.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 2.8 MB/s | 518 kB 00:00 2023-10-14T12:30:52.414 INFO:teuthology.orchestra.run.smithi123.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-10-14T12:30:52.456 INFO:teuthology.orchestra.run.smithi123.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-10-14T12:30:52.523 INFO:teuthology.orchestra.run.smithi123.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 7.0 MB/s | 476 kB 00:00 2023-10-14T12:30:52.591 INFO:teuthology.orchestra.run.smithi123.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 640 kB/s | 44 kB 00:00 2023-10-14T12:30:52.640 INFO:teuthology.orchestra.run.smithi123.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.7 MB/s | 185 kB 00:00 2023-10-14T12:30:52.724 INFO:teuthology.orchestra.run.smithi123.stdout:(43/131): ceph-mgr-diskprediction-local-18.0.0- 5.5 MB/s | 7.4 MB 00:01 2023-10-14T12:30:52.749 INFO:teuthology.orchestra.run.smithi123.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 303 kB/s | 33 kB 00:00 2023-10-14T12:30:52.820 INFO:teuthology.orchestra.run.smithi123.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.4 MB/s | 173 kB 00:00 2023-10-14T12:30:52.858 INFO:teuthology.orchestra.run.smithi123.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 122 kB/s | 16 kB 00:00 2023-10-14T12:30:52.883 INFO:teuthology.orchestra.run.smithi123.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.9 MB/s | 384 kB 00:00 2023-10-14T12:30:52.917 INFO:teuthology.orchestra.run.smithi123.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 333 kB/s | 11 kB 00:00 2023-10-14T12:30:52.959 INFO:teuthology.orchestra.run.smithi123.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 807 kB/s | 81 kB 00:00 2023-10-14T12:30:52.976 INFO:teuthology.orchestra.run.smithi123.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 299 kB/s | 18 kB 00:00 2023-10-14T12:30:53.010 INFO:teuthology.orchestra.run.smithi123.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.4 MB/s | 49 kB 00:00 2023-10-14T12:30:53.069 INFO:teuthology.orchestra.run.smithi123.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-14T12:30:53.102 INFO:teuthology.orchestra.run.smithi123.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.8 MB/s | 60 kB 00:00 2023-10-14T12:30:53.161 INFO:teuthology.orchestra.run.smithi123.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2023-10-14T12:30:53.186 INFO:teuthology.orchestra.run.smithi123.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-10-14T12:30:53.211 INFO:teuthology.orchestra.run.smithi123.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-10-14T12:30:53.237 INFO:teuthology.orchestra.run.smithi123.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 669 kB/s | 34 kB 00:00 2023-10-14T12:30:53.243 INFO:teuthology.orchestra.run.smithi072.stdout:(17/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 8.0 MB/s | 6.9 MB 00:00 2023-10-14T12:30:53.285 INFO:teuthology.orchestra.run.smithi123.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2023-10-14T12:30:53.310 INFO:teuthology.orchestra.run.smithi072.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 671 kB/s | 45 kB 00:00 2023-10-14T12:30:53.320 INFO:teuthology.orchestra.run.smithi123.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 769 kB/s | 64 kB 00:00 2023-10-14T12:30:53.346 INFO:teuthology.orchestra.run.smithi123.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 308 kB/s | 19 kB 00:00 2023-10-14T12:30:53.379 INFO:teuthology.orchestra.run.smithi123.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2023-10-14T12:30:53.402 INFO:teuthology.orchestra.run.smithi072.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.3 MB/s | 126 kB 00:00 2023-10-14T12:30:53.421 INFO:teuthology.orchestra.run.smithi123.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 661 kB/s | 27 kB 00:00 2023-10-14T12:30:53.447 INFO:teuthology.orchestra.run.smithi123.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 290 kB/s | 29 kB 00:00 2023-10-14T12:30:53.469 INFO:teuthology.orchestra.run.smithi072.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.9 MB/s | 197 kB 00:00 2023-10-14T12:30:53.472 INFO:teuthology.orchestra.run.smithi123.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-10-14T12:30:53.521 INFO:teuthology.orchestra.run.smithi123.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2023-10-14T12:30:53.553 INFO:teuthology.orchestra.run.smithi072.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 4.3 MB/s | 371 kB 00:00 2023-10-14T12:30:53.556 INFO:teuthology.orchestra.run.smithi123.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 733 kB/s | 61 kB 00:00 2023-10-14T12:30:53.581 INFO:teuthology.orchestra.run.smithi123.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-10-14T12:30:53.615 INFO:teuthology.orchestra.run.smithi123.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 392 kB/s | 23 kB 00:00 2023-10-14T12:30:53.620 INFO:teuthology.orchestra.run.smithi072.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 5.3 MB/s | 365 kB 00:00 2023-10-14T12:30:53.679 INFO:teuthology.orchestra.run.smithi072.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.8 MB/s | 107 kB 00:00 2023-10-14T12:30:53.738 INFO:teuthology.orchestra.run.smithi072.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.6 MB/s | 94 kB 00:00 2023-10-14T12:30:54.074 INFO:teuthology.orchestra.run.smithi123.stdout:(69/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 8.1 MB/s | 49 MB 00:06 2023-10-14T12:30:54.099 INFO:teuthology.orchestra.run.smithi123.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 144 kB/s | 70 kB 00:00 2023-10-14T12:30:54.158 INFO:teuthology.orchestra.run.smithi123.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 3.0 MB/s | 1.7 MB 00:00 2023-10-14T12:30:54.174 INFO:teuthology.orchestra.run.smithi072.stdout:(25/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 8.2 MB/s | 3.6 MB 00:00 2023-10-14T12:30:54.207 INFO:teuthology.orchestra.run.smithi123.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-10-14T12:30:54.233 INFO:teuthology.orchestra.run.smithi123.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 776 kB/s | 54 kB 00:00 2023-10-14T12:30:54.249 INFO:teuthology.orchestra.run.smithi072.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 2.3 MB/s | 179 kB 00:00 2023-10-14T12:30:54.291 INFO:teuthology.orchestra.run.smithi123.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-10-14T12:30:54.333 INFO:teuthology.orchestra.run.smithi123.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2023-10-14T12:30:54.346 INFO:teuthology.orchestra.run.smithi072.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 240 kB/s | 23 kB 00:00 2023-10-14T12:30:54.359 INFO:teuthology.orchestra.run.smithi123.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 579 kB/s | 39 kB 00:00 2023-10-14T12:30:54.392 INFO:teuthology.orchestra.run.smithi123.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-10-14T12:30:54.425 INFO:teuthology.orchestra.run.smithi072.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.6 MB/s | 132 kB 00:00 2023-10-14T12:30:54.426 INFO:teuthology.orchestra.run.smithi123.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.8 MB/s | 538 kB 00:00 2023-10-14T12:30:54.451 INFO:teuthology.orchestra.run.smithi123.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-14T12:30:54.477 INFO:teuthology.orchestra.run.smithi123.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-10-14T12:30:54.543 INFO:teuthology.orchestra.run.smithi123.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 7.6 MB/s | 713 kB 00:00 2023-10-14T12:30:54.585 INFO:teuthology.orchestra.run.smithi123.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 638 kB/s | 27 kB 00:00 2023-10-14T12:30:54.636 INFO:teuthology.orchestra.run.smithi123.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-14T12:30:54.669 INFO:teuthology.orchestra.run.smithi123.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-14T12:30:54.709 INFO:teuthology.orchestra.run.smithi072.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 6.2 MB/s | 1.8 MB 00:00 2023-10-14T12:30:54.778 INFO:teuthology.orchestra.run.smithi123.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2023-10-14T12:30:54.828 INFO:teuthology.orchestra.run.smithi123.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-10-14T12:30:54.870 INFO:teuthology.orchestra.run.smithi123.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-14T12:30:54.945 INFO:teuthology.orchestra.run.smithi123.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-10-14T12:30:54.992 INFO:teuthology.orchestra.run.smithi123.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 524 kB/s | 64 kB 00:00 2023-10-14T12:30:55.029 INFO:teuthology.orchestra.run.smithi123.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.5 MB/s | 126 kB 00:00 2023-10-14T12:30:55.046 INFO:teuthology.orchestra.run.smithi123.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 374 kB/s | 20 kB 00:00 2023-10-14T12:30:55.071 INFO:teuthology.orchestra.run.smithi123.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-10-14T12:30:55.105 INFO:teuthology.orchestra.run.smithi123.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-14T12:30:55.280 INFO:teuthology.orchestra.run.smithi123.stdout:(94/131): python3-scipy-1.0.0-21.module+el8.5.0 11 MB/s | 14 MB 00:01 2023-10-14T12:30:55.306 INFO:teuthology.orchestra.run.smithi123.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 987 kB/s | 198 kB 00:00 2023-10-14T12:30:55.348 INFO:teuthology.orchestra.run.smithi123.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-14T12:30:55.389 INFO:teuthology.orchestra.run.smithi123.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-14T12:30:55.506 INFO:teuthology.orchestra.run.smithi123.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2023-10-14T12:30:55.573 INFO:teuthology.orchestra.run.smithi123.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-10-14T12:30:55.607 INFO:teuthology.orchestra.run.smithi123.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.9 MB/s | 808 kB 00:00 2023-10-14T12:30:55.649 INFO:teuthology.orchestra.run.smithi123.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-10-14T12:30:55.716 INFO:teuthology.orchestra.run.smithi123.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-10-14T12:30:55.741 INFO:teuthology.orchestra.run.smithi123.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.1 MB/s | 200 kB 00:00 2023-10-14T12:30:55.766 INFO:teuthology.orchestra.run.smithi123.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 846 kB/s | 43 kB 00:00 2023-10-14T12:30:55.792 INFO:teuthology.orchestra.run.smithi123.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-14T12:30:55.817 INFO:teuthology.orchestra.run.smithi123.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-10-14T12:30:55.842 INFO:teuthology.orchestra.run.smithi123.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-14T12:30:55.843 INFO:teuthology.orchestra.run.smithi072.stdout:(30/131): ceph-mgr-diskprediction-local-18.0.0- 6.5 MB/s | 7.4 MB 00:01 2023-10-14T12:30:55.868 INFO:teuthology.orchestra.run.smithi123.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 844 kB/s | 43 kB 00:00 2023-10-14T12:30:55.894 INFO:teuthology.orchestra.run.smithi072.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6730.g4b 4.7 MB/s | 242 kB 00:00 2023-10-14T12:30:55.913 INFO:teuthology.orchestra.run.smithi123.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.5 MB/s | 109 kB 00:00 2023-10-14T12:30:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-10-14T12:30:55.977 INFO:teuthology.orchestra.run.smithi072.stdout:(32/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 569 kB/s | 47 kB 00:00 2023-10-14T12:30:56.011 INFO:teuthology.orchestra.run.smithi123.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.2 MB/s | 5.1 MB 00:00 2023-10-14T12:30:56.036 INFO:teuthology.orchestra.run.smithi123.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 203 kB/s | 19 kB 00:00 2023-10-14T12:30:56.061 INFO:teuthology.orchestra.run.smithi123.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-10-14T12:30:56.062 INFO:teuthology.orchestra.run.smithi072.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6730.g4 179 kB/s | 15 kB 00:00 2023-10-14T12:30:56.086 INFO:teuthology.orchestra.run.smithi123.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.2 MB/s | 560 kB 00:00 2023-10-14T12:30:56.112 INFO:teuthology.orchestra.run.smithi123.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-10-14T12:30:56.153 INFO:teuthology.orchestra.run.smithi072.stdout:(34/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 2.8 MB/s | 261 kB 00:00 2023-10-14T12:30:56.170 INFO:teuthology.orchestra.run.smithi123.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.1 MB/s | 559 kB 00:00 2023-10-14T12:30:56.204 INFO:teuthology.orchestra.run.smithi123.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-10-14T12:30:56.229 INFO:teuthology.orchestra.run.smithi123.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.0 MB/s | 238 kB 00:00 2023-10-14T12:30:56.246 INFO:teuthology.orchestra.run.smithi072.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 2.0 MB/s | 192 kB 00:00 2023-10-14T12:30:56.254 INFO:teuthology.orchestra.run.smithi123.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-14T12:30:56.279 INFO:teuthology.orchestra.run.smithi123.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-14T12:30:56.297 INFO:teuthology.orchestra.run.smithi123.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-10-14T12:30:56.322 INFO:teuthology.orchestra.run.smithi123.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-10-14T12:30:56.338 INFO:teuthology.orchestra.run.smithi072.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 197 kB/s | 18 kB 00:00 2023-10-14T12:30:56.339 INFO:teuthology.orchestra.run.smithi123.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-10-14T12:30:56.422 INFO:teuthology.orchestra.run.smithi072.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 3.6 MB/s | 306 kB 00:00 2023-10-14T12:30:56.456 INFO:teuthology.orchestra.run.smithi072.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.7 MB/s | 59 kB 00:00 2023-10-14T12:30:56.490 INFO:teuthology.orchestra.run.smithi072.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 2.2 MB/s | 75 kB 00:00 2023-10-14T12:30:56.533 INFO:teuthology.orchestra.run.smithi072.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 11 MB/s | 476 kB 00:00 2023-10-14T12:30:56.559 INFO:teuthology.orchestra.run.smithi072.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.7 MB/s | 44 kB 00:00 2023-10-14T12:30:56.593 INFO:teuthology.orchestra.run.smithi072.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 5.4 MB/s | 185 kB 00:00 2023-10-14T12:30:56.598 INFO:teuthology.orchestra.run.smithi123.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 140 kB/s | 39 kB 00:00 2023-10-14T12:30:56.627 INFO:teuthology.orchestra.run.smithi072.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 989 kB/s | 33 kB 00:00 2023-10-14T12:30:56.639 INFO:teuthology.orchestra.run.smithi123.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 2.1 MB/s | 644 kB 00:00 2023-10-14T12:30:56.661 INFO:teuthology.orchestra.run.smithi072.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 485 kB/s | 16 kB 00:00 2023-10-14T12:30:56.694 INFO:teuthology.orchestra.run.smithi072.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 5.0 MB/s | 173 kB 00:00 2023-10-14T12:30:56.699 INFO:teuthology.orchestra.run.smithi123.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.7 MB/s | 171 kB 00:00 2023-10-14T12:30:56.732 INFO:teuthology.orchestra.run.smithi123.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.5 MB/s | 138 kB 00:00 2023-10-14T12:30:56.737 INFO:teuthology.orchestra.run.smithi072.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 9.0 MB/s | 384 kB 00:00 2023-10-14T12:30:56.771 INFO:teuthology.orchestra.run.smithi072.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2023-10-14T12:30:56.790 INFO:teuthology.orchestra.run.smithi123.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 3.7 MB/s | 2.3 MB 00:00 2023-10-14T12:30:56.804 INFO:teuthology.orchestra.run.smithi072.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 332 kB/s | 11 kB 00:00 2023-10-14T12:30:56.839 INFO:teuthology.orchestra.run.smithi072.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 524 kB/s | 18 kB 00:00 2023-10-14T12:30:56.849 INFO:teuthology.orchestra.run.smithi123.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-14T12:30:57.268 INFO:teuthology.orchestra.run.smithi072.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 2.7 MB/s | 1.2 MB 00:00 2023-10-14T12:30:57.298 INFO:teuthology.orchestra.run.smithi072.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.6 MB/s | 49 kB 00:00 2023-10-14T12:30:57.332 INFO:teuthology.orchestra.run.smithi072.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.7 MB/s | 59 kB 00:00 2023-10-14T12:30:57.366 INFO:teuthology.orchestra.run.smithi072.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.8 MB/s | 60 kB 00:00 2023-10-14T12:30:57.427 INFO:teuthology.orchestra.run.smithi072.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.6 MB/s | 283 kB 00:00 2023-10-14T12:30:57.460 INFO:teuthology.orchestra.run.smithi072.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 468 kB/s | 16 kB 00:00 2023-10-14T12:30:57.494 INFO:teuthology.orchestra.run.smithi072.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 1.0 MB/s | 34 kB 00:00 2023-10-14T12:30:57.537 INFO:teuthology.orchestra.run.smithi072.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 4.6 MB/s | 196 kB 00:00 2023-10-14T12:30:57.570 INFO:teuthology.orchestra.run.smithi072.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.9 MB/s | 64 kB 00:00 2023-10-14T12:30:57.596 INFO:teuthology.orchestra.run.smithi072.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 741 kB/s | 19 kB 00:00 2023-10-14T12:30:57.630 INFO:teuthology.orchestra.run.smithi072.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 715 kB/s | 24 kB 00:00 2023-10-14T12:30:57.664 INFO:teuthology.orchestra.run.smithi072.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 875 kB/s | 29 kB 00:00 2023-10-14T12:30:57.698 INFO:teuthology.orchestra.run.smithi072.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 826 kB/s | 27 kB 00:00 2023-10-14T12:30:57.731 INFO:teuthology.orchestra.run.smithi072.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 7.5 MB/s | 255 kB 00:00 2023-10-14T12:30:57.774 INFO:teuthology.orchestra.run.smithi072.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 5.9 MB/s | 251 kB 00:00 2023-10-14T12:30:57.808 INFO:teuthology.orchestra.run.smithi072.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.8 MB/s | 61 kB 00:00 2023-10-14T12:30:57.842 INFO:teuthology.orchestra.run.smithi072.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 2.5 MB/s | 85 kB 00:00 2023-10-14T12:30:57.875 INFO:teuthology.orchestra.run.smithi072.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 687 kB/s | 23 kB 00:00 2023-10-14T12:30:57.943 INFO:teuthology.orchestra.run.smithi072.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 26 MB/s | 1.7 MB 00:00 2023-10-14T12:30:58.007 INFO:teuthology.orchestra.run.smithi123.stdout:(130/131): librados2-18.0.0-6730.g4ba8a190.el8. 2.9 MB/s | 3.7 MB 00:01 2023-10-14T12:30:58.124 INFO:teuthology.orchestra.run.smithi123.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 2.7 MB/s | 3.7 MB 00:01 2023-10-14T12:30:58.127 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2023-10-14T12:30:58.127 INFO:teuthology.orchestra.run.smithi123.stdout:Total 16 MB/s | 209 MB 00:13 2023-10-14T12:30:58.745 INFO:teuthology.orchestra.run.smithi072.stdout:(69/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 6.6 MB/s | 49 MB 00:07 2023-10-14T12:30:58.770 INFO:teuthology.orchestra.run.smithi072.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 84 kB/s | 70 kB 00:00 2023-10-14T12:30:58.837 INFO:teuthology.orchestra.run.smithi072.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-10-14T12:30:58.880 INFO:teuthology.orchestra.run.smithi072.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-14T12:30:58.922 INFO:teuthology.orchestra.run.smithi072.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.0 MB/s | 259 kB 00:00 2023-10-14T12:30:58.948 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2023-10-14T12:30:58.973 INFO:teuthology.orchestra.run.smithi072.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-10-14T12:30:59.006 INFO:teuthology.orchestra.run.smithi072.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-10-14T12:30:59.065 INFO:teuthology.orchestra.run.smithi072.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-10-14T12:30:59.068 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2023-10-14T12:30:59.068 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2023-10-14T12:30:59.116 INFO:teuthology.orchestra.run.smithi072.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-10-14T12:30:59.358 INFO:teuthology.orchestra.run.smithi072.stdout:(78/131): python3-scipy-1.0.0-21.module+el8.5.0 22 MB/s | 14 MB 00:00 2023-10-14T12:30:59.384 INFO:teuthology.orchestra.run.smithi072.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 586 kB/s | 157 kB 00:00 2023-10-14T12:30:59.409 INFO:teuthology.orchestra.run.smithi072.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-14T12:30:59.452 INFO:teuthology.orchestra.run.smithi072.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-10-14T12:30:59.494 INFO:teuthology.orchestra.run.smithi072.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 635 kB/s | 27 kB 00:00 2023-10-14T12:30:59.536 INFO:teuthology.orchestra.run.smithi072.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-14T12:30:59.581 INFO:teuthology.orchestra.run.smithi072.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-10-14T12:30:59.730 INFO:teuthology.orchestra.run.smithi072.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-10-14T12:30:59.789 INFO:teuthology.orchestra.run.smithi072.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 7.6 MB/s | 457 kB 00:00 2023-10-14T12:30:59.898 INFO:teuthology.orchestra.run.smithi072.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-10-14T12:30:59.923 INFO:teuthology.orchestra.run.smithi072.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-10-14T12:30:59.957 INFO:teuthology.orchestra.run.smithi072.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-10-14T12:30:59.985 INFO:teuthology.orchestra.run.smithi072.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-10-14T12:31:00.008 INFO:teuthology.orchestra.run.smithi072.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 395 kB/s | 20 kB 00:00 2023-10-14T12:31:00.034 INFO:teuthology.orchestra.run.smithi072.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-14T12:31:00.076 INFO:teuthology.orchestra.run.smithi072.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-14T12:31:00.127 INFO:teuthology.orchestra.run.smithi072.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-10-14T12:31:00.197 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2023-10-14T12:31:00.201 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2023-10-14T12:31:00.269 INFO:teuthology.orchestra.run.smithi072.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 21 MB/s | 4.9 MB 00:00 2023-10-14T12:31:00.495 INFO:teuthology.orchestra.run.smithi072.stdout:(96/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 1.3 MB/s | 14 MB 00:10 2023-10-14T12:31:00.520 INFO:teuthology.orchestra.run.smithi072.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 806 kB/s | 202 kB 00:00 2023-10-14T12:31:00.580 INFO:teuthology.orchestra.run.smithi072.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-10-14T12:31:00.726 INFO:teuthology.orchestra.run.smithi072.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 7.9 MB/s | 4.7 MB 00:00 2023-10-14T12:31:00.798 INFO:teuthology.orchestra.run.smithi072.stdout:(100/131): postgresql-contrib-10.21-2.module+el 3.6 MB/s | 808 kB 00:00 2023-10-14T12:31:00.857 INFO:teuthology.orchestra.run.smithi072.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-10-14T12:31:00.883 INFO:teuthology.orchestra.run.smithi072.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 556 kB/s | 47 kB 00:00 2023-10-14T12:31:00.917 INFO:teuthology.orchestra.run.smithi072.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.3 MB/s | 200 kB 00:00 2023-10-14T12:31:00.942 INFO:teuthology.orchestra.run.smithi072.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 723 kB/s | 43 kB 00:00 2023-10-14T12:31:00.968 INFO:teuthology.orchestra.run.smithi072.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.2 MB/s | 220 kB 00:00 2023-10-14T12:31:01.002 INFO:teuthology.orchestra.run.smithi072.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 812 kB/s | 48 kB 00:00 2023-10-14T12:31:01.027 INFO:teuthology.orchestra.run.smithi072.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2023-10-14T12:31:01.053 INFO:teuthology.orchestra.run.smithi072.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 839 kB/s | 43 kB 00:00 2023-10-14T12:31:01.079 INFO:teuthology.orchestra.run.smithi072.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-14T12:31:01.112 INFO:teuthology.orchestra.run.smithi072.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-10-14T12:31:01.213 INFO:teuthology.orchestra.run.smithi072.stdout:(111/131): postgresql-server-10.21-2.module+el8 7.4 MB/s | 5.1 MB 00:00 2023-10-14T12:31:01.238 INFO:teuthology.orchestra.run.smithi072.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 149 kB/s | 19 kB 00:00 2023-10-14T12:31:01.266 INFO:teuthology.orchestra.run.smithi072.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.9 MB/s | 155 kB 00:00 2023-10-14T12:31:01.308 INFO:teuthology.orchestra.run.smithi072.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.4 MB/s | 560 kB 00:00 2023-10-14T12:31:01.333 INFO:teuthology.orchestra.run.smithi072.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 266 kB/s | 18 kB 00:00 2023-10-14T12:31:01.367 INFO:teuthology.orchestra.run.smithi072.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.3 MB/s | 559 kB 00:00 2023-10-14T12:31:01.401 INFO:teuthology.orchestra.run.smithi072.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.4 MB/s | 238 kB 00:00 2023-10-14T12:31:01.435 INFO:teuthology.orchestra.run.smithi072.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-14T12:31:01.460 INFO:teuthology.orchestra.run.smithi072.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-14T12:31:01.494 INFO:teuthology.orchestra.run.smithi072.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-10-14T12:31:01.520 INFO:teuthology.orchestra.run.smithi072.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.0 MB/s | 60 kB 00:00 2023-10-14T12:31:01.545 INFO:teuthology.orchestra.run.smithi072.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-14T12:31:01.571 INFO:teuthology.orchestra.run.smithi072.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-14T12:31:01.596 INFO:teuthology.orchestra.run.smithi072.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 761 kB/s | 39 kB 00:00 2023-10-14T12:31:01.642 INFO:teuthology.orchestra.run.smithi072.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.3 MB/s | 644 kB 00:00 2023-10-14T12:31:01.708 INFO:teuthology.orchestra.run.smithi072.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.5 MB/s | 171 kB 00:00 2023-10-14T12:31:01.731 INFO:teuthology.orchestra.run.smithi072.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.5 MB/s | 138 kB 00:00 2023-10-14T12:31:01.799 INFO:teuthology.orchestra.run.smithi072.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.4 MB/s | 2.3 MB 00:00 2023-10-14T12:31:01.859 INFO:teuthology.orchestra.run.smithi072.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-14T12:31:02.101 INFO:teuthology.orchestra.run.smithi072.stdout:(130/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 10 MB/s | 3.7 MB 00:00 2023-10-14T12:31:03.151 INFO:teuthology.orchestra.run.smithi072.stdout:(131/131): librados2-18.0.0-6730.g4ba8a190.el8. 2.6 MB/s | 3.7 MB 00:01 2023-10-14T12:31:03.155 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-10-14T12:31:03.155 INFO:teuthology.orchestra.run.smithi072.stdout:Total 12 MB/s | 209 MB 00:17 2023-10-14T12:31:03.999 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-10-14T12:31:04.117 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-10-14T12:31:04.118 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-10-14T12:31:05.230 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-10-14T12:31:05.234 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-10-14T12:31:05.902 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2023-10-14T12:31:06.094 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-14T12:31:06.229 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-14T12:31:06.469 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-14T12:31:06.663 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T12:31:06.825 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T12:31:07.063 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T12:31:07.472 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T12:31:07.821 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:31:08.231 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:31:08.462 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:31:08.605 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:31:08.821 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:31:08.937 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:31:09.159 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T12:31:09.415 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-14T12:31:09.649 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-14T12:31:10.067 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-14T12:31:10.320 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-14T12:31:10.341 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-10-14T12:31:10.479 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T12:31:10.548 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-14T12:31:10.614 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T12:31:10.731 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-14T12:31:10.804 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T12:31:10.877 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T12:31:10.979 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-14T12:31:11.029 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T12:31:11.156 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T12:31:11.164 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T12:31:11.278 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T12:31:11.312 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T12:31:11.498 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T12:31:11.904 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T12:31:11.916 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T12:31:12.070 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T12:31:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:31:12.550 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:31:12.696 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T12:31:12.787 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:31:12.902 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:31:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:31:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:31:13.387 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T12:31:13.754 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T12:31:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-14T12:31:14.101 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T12:31:14.252 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-14T12:31:14.408 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-14T12:31:14.670 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-14T12:31:14.682 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-14T12:31:14.907 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-14T12:31:14.971 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-14T12:31:15.109 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-14T12:31:15.138 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T12:31:15.256 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T12:31:15.341 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-14T12:31:15.447 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T12:31:15.523 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T12:31:15.581 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-14T12:31:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T12:31:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-14T12:31:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T12:31:15.881 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-14T12:31:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T12:31:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T12:31:16.787 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-14T12:31:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T12:31:17.142 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-14T12:31:17.406 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T12:31:17.430 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-14T12:31:17.597 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T12:31:17.706 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-14T12:31:17.928 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T12:31:18.327 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T12:31:18.624 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-14T12:31:18.890 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-14T12:31:19.426 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-14T12:31:19.588 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-14T12:31:19.700 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T12:31:19.798 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-14T12:31:20.012 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-14T12:31:20.028 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-14T12:31:20.201 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-14T12:31:20.239 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-14T12:31:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-14T12:31:20.446 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-14T12:31:20.659 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-14T12:31:20.789 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-14T12:31:20.971 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-14T12:31:21.167 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-14T12:31:21.254 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-14T12:31:21.363 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-14T12:31:21.505 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-14T12:31:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-14T12:31:21.739 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-14T12:31:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-14T12:31:21.971 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-14T12:31:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-14T12:31:22.296 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T12:31:22.351 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-14T12:31:22.639 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-14T12:31:22.862 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-14T12:31:23.106 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-14T12:31:23.373 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-14T12:31:23.710 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-14T12:31:24.009 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-14T12:31:24.090 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T12:31:24.231 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-14T12:31:24.422 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-14T12:31:24.481 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-14T12:31:24.624 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-14T12:31:24.644 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-14T12:31:24.805 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-14T12:31:24.873 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-14T12:31:25.053 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-14T12:31:25.123 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-14T12:31:25.214 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-14T12:31:25.380 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-14T12:31:25.426 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-14T12:31:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-14T12:31:25.698 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-14T12:31:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-14T12:31:25.940 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-14T12:31:25.950 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-14T12:31:26.125 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-14T12:31:26.158 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-14T12:31:26.261 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-14T12:31:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-14T12:31:26.564 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T12:31:26.640 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T12:31:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-14T12:31:26.896 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-14T12:31:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-14T12:31:27.122 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-14T12:31:27.222 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-14T12:31:27.301 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T12:31:27.369 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T12:31:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-14T12:31:27.625 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-14T12:31:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-14T12:31:27.820 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-14T12:31:28.003 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-14T12:31:28.052 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-14T12:31:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-14T12:31:28.273 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-14T12:31:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-14T12:31:28.566 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-14T12:31:28.677 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-14T12:31:28.825 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-14T12:31:28.912 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-14T12:31:29.006 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-14T12:31:29.118 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-14T12:31:29.145 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-14T12:31:29.369 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-14T12:31:29.444 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-14T12:31:29.597 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-14T12:31:29.717 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-14T12:31:29.795 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-14T12:31:29.979 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-14T12:31:30.016 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-14T12:31:30.165 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-14T12:31:30.244 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-14T12:31:30.363 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-14T12:31:30.427 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-14T12:31:30.605 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-14T12:31:30.620 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-14T12:31:30.785 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T12:31:30.857 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-14T12:31:30.896 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T12:31:31.114 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-14T12:31:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-14T12:31:31.358 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-14T12:31:31.392 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-14T12:31:31.537 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T12:31:31.582 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-14T12:31:31.618 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T12:31:31.786 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-14T12:31:31.867 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-14T12:31:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-14T12:31:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-14T12:31:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-14T12:31:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-14T12:31:32.921 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-14T12:31:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-14T12:31:33.139 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-14T12:31:33.238 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-14T12:31:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-14T12:31:33.484 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-14T12:31:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-14T12:31:33.699 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-14T12:31:33.812 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-14T12:31:33.924 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-14T12:31:34.081 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-14T12:31:34.089 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-14T12:31:34.226 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-14T12:31:34.302 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-14T12:31:34.450 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-14T12:31:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-14T12:31:34.934 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-14T12:31:35.150 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-14T12:31:35.200 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-14T12:31:35.350 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T12:31:35.411 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T12:31:35.419 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-14T12:31:35.600 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-14T12:31:35.609 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-14T12:31:35.853 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-14T12:31:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-14T12:31:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-14T12:31:37.460 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-14T12:31:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-14T12:31:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-14T12:31:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-14T12:31:39.101 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-14T12:31:39.286 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T12:31:39.359 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T12:31:39.434 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:31:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-14T12:31:39.700 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:31:40.291 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:31:40.608 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T12:31:40.671 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T12:31:40.824 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T12:31:43.302 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:31:43.519 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:31:44.135 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T12:31:44.441 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T12:31:44.522 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T12:31:44.677 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T12:31:59.664 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T12:31:59.664 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2023-10-14T12:31:59.665 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2023-10-14T12:31:59.665 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2023-10-14T12:31:59.665 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /run 2023-10-14T12:31:59.665 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2023-10-14T12:31:59.665 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2023-10-14T12:31:59.665 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2023-10-14T12:31:59.666 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2023-10-14T12:31:59.666 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2023-10-14T12:31:59.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:00.029 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T12:32:01.615 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T12:32:01.804 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T12:32:02.025 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T12:32:02.213 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T12:32:02.681 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T12:32:02.904 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T12:32:02.921 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T12:32:04.633 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T12:32:04.864 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T12:32:05.018 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-14T12:32:05.209 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-14T12:32:05.359 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T12:32:05.359 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-10-14T12:32:05.360 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-10-14T12:32:05.360 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-10-14T12:32:05.360 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2023-10-14T12:32:05.360 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-10-14T12:32:05.361 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-10-14T12:32:05.361 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-10-14T12:32:05.361 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-10-14T12:32:05.361 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-10-14T12:32:05.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:05.387 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T12:32:05.605 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T12:32:05.697 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T12:32:05.961 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T12:32:06.920 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T12:32:07.095 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T12:32:07.186 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T12:32:07.286 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T12:32:07.471 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T12:32:07.608 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-14T12:32:07.690 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T12:32:07.778 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T12:32:07.813 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T12:32:07.857 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T12:32:08.011 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T12:32:08.023 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T12:32:08.324 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T12:32:08.516 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T12:32:08.533 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T12:32:09.376 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-14T12:32:09.694 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T12:32:09.728 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T12:32:09.953 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T12:32:09.995 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T12:32:10.203 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T12:32:10.264 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T12:32:10.490 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T12:32:10.574 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T12:32:10.605 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-14T12:32:10.778 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T12:32:10.787 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-14T12:32:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T12:32:11.200 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T12:32:11.562 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T12:32:12.518 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T12:32:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T12:32:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T12:32:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-14T12:32:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T12:32:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T12:32:13.546 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T12:32:13.558 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T12:32:14.879 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-14T12:32:15.115 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T12:32:15.150 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T12:32:15.307 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T12:32:15.349 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T12:32:15.423 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T12:32:15.549 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T12:32:15.739 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-14T12:32:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T12:32:15.918 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T12:32:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T12:32:16.109 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T12:32:17.037 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-14T12:32:17.397 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-14T12:32:17.598 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-14T12:32:17.814 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T12:32:18.014 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-14T12:32:18.153 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T12:32:20.370 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:32:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:32:20.653 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:32:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T12:32:20.863 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-14T12:32:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-14T12:32:21.172 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T12:32:21.176 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-14T12:32:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T12:32:21.515 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-14T12:32:21.911 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-14T12:32:22.076 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:32:22.085 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:32:22.296 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-14T12:32:22.303 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-14T12:32:22.501 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T12:32:22.584 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T12:32:22.651 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-14T12:32:22.809 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T12:32:22.822 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T12:32:22.823 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:32:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-14T12:32:23.034 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T12:32:23.054 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:32:23.054 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T12:32:23.199 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-14T12:32:23.332 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T12:32:23.357 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T12:32:23.558 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:32:24.089 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:32:24.090 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-14T12:32:24.090 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-14T12:32:24.090 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-14T12:32:24.090 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-14T12:32:24.090 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-14T12:32:24.091 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:32:24.091 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:32:24.091 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:32:24.091 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T12:32:24.091 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-14T12:32:24.092 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-14T12:32:24.092 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-14T12:32:24.092 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-14T12:32:24.092 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-14T12:32:24.092 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-14T12:32:24.093 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-14T12:32:24.093 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-14T12:32:24.093 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-14T12:32:24.093 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-14T12:32:24.093 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-14T12:32:24.093 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-14T12:32:24.094 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-14T12:32:24.094 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-14T12:32:24.094 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-14T12:32:24.094 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-14T12:32:24.094 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-14T12:32:24.095 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-14T12:32:24.095 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-14T12:32:24.095 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-14T12:32:24.095 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-14T12:32:24.095 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-14T12:32:24.095 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-14T12:32:24.104 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-14T12:32:24.104 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-14T12:32:24.105 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-14T12:32:24.105 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-14T12:32:24.105 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-14T12:32:24.105 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-14T12:32:24.105 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-14T12:32:24.106 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-14T12:32:24.106 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-14T12:32:24.106 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-14T12:32:24.106 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-14T12:32:24.106 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-14T12:32:24.107 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-14T12:32:24.107 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-14T12:32:24.107 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-14T12:32:24.107 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-14T12:32:24.107 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-14T12:32:24.107 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-14T12:32:24.108 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-14T12:32:24.108 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-14T12:32:24.108 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-14T12:32:24.108 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-14T12:32:24.108 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-14T12:32:24.109 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-14T12:32:24.109 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-14T12:32:24.109 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-14T12:32:24.109 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-14T12:32:24.109 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-14T12:32:24.110 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-14T12:32:24.110 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-14T12:32:24.110 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-14T12:32:24.110 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-14T12:32:24.110 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-14T12:32:24.110 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-14T12:32:24.111 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-14T12:32:24.111 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-14T12:32:24.111 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-14T12:32:24.111 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-14T12:32:24.111 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-14T12:32:24.112 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-14T12:32:24.112 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-14T12:32:24.112 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-14T12:32:24.112 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-14T12:32:24.112 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-14T12:32:24.112 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-14T12:32:24.113 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-14T12:32:24.113 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-14T12:32:24.113 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-14T12:32:24.113 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-14T12:32:24.113 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-14T12:32:24.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-14T12:32:24.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-14T12:32:24.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-14T12:32:24.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-14T12:32:24.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-14T12:32:24.114 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-14T12:32:24.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-14T12:32:24.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-14T12:32:24.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-14T12:32:24.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-14T12:32:24.115 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-14T12:32:24.116 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-14T12:32:24.116 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-14T12:32:24.116 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-14T12:32:24.116 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-14T12:32:24.116 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-14T12:32:24.116 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-14T12:32:24.117 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-14T12:32:24.117 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-14T12:32:24.117 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-14T12:32:24.117 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-14T12:32:24.117 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-14T12:32:24.118 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-14T12:32:24.118 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-14T12:32:24.118 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-14T12:32:24.118 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-14T12:32:24.118 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-14T12:32:24.118 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-14T12:32:24.119 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-14T12:32:24.119 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-14T12:32:24.119 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-14T12:32:24.119 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-14T12:32:24.119 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-14T12:32:24.120 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-14T12:32:24.120 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-14T12:32:24.120 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-14T12:32:24.120 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-14T12:32:24.120 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T12:32:24.120 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-14T12:32:24.121 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T12:32:24.121 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-14T12:32:24.121 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-14T12:32:24.121 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-14T12:32:24.121 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-14T12:32:24.121 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-14T12:32:24.122 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:32:24.122 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-14T12:32:24.122 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-14T12:32:24.122 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-14T12:32:24.122 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:32:24.123 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-14T12:32:25.581 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:32:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:32:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T12:32:25.997 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-14T12:32:26.288 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-14T12:32:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-14T12:32:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-14T12:32:26.986 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:32:26.986 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:01:53 ago on Sat 14 Oct 2023 12:30:33 PM UTC. 2023-10-14T12:32:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:32:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:32:27.334 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-14T12:32:27.553 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T12:32:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T12:32:27.863 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T12:32:27.877 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T12:32:27.877 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:32:28.093 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:32:28.093 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T12:32:28.332 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T12:32:28.554 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:32:29.070 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:32:29.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-14T12:32:29.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-14T12:32:29.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-14T12:32:29.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-14T12:32:29.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-14T12:32:29.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T12:32:29.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T12:32:29.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T12:32:29.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T12:32:29.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-14T12:32:29.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-14T12:32:29.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-14T12:32:29.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-14T12:32:29.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-14T12:32:29.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-14T12:32:29.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-14T12:32:29.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-14T12:32:29.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-14T12:32:29.074 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-14T12:32:29.074 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-14T12:32:29.074 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-14T12:32:29.074 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-14T12:32:29.075 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-14T12:32:29.075 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-14T12:32:29.075 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-14T12:32:29.075 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-14T12:32:29.075 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-14T12:32:29.075 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-14T12:32:29.076 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-14T12:32:29.076 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-14T12:32:29.086 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-14T12:32:29.086 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-14T12:32:29.086 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-14T12:32:29.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-14T12:32:29.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-14T12:32:29.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-14T12:32:29.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-14T12:32:29.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-14T12:32:29.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-14T12:32:29.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-14T12:32:29.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-14T12:32:29.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-14T12:32:29.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-14T12:32:29.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-14T12:32:29.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-14T12:32:29.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-14T12:32:29.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-14T12:32:29.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-14T12:32:29.090 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-14T12:32:29.090 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-14T12:32:29.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-14T12:32:29.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-14T12:32:29.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-14T12:32:29.092 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-14T12:32:29.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-14T12:32:29.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-14T12:32:29.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-14T12:32:29.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-14T12:32:29.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-14T12:32:29.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-14T12:32:29.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-14T12:32:29.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-14T12:32:29.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-14T12:32:29.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-14T12:32:29.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-14T12:32:29.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-14T12:32:29.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-14T12:32:29.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-14T12:32:29.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-14T12:32:29.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-14T12:32:29.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-14T12:32:29.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-14T12:32:29.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-14T12:32:29.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-14T12:32:29.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-14T12:32:29.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-14T12:32:29.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-14T12:32:29.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-14T12:32:29.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-14T12:32:29.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-14T12:32:29.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-14T12:32:29.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-14T12:32:29.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-14T12:32:29.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-14T12:32:29.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-14T12:32:29.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-14T12:32:29.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-14T12:32:29.100 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-14T12:32:29.100 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-14T12:32:29.100 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-14T12:32:29.100 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-14T12:32:29.100 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-14T12:32:29.100 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-14T12:32:29.101 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-14T12:32:29.101 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-14T12:32:29.101 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-14T12:32:29.101 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-14T12:32:29.101 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-14T12:32:29.102 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-14T12:32:29.102 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-14T12:32:29.102 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-14T12:32:29.102 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-14T12:32:29.102 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-14T12:32:29.103 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-14T12:32:29.103 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-14T12:32:29.103 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-14T12:32:29.103 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-14T12:32:29.103 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-14T12:32:29.104 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-14T12:32:29.104 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-14T12:32:29.104 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-14T12:32:29.104 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-14T12:32:29.105 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-14T12:32:29.106 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-14T12:32:29.106 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-14T12:32:29.106 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-14T12:32:29.106 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-14T12:32:29.106 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-14T12:32:29.107 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-14T12:32:29.107 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T12:32:29.107 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-14T12:32:29.107 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T12:32:29.107 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-14T12:32:29.107 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-14T12:32:29.108 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-14T12:32:29.108 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-14T12:32:29.108 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-14T12:32:29.108 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T12:32:29.108 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-14T12:32:29.109 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-14T12:32:29.109 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-14T12:32:29.109 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T12:32:29.109 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-14T12:32:29.578 INFO:teuthology.orchestra.run.smithi123.stdout:Installed products updated. 2023-10-14T12:32:29.802 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:29.803 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2023-10-14T12:32:29.803 INFO:teuthology.orchestra.run.smithi123.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-14T12:32:29.803 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.803 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.803 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2023-10-14T12:32:29.804 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-14T12:32:29.804 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T12:32:29.804 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T12:32:29.804 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.804 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.804 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.805 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.805 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.805 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.805 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.805 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.807 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.807 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.807 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.807 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.807 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.807 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.808 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.808 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.808 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.808 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:29.808 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-14T12:32:29.809 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T12:32:29.809 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-14T12:32:29.809 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T12:32:29.809 INFO:teuthology.orchestra.run.smithi123.stdout: jq-1.6-3.el8.x86_64 2023-10-14T12:32:29.809 INFO:teuthology.orchestra.run.smithi123.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-14T12:32:29.809 INFO:teuthology.orchestra.run.smithi123.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-14T12:32:29.810 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T12:32:29.810 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.810 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.810 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.811 INFO:teuthology.orchestra.run.smithi123.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-14T12:32:29.811 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-14T12:32:29.811 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T12:32:29.811 INFO:teuthology.orchestra.run.smithi123.stdout: libpq-13.5-1.el8.x86_64 2023-10-14T12:32:29.811 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-14T12:32:29.811 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T12:32:29.812 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.812 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.812 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T12:32:29.812 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.812 INFO:teuthology.orchestra.run.smithi123.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T12:32:29.813 INFO:teuthology.orchestra.run.smithi123.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-14T12:32:29.813 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T12:32:29.813 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T12:32:29.813 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-14T12:32:29.813 INFO:teuthology.orchestra.run.smithi123.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T12:32:29.814 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T12:32:29.814 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T12:32:29.814 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-14T12:32:29.814 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-14T12:32:29.814 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-14T12:32:29.815 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T12:32:29.815 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T12:32:29.815 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T12:32:29.815 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:32:29.815 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:32:29.815 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:32:29.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T12:32:29.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T12:32:29.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T12:32:29.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T12:32:29.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T12:32:29.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T12:32:29.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-14T12:32:29.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T12:32:29.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T12:32:29.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-14T12:32:29.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T12:32:29.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T12:32:29.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T12:32:29.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T12:32:29.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T12:32:29.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T12:32:29.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T12:32:29.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T12:32:29.820 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T12:32:29.820 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T12:32:29.820 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T12:32:29.820 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T12:32:29.820 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T12:32:29.821 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T12:32:29.821 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T12:32:29.821 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T12:32:29.821 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T12:32:29.821 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T12:32:29.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T12:32:29.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T12:32:29.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T12:32:29.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T12:32:29.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T12:32:29.822 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T12:32:29.823 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.823 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.823 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T12:32:29.823 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T12:32:29.823 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.824 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T12:32:29.824 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T12:32:29.824 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-14T12:32:29.824 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T12:32:29.824 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T12:32:29.824 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T12:32:29.825 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T12:32:29.825 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T12:32:29.825 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T12:32:29.825 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T12:32:29.825 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T12:32:29.826 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T12:32:29.826 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T12:32:29.826 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.826 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.826 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:29.826 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T12:32:29.827 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T12:32:29.827 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-14T12:32:29.827 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-14T12:32:29.827 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T12:32:29.828 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-14T12:32:29.828 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:29.828 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2023-10-14T12:32:30.126 DEBUG:teuthology.parallel:result is None 2023-10-14T12:32:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T12:32:32.015 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:58 ago on Sat 14 Oct 2023 12:30:34 PM UTC. 2023-10-14T12:32:34.635 INFO:teuthology.orchestra.run.smithi072.stdout:Installed products updated. 2023-10-14T12:32:34.868 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:34.868 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-10-14T12:32:34.869 INFO:teuthology.orchestra.run.smithi072.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-14T12:32:34.869 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.869 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.869 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-10-14T12:32:34.870 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-14T12:32:34.870 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T12:32:34.870 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T12:32:34.870 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.870 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.871 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.871 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.871 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.871 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.871 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.872 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.872 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.872 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.872 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.872 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.873 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.873 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.873 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.873 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.873 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.874 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.874 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.874 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.874 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.874 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.875 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T12:32:34.875 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-14T12:32:34.875 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T12:32:34.875 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-14T12:32:34.875 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T12:32:34.876 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-3.el8.x86_64 2023-10-14T12:32:34.876 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-14T12:32:34.876 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-14T12:32:34.876 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T12:32:34.876 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.876 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.877 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.877 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-14T12:32:34.877 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-14T12:32:34.877 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T12:32:34.878 INFO:teuthology.orchestra.run.smithi072.stdout: libpq-13.5-1.el8.x86_64 2023-10-14T12:32:34.878 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-14T12:32:34.878 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T12:32:34.878 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.878 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.879 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T12:32:34.879 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.879 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T12:32:34.879 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-14T12:32:34.879 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T12:32:34.880 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T12:32:34.880 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-14T12:32:34.880 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T12:32:34.880 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T12:32:34.880 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T12:32:34.881 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-14T12:32:34.881 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-14T12:32:34.881 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-14T12:32:34.881 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T12:32:34.881 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T12:32:34.882 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T12:32:34.882 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:32:34.882 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:32:34.882 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T12:32:34.882 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T12:32:34.883 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T12:32:34.883 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T12:32:34.883 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T12:32:34.883 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T12:32:34.883 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.884 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.884 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.884 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T12:32:34.884 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-14T12:32:34.884 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T12:32:34.885 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T12:32:34.885 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-14T12:32:34.885 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T12:32:34.885 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T12:32:34.886 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T12:32:34.886 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T12:32:34.886 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T12:32:34.886 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T12:32:34.886 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T12:32:34.887 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T12:32:34.887 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T12:32:34.887 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T12:32:34.887 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T12:32:34.887 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T12:32:34.888 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T12:32:34.888 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T12:32:34.888 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T12:32:34.888 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T12:32:34.888 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T12:32:34.889 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T12:32:34.889 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T12:32:34.889 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T12:32:34.889 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T12:32:34.889 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T12:32:34.889 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T12:32:34.890 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T12:32:34.890 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.890 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.890 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T12:32:34.890 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T12:32:34.891 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.891 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T12:32:34.891 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T12:32:34.891 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-14T12:32:34.891 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T12:32:34.891 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T12:32:34.892 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T12:32:34.892 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T12:32:34.892 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T12:32:34.892 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T12:32:34.892 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T12:32:34.893 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T12:32:34.893 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T12:32:34.893 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T12:32:34.893 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.893 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.893 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T12:32:34.894 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T12:32:34.894 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T12:32:34.894 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-14T12:32:34.894 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-14T12:32:34.895 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T12:32:34.895 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-14T12:32:34.895 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:34.896 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-10-14T12:32:35.078 DEBUG:teuthology.parallel:result is None 2023-10-14T12:32:35.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:32:35.306 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T12:32:35.330 INFO:teuthology.orchestra.run.smithi072.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-14T12:32:35.331 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-14T12:32:35.331 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T12:32:35.332 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:32:35.474 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T12:32:35.502 INFO:teuthology.orchestra.run.smithi123.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-14T12:32:35.503 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-14T12:32:35.503 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T12:32:35.504 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T12:32:35.504 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:35.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T12:32:35.546 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:32:35.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T12:32:35.594 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T12:32:35.595 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:35.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T12:32:35.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T12:32:35.688 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:32:35.688 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T12:32:35.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T12:32:35.788 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T12:32:35.788 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:35.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T12:32:35.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T12:32:35.882 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:32:35.882 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T12:32:35.911 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T12:32:35.979 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T12:32:35.979 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:35.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T12:32:36.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T12:32:36.072 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:32:36.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T12:32:36.101 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T12:32:36.168 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T12:32:36.234 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T12:32:36.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-10-14T12:32:36.237 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2023-10-14T12:32:36.264 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T12:32:36.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T12:32:36.303 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T12:32:36.331 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T12:32:36.331 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T12:32:36.369 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T12:32:36.404 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T12:32:36.405 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T12:32:36.405 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T12:32:36.406 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:36.406 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T12:32:36.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T12:32:36.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T12:32:36.635 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:32:36.636 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T12:32:36.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T12:32:36.801 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T12:32:36.833 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T12:32:36.834 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T12:32:36.834 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322', 'branch': 'rishabh-2023oct13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls}', 'email': None, 'first_in_suite': False, 'job_id': '7425322', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_18:04:14', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T12:32:36.835 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T12:32:36.838 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T12:32:36.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T12:32:36.895 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T12:32:36.950 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:36.951 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T12:32:36.976 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T12:32:36.977 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-10-14T12:32:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T12:32:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:32:37.033 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 391567 Links: 1 2023-10-14T12:32:37.034 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:32:37.034 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:32:37.034 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-14 12:32:28.779380393 +0000 2023-10-14T12:32:37.034 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-14 12:29:46.651400631 +0000 2023-10-14T12:32:37.034 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-14 12:29:46.651400631 +0000 2023-10-14T12:32:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-14T12:32:37.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T12:32:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-14T12:32:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-14T12:32:37.097 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.00023122 s, 2.2 MB/s 2023-10-14T12:32:37.099 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T12:32:37.156 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-10-14T12:32:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T12:32:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:32:37.214 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 391623 Links: 1 2023-10-14T12:32:37.214 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:32:37.214 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:32:37.214 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-14 12:32:28.779380393 +0000 2023-10-14T12:32:37.215 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-14 12:29:47.146390794 +0000 2023-10-14T12:32:37.215 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-14 12:29:47.146390794 +0000 2023-10-14T12:32:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-14T12:32:37.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T12:32:37.279 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-14T12:32:37.279 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-14T12:32:37.280 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000248396 s, 2.1 MB/s 2023-10-14T12:32:37.281 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T12:32:37.338 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-10-14T12:32:37.396 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T12:32:37.396 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:32:37.396 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 395432 Links: 1 2023-10-14T12:32:37.396 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:32:37.397 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:32:37.397 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-14 12:32:28.779380393 +0000 2023-10-14T12:32:37.397 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-14 12:29:47.644380897 +0000 2023-10-14T12:32:37.397 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-14 12:29:47.644380897 +0000 2023-10-14T12:32:37.397 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-14T12:32:37.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T12:32:37.461 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-14T12:32:37.461 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-14T12:32:37.462 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000230325 s, 2.2 MB/s 2023-10-14T12:32:37.463 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T12:32:37.520 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-10-14T12:32:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T12:32:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:32:37.578 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 390846 Links: 1 2023-10-14T12:32:37.578 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:32:37.579 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:32:37.579 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-14 12:32:28.779380393 +0000 2023-10-14T12:32:37.579 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-14 12:29:48.141371019 +0000 2023-10-14T12:32:37.579 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-14 12:29:48.141371019 +0000 2023-10-14T12:32:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-14T12:32:37.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T12:32:37.642 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-14T12:32:37.643 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-14T12:32:37.643 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000190155 s, 2.7 MB/s 2023-10-14T12:32:37.644 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T12:32:37.701 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:37.702 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:32:37.702 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T12:32:37.721 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T12:32:37.721 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2023-10-14T12:32:37.780 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T12:32:37.780 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:32:37.781 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 395477 Links: 1 2023-10-14T12:32:37.781 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:32:37.781 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:32:37.781 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-10-14 12:32:23.799118436 +0000 2023-10-14T12:32:37.781 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-10-14 12:29:41.232629004 +0000 2023-10-14T12:32:37.782 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-10-14 12:29:41.232629004 +0000 2023-10-14T12:32:37.782 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-10-14T12:32:37.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T12:32:37.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-10-14T12:32:37.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-10-14T12:32:37.848 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000265685 s, 1.9 MB/s 2023-10-14T12:32:37.849 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T12:32:37.908 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2023-10-14T12:32:37.966 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T12:32:37.966 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:32:37.966 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 396564 Links: 1 2023-10-14T12:32:37.967 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:32:37.967 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:32:37.967 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-10-14 12:32:23.799118436 +0000 2023-10-14T12:32:37.967 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-10-14 12:29:41.741616738 +0000 2023-10-14T12:32:37.967 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-10-14 12:29:41.741616738 +0000 2023-10-14T12:32:37.968 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-10-14T12:32:37.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T12:32:38.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-10-14T12:32:38.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-10-14T12:32:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000206759 s, 2.5 MB/s 2023-10-14T12:32:38.034 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T12:32:38.092 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2023-10-14T12:32:38.149 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T12:32:38.150 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:32:38.150 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 389623 Links: 1 2023-10-14T12:32:38.150 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:32:38.150 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:32:38.151 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-10-14 12:32:23.799118436 +0000 2023-10-14T12:32:38.151 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-10-14 12:29:42.264604134 +0000 2023-10-14T12:32:38.151 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-10-14 12:29:42.264604134 +0000 2023-10-14T12:32:38.151 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-10-14T12:32:38.151 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T12:32:38.214 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-10-14T12:32:38.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-10-14T12:32:38.215 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000236334 s, 2.2 MB/s 2023-10-14T12:32:38.216 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T12:32:38.274 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2023-10-14T12:32:38.331 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T12:32:38.331 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:32:38.331 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 391800 Links: 1 2023-10-14T12:32:38.331 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:32:38.331 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:32:38.332 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2023-10-14 12:32:23.799118436 +0000 2023-10-14T12:32:38.332 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2023-10-14 12:29:42.770591940 +0000 2023-10-14T12:32:38.332 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2023-10-14 12:29:42.770591940 +0000 2023-10-14T12:32:38.332 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2023-10-14T12:32:38.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T12:32:38.396 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2023-10-14T12:32:38.396 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2023-10-14T12:32:38.396 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000189154 s, 2.7 MB/s 2023-10-14T12:32:38.397 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T12:32:38.455 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:38.455 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T12:32:38.455 INFO:tasks.ceph:Generating config... 2023-10-14T12:32:38.457 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T12:32:38.457 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T12:32:38.457 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T12:32:38.458 INFO:tasks.ceph:[client] pid file = 2023-10-14T12:32:38.458 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T12:32:38.458 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T12:32:38.458 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-14T12:32:38.459 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T12:32:38.459 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-14T12:32:38.459 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T12:32:38.459 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T12:32:38.460 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T12:32:38.460 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T12:32:38.460 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T12:32:38.461 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T12:32:38.461 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T12:32:38.461 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T12:32:38.461 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T12:32:38.462 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T12:32:38.462 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T12:32:38.462 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T12:32:38.462 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T12:32:38.463 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T12:32:38.463 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T12:32:38.463 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T12:32:38.463 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-14T12:32:38.464 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-14T12:32:38.464 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T12:32:38.464 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T12:32:38.464 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-14T12:32:38.465 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T12:32:38.465 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T12:32:38.465 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T12:32:38.465 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T12:32:38.466 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T12:32:38.466 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T12:32:38.466 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T12:32:38.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T12:32:38.522 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T12:32:38.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T12:32:38.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T12:32:38.596 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '172.21.15.123'), ('mon.c', '[v2:172.21.15.123:3301,v1:172.21.15.123:6790]')] 2023-10-14T12:32:38.597 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T12:32:38.598 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:38.599 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T12:32:38.655 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --add b 172.21.15.123 --addv c '[v2:172.21.15.123:3301,v1:172.21.15.123:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:32:38.742 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:32:38.742 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid 76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8 2023-10-14T12:32:38.743 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = pacific 2023-10-14T12:32:38.743 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2023-10-14T12:32:38.743 INFO:teuthology.orchestra.run.smithi072.stdout:fsid 76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8 2023-10-14T12:32:38.743 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2023-10-14T12:32:38.742269+0000 2023-10-14T12:32:38.743 INFO:teuthology.orchestra.run.smithi072.stdout:created 2023-10-14T12:32:38.742269+0000 2023-10-14T12:32:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 16 (pacific) 2023-10-14T12:32:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2023-10-14T12:32:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2023-10-14T12:32:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.b 2023-10-14T12:32:38.744 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] mon.c 2023-10-14T12:32:38.745 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T12:32:38.746 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T12:32:38.762 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8... 2023-10-14T12:32:38.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T12:32:38.805 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T12:32:38.848 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-10-14T12:32:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-10-14T12:32:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T12:32:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-10-14T12:32:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-10-14T12:32:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-10-14T12:32:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-10-14T12:32:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-10-14T12:32:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-10-14T12:32:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-10-14T12:32:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T12:32:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-10-14T12:32:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T12:32:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T12:32:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-10-14T12:32:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-10-14T12:32:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-10-14T12:32:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-10-14T12:32:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-10-14T12:32:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-10-14T12:32:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-10-14T12:32:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-10-14T12:32:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T12:32:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T12:32:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-10-14T12:32:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T12:32:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-10-14T12:32:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-10-14T12:32:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-10-14T12:32:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-10-14T12:32:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-10-14T12:32:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2023-10-14T12:32:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on skipped message = False 2023-10-14T12:32:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8 2023-10-14T12:32:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.857 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-10-14T12:32:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-10-14T12:32:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-10-14T12:32:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-10-14T12:32:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-10-14T12:32:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-10-14T12:32:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-10-14T12:32:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-10-14T12:32:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-10-14T12:32:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-10-14T12:32:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-10-14T12:32:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-10-14T12:32:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-10-14T12:32:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-10-14T12:32:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-10-14T12:32:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-10-14T12:32:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-10-14T12:32:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-10-14T12:32:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-10-14T12:32:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-10-14T12:32:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-10-14T12:32:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2023-10-14T12:32:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2023-10-14T12:32:38.863 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T12:32:38.863 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-10-14T12:32:38.863 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2023-10-14T12:32:38.863 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T12:32:38.863 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-10-14T12:32:38.864 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-10-14T12:32:38.864 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-10-14T12:32:38.864 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-10-14T12:32:38.864 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-14T12:32:38.864 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.864 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-10-14T12:32:38.865 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T12:32:38.865 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-10-14T12:32:38.865 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-14T12:32:38.865 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-14T12:32:38.865 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:32:38.866 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:32:38.866 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-10-14T12:32:38.866 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.866 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-10-14T12:32:38.866 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T12:32:38.867 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-14T12:32:38.867 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-10-14T12:32:38.867 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-14T12:32:38.867 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-10-14T12:32:38.867 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-10-14T12:32:38.868 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:32:38.868 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-10-14T12:32:38.868 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-10-14T12:32:38.868 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:32:38.868 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.869 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T12:32:38.869 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T12:32:38.869 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T12:32:38.869 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.869 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T12:32:38.870 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T12:32:38.870 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T12:32:38.870 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.870 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-10-14T12:32:38.870 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-10-14T12:32:38.871 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.871 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-10-14T12:32:38.871 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-10-14T12:32:38.871 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:32:38.871 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-10-14T12:32:38.871 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-10-14T12:32:38.872 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-10-14T12:32:38.872 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-10-14T12:32:38.872 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T12:32:38.872 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T12:32:38.872 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-10-14T12:32:38.873 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-10-14T12:32:38.873 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T12:32:38.873 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = "" 2023-10-14T12:32:38.873 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-14T12:32:38.873 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-14T12:32:38.873 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-10-14T12:32:38.874 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-10-14T12:32:38.874 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-10-14T12:32:38.874 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-10-14T12:32:38.874 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-10-14T12:32:38.874 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-10-14T12:32:38.875 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-10-14T12:32:38.875 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-10-14T12:32:38.875 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-10-14T12:32:38.875 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2023-10-14T12:32:38.875 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T12:32:38.875 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-10-14T12:32:38.876 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-10-14T12:32:38.876 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-10-14T12:32:38.876 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-10-14T12:32:38.876 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-14T12:32:38.876 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-14T12:32:38.877 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-14T12:32:38.878 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2023-10-14T12:32:38.878 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2023-10-14T12:32:38.879 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T12:32:38.879 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2023-10-14T12:32:38.879 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.879 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2023-10-14T12:32:38.879 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.880 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2023-10-14T12:32:38.880 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.880 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2023-10-14T12:32:38.880 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2023-10-14T12:32:38.880 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.881 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2023-10-14T12:32:38.881 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2023-10-14T12:32:38.881 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.881 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T12:32:38.881 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2023-10-14T12:32:38.881 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.882 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T12:32:38.882 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T12:32:38.882 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.882 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2023-10-14T12:32:38.882 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.883 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2023-10-14T12:32:38.883 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2023-10-14T12:32:38.883 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2023-10-14T12:32:38.883 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2023-10-14T12:32:38.883 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2023-10-14T12:32:38.884 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2023-10-14T12:32:38.884 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2023-10-14T12:32:38.884 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T12:32:38.884 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T12:32:38.884 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2023-10-14T12:32:38.884 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.885 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T12:32:38.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.885 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2023-10-14T12:32:38.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.885 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2023-10-14T12:32:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2023-10-14T12:32:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2023-10-14T12:32:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2023-10-14T12:32:38.886 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.72,172.21.15.123,[v2:172.21.15.123:3301,v1:172.21.15.123:6790]" 2023-10-14T12:32:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on skipped message = False 2023-10-14T12:32:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8 2023-10-14T12:32:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.887 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2023-10-14T12:32:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2023-10-14T12:32:38.887 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2023-10-14T12:32:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2023-10-14T12:32:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2023-10-14T12:32:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.888 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2023-10-14T12:32:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2023-10-14T12:32:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2023-10-14T12:32:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2023-10-14T12:32:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2023-10-14T12:32:38.889 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2023-10-14T12:32:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2023-10-14T12:32:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2023-10-14T12:32:38.890 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2023-10-14T12:32:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2023-10-14T12:32:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.891 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2023-10-14T12:32:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2023-10-14T12:32:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2023-10-14T12:32:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2023-10-14T12:32:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2023-10-14T12:32:38.892 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2023-10-14T12:32:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 20 2023-10-14T12:32:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 20 2023-10-14T12:32:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-14T12:32:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2023-10-14T12:32:38.893 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 10 2023-10-14T12:32:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T12:32:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2023-10-14T12:32:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2023-10-14T12:32:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2023-10-14T12:32:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2023-10-14T12:32:38.894 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-10-14T12:32:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.895 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2023-10-14T12:32:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-14T12:32:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2023-10-14T12:32:38.895 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-10-14T12:32:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-10-14T12:32:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:32:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:32:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2023-10-14T12:32:38.896 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.896 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2023-10-14T12:32:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-14T12:32:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2023-10-14T12:32:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2023-10-14T12:32:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2023-10-14T12:32:38.897 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2023-10-14T12:32:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2023-10-14T12:32:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:32:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2023-10-14T12:32:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2023-10-14T12:32:38.898 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:32:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T12:32:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T12:32:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T12:32:38.899 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T12:32:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T12:32:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T12:32:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2023-10-14T12:32:38.900 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2023-10-14T12:32:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2023-10-14T12:32:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2023-10-14T12:32:38.901 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-10-14T12:32:38.901 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2023-10-14T12:32:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2023-10-14T12:32:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2023-10-14T12:32:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2023-10-14T12:32:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T12:32:38.902 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T12:32:38.903 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2023-10-14T12:32:38.903 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2023-10-14T12:32:38.903 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-14T12:32:38.903 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = "" 2023-10-14T12:32:38.903 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-10-14T12:32:38.903 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-10-14T12:32:38.904 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2023-10-14T12:32:38.904 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2023-10-14T12:32:38.904 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2023-10-14T12:32:38.904 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-10-14T12:32:38.904 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2023-10-14T12:32:38.905 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-10-14T12:32:38.905 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2023-10-14T12:32:38.905 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2023-10-14T12:32:38.905 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2023-10-14T12:32:38.905 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2023-10-14T12:32:38.905 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2023-10-14T12:32:38.906 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2023-10-14T12:32:38.906 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2023-10-14T12:32:38.906 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2023-10-14T12:32:38.906 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2023-10-14T12:32:38.906 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2023-10-14T12:32:38.907 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2023-10-14T12:32:38.907 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2023-10-14T12:32:38.907 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T12:32:38.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T12:32:38.975 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T12:32:38.975 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:38.976 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T12:32:38.992 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:38.993 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T12:32:39.048 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:32:39.049 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:39.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T12:32:39.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T12:32:39.124 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:32:39.124 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:32:39.180 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:32:39.181 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:32:39.181 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T12:32:39.181 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T12:32:39.218 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:32:39.218 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:32:39.276 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T12:32:39.276 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T12:32:39.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T12:32:39.331 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T12:32:39.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T12:32:39.420 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T12:32:39.423 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T12:32:39.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T12:32:39.477 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T12:32:39.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T12:32:39.506 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T12:32:39.599 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T12:32:39.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T12:32:39.627 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T12:32:39.680 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T12:32:39.683 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T12:32:39.709 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T12:32:39.802 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T12:32:39.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T12:32:39.830 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T12:32:39.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T12:32:39.874 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T12:32:39.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-14T12:32:39.970 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-14T12:32:39.982 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T12:32:40.025 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T12:32:40.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-14T12:32:40.121 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-14T12:32:40.133 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T12:32:40.133 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T12:32:40.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T12:32:40.160 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:40.161 INFO:tasks.ceph:role: osd.0 2023-10-14T12:32:40.161 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:32:40.161 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T12:32:40.234 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:32:40.235 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:32:40.235 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:32:40.235 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:32:40.235 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:32:40.236 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:32:40.236 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:32:40.236 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:32:40.236 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:32:40.236 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:32:40.667 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-14T12:32:40.669 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-14T12:32:40.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T12:32:40.842 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T12:32:40.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T12:32:40.950 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:40.951 INFO:tasks.ceph:role: osd.1 2023-10-14T12:32:40.951 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:32:40.951 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T12:32:41.030 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:32:41.030 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:32:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:32:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:32:41.031 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:32:41.031 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:32:41.031 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:32:41.032 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:32:41.032 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:32:41.032 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:32:41.453 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-14T12:32:41.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-14T12:32:41.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T12:32:41.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T12:32:41.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T12:32:41.667 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:41.668 INFO:tasks.ceph:role: osd.2 2023-10-14T12:32:41.668 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:32:41.668 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T12:32:41.743 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:32:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:32:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:32:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:32:41.744 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:32:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:32:41.745 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:32:41.745 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:32:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:32:41.746 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:32:42.186 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-14T12:32:42.189 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-14T12:32:42.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T12:32:42.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T12:32:42.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T12:32:42.473 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:42.473 INFO:tasks.ceph:role: osd.3 2023-10-14T12:32:42.473 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:32:42.474 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T12:32:42.548 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:32:42.548 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:32:42.549 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:32:42.549 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:32:42.549 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:32:42.549 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:32:42.549 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:32:42.550 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:32:42.550 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:32:42.550 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:32:42.981 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-14T12:32:42.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-14T12:32:42.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T12:32:43.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T12:32:43.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:32:43.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:43.368+0000 7f4769a05640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T12:32:43.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:43.368+0000 7f4769a05640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T12:32:43.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:43.368+0000 7f4769a05640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T12:32:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:43.368+0000 7f4769a05640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T12:32:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:43.368+0000 7f4769a05640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T12:32:43.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:43.369+0000 7f4769a05640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T12:32:46.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T12:32:46.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:32:46.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:46.367+0000 7effab636640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T12:32:46.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:46.367+0000 7effab636640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T12:32:46.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:46.367+0000 7effab636640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T12:32:46.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:46.367+0000 7effab636640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T12:32:46.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:46.367+0000 7effab636640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T12:32:46.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:46.368+0000 7effab636640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T12:32:49.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T12:32:49.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:32:49.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:49.350+0000 7f3eea308640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T12:32:49.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:49.351+0000 7f3eea308640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T12:32:49.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:49.351+0000 7f3eea308640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T12:32:49.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:49.351+0000 7f3eea308640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T12:32:49.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:49.351+0000 7f3eea308640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T12:32:49.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:49.351+0000 7f3eea308640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T12:32:52.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T12:32:52.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:32:52.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:52.353+0000 7fce65daf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T12:32:52.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:52.354+0000 7fce65daf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T12:32:52.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:52.354+0000 7fce65daf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T12:32:52.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:52.354+0000 7fce65daf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T12:32:52.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:52.354+0000 7fce65daf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T12:32:52.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:32:52.354+0000 7fce65daf640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T12:32:55.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T12:32:55.502 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T12:32:55.538 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:55.538 INFO:tasks.ceph:role: osd.4 2023-10-14T12:32:55.539 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:32:55.540 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T12:32:55.620 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:32:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:32:55.620 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:32:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:32:55.621 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:32:55.621 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:32:55.621 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:32:55.621 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:32:55.622 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:32:55.622 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:32:56.051 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-10-14T12:32:56.054 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-10-14T12:32:56.054 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T12:32:56.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T12:32:56.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T12:32:56.350 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:56.350 INFO:tasks.ceph:role: osd.5 2023-10-14T12:32:56.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:32:56.351 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T12:32:56.425 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:32:56.425 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:32:56.425 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:32:56.425 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:32:56.426 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:32:56.426 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:32:56.426 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:32:56.426 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:32:56.426 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:32:56.427 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:32:56.865 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-10-14T12:32:56.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-10-14T12:32:56.867 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T12:32:56.979 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T12:32:57.011 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T12:32:57.078 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:57.079 INFO:tasks.ceph:role: osd.6 2023-10-14T12:32:57.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:32:57.079 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T12:32:57.152 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:32:57.152 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:32:57.153 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:32:57.153 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:32:57.153 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:32:57.153 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:32:57.153 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:32:57.154 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:32:57.154 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:32:57.154 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:32:57.606 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-10-14T12:32:57.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-10-14T12:32:57.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T12:32:57.770 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T12:32:57.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T12:32:57.872 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:32:57.873 INFO:tasks.ceph:role: osd.7 2023-10-14T12:32:57.873 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:32:57.873 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T12:32:57.947 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:32:57.948 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:32:57.948 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:32:57.948 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T12:32:57.948 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:32:57.948 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:32:57.949 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:32:57.949 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T12:32:57.949 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:32:57.949 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:32:58.378 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2023-10-14T12:32:58.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2023-10-14T12:32:58.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T12:32:58.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T12:32:58.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:32:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:32:58.706+0000 7f58dcdca640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T12:32:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:32:58.706+0000 7f58dcdca640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T12:32:58.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:32:58.706+0000 7f58dcdca640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T12:32:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:32:58.706+0000 7f58dcdca640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T12:32:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:32:58.706+0000 7f58dcdca640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T12:32:58.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:32:58.707+0000 7f58dcdca640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-14T12:33:01.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T12:33:01.623 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:33:01.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:01.719+0000 7fee2360a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T12:33:01.720 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:01.719+0000 7fee2360a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T12:33:01.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:01.719+0000 7fee2360a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T12:33:01.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:01.719+0000 7fee2360a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T12:33:01.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:01.719+0000 7fee2360a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T12:33:01.721 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:01.720+0000 7fee2360a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-14T12:33:04.586 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T12:33:04.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:33:04.714 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:04.713+0000 7f0fa57f6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T12:33:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:04.713+0000 7f0fa57f6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T12:33:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:04.714+0000 7f0fa57f6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T12:33:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:04.714+0000 7f0fa57f6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T12:33:04.715 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:04.714+0000 7f0fa57f6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T12:33:04.716 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:04.714+0000 7f0fa57f6640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-14T12:33:06.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:33:06.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:33:07.584 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T12:33:07.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:33:07.708 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:07.707+0000 7fcf1fcf5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T12:33:07.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:07.707+0000 7fcf1fcf5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T12:33:07.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:07.708+0000 7fcf1fcf5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T12:33:07.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:07.708+0000 7fcf1fcf5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T12:33:07.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:07.708+0000 7fcf1fcf5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T12:33:07.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:07.708+0000 7fcf1fcf5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-14T12:33:10.572 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T12:33:10.604 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T12:33:10.605 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:10.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T12:33:10.637 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:10.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T12:33:10.708 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:10.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T12:33:10.777 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:10.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T12:33:10.847 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:10.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T12:33:10.916 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:10.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T12:33:10.985 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:10.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T12:33:11.053 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:11.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T12:33:11.085 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:11.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T12:33:11.158 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:11.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T12:33:11.231 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:11.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T12:33:11.302 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:11.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T12:33:11.375 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:11.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T12:33:11.448 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:11.449 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T12:33:11.521 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:11.521 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T12:33:11.541 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:11.541 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-14T12:33:11.601 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:11.601 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T12:33:11.622 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:11.623 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-14T12:33:11.682 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T12:33:11.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T12:33:11.685 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T12:33:11.726 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2023-10-14T12:33:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBniiplPDK+ExAApFFqoR2bLlT+hh483RFA1g== 2023-10-14T12:33:11.726 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-10-14T12:33:11.726 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBniipljRF0HBAA7p2KLjIe8kIBXe5VokuL7Q== 2023-10-14T12:33:11.727 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-10-14T12:33:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBniiplbTOzIxAAE67DHYZlOwMouQqtLR+9IQ== 2023-10-14T12:33:11.727 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2023-10-14T12:33:11.727 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBriiplO5T3FRAAtFKzVz7NTxg94lg3RdS57g== 2023-10-14T12:33:11.727 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2023-10-14T12:33:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBuiipllEHnFRAAKJRQWsn5FL3ZsPOGTMkVKA== 2023-10-14T12:33:11.728 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2023-10-14T12:33:11.728 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBxiiplXSf9FBAATR15ePkTEDTqAVke9yNHLQ== 2023-10-14T12:33:11.728 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2023-10-14T12:33:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQB0iiplSdonFRAASnJCvmMBZz28LjqXuFwBfw== 2023-10-14T12:33:11.729 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2023-10-14T12:33:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBniiplwUwPGRAAHrSf1H0UuInKI/grT1DQow== 2023-10-14T12:33:11.729 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-10-14T12:33:11.729 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBniiplbP+PKBAAzc9e2Fbyhd7Ej7Y203MiMw== 2023-10-14T12:33:11.729 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-10-14T12:33:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBniiplMAbTLxAAtQEe6vxLT8qIwvWadHJ5WA== 2023-10-14T12:33:11.730 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2023-10-14T12:33:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQB6iiplR68gKhAAsqnwjg/k7ZLl1x7b/s/y6A== 2023-10-14T12:33:11.730 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2023-10-14T12:33:11.730 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQB9iiplZUTnKhAAokxi7A0gtASkNUNBAZhF5g== 2023-10-14T12:33:11.731 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2023-10-14T12:33:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCAiiplOqmQKhAAER+f7Vu0/2CFvthS/yfX0w== 2023-10-14T12:33:11.731 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2023-10-14T12:33:11.731 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCDiiplUn41KhAA+GV4jUrNCOfodz/VjfDvSg== 2023-10-14T12:33:11.731 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-10-14T12:33:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBniiplx+gcNBAA9Bt6El4sSwdUx/6c4Ruo3g== 2023-10-14T12:33:11.732 INFO:teuthology.orchestra.run.smithi072.stdout:[client.2] 2023-10-14T12:33:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBniiplN1/SORAAryVAHkbO9GacQgehR58mXQ== 2023-10-14T12:33:11.732 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-10-14T12:33:11.732 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBoiiplqwaHARAArzGlYBbUVvOD6htSNdKeAw== 2023-10-14T12:33:11.733 INFO:teuthology.orchestra.run.smithi072.stdout:[client.3] 2023-10-14T12:33:11.733 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBoiiplf1c5BxAAVvs8eeU/bW4ZBUWT6MmyBg== 2023-10-14T12:33:11.753 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2023-10-14T12:33:11.753 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBniiplPDK+ExAApFFqoR2bLlT+hh483RFA1g== 2023-10-14T12:33:11.753 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2023-10-14T12:33:11.753 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBniipljRF0HBAA7p2KLjIe8kIBXe5VokuL7Q== 2023-10-14T12:33:11.754 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2023-10-14T12:33:11.754 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBniiplbTOzIxAAE67DHYZlOwMouQqtLR+9IQ== 2023-10-14T12:33:11.754 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2023-10-14T12:33:11.754 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBriiplO5T3FRAAtFKzVz7NTxg94lg3RdS57g== 2023-10-14T12:33:11.755 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2023-10-14T12:33:11.755 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBuiipllEHnFRAAKJRQWsn5FL3ZsPOGTMkVKA== 2023-10-14T12:33:11.755 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2023-10-14T12:33:11.755 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBxiiplXSf9FBAATR15ePkTEDTqAVke9yNHLQ== 2023-10-14T12:33:11.755 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2023-10-14T12:33:11.756 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB0iiplSdonFRAASnJCvmMBZz28LjqXuFwBfw== 2023-10-14T12:33:11.756 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2023-10-14T12:33:11.756 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBniiplwUwPGRAAHrSf1H0UuInKI/grT1DQow== 2023-10-14T12:33:11.756 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2023-10-14T12:33:11.756 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBniiplbP+PKBAAzc9e2Fbyhd7Ej7Y203MiMw== 2023-10-14T12:33:11.757 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2023-10-14T12:33:11.757 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBniiplMAbTLxAAtQEe6vxLT8qIwvWadHJ5WA== 2023-10-14T12:33:11.757 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2023-10-14T12:33:11.757 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB6iiplR68gKhAAsqnwjg/k7ZLl1x7b/s/y6A== 2023-10-14T12:33:11.757 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2023-10-14T12:33:11.757 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB9iiplZUTnKhAAokxi7A0gtASkNUNBAZhF5g== 2023-10-14T12:33:11.758 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2023-10-14T12:33:11.758 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCAiiplOqmQKhAAER+f7Vu0/2CFvthS/yfX0w== 2023-10-14T12:33:11.758 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2023-10-14T12:33:11.758 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCDiiplUn41KhAA+GV4jUrNCOfodz/VjfDvSg== 2023-10-14T12:33:11.758 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2023-10-14T12:33:11.759 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBniiplx+gcNBAA9Bt6El4sSwdUx/6c4Ruo3g== 2023-10-14T12:33:11.759 INFO:teuthology.orchestra.run.smithi123.stdout:[client.2] 2023-10-14T12:33:11.759 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBniiplN1/SORAAryVAHkbO9GacQgehR58mXQ== 2023-10-14T12:33:11.759 INFO:teuthology.orchestra.run.smithi123.stdout:[client.1] 2023-10-14T12:33:11.759 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBoiiplqwaHARAArzGlYBbUVvOD6htSNdKeAw== 2023-10-14T12:33:11.760 INFO:teuthology.orchestra.run.smithi123.stdout:[client.3] 2023-10-14T12:33:11.760 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBoiiplf1c5BxAAVvs8eeU/bW4ZBUWT6MmyBg== 2023-10-14T12:33:11.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:33:11.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:33:11.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:33:11.867 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:33:11.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:33:11.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:33:11.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.001 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.169 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:33:12.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:33:12.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:33:12.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:33:12.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:33:12.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:33:12.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.396 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.451 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.506 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:33:12.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:33:12.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:33:12.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:33:12.673 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:33:12.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:33:12.732 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:33:12.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:33:12.790 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:33:12.846 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T12:33:12.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T12:33:12.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T12:33:12.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T12:33:12.996 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T12:33:13.024 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T12:33:13.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T12:33:13.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T12:33:13.216 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T12:33:13.314 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T12:33:13.341 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:33:13.343 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:33:13.398 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T12:33:13.399 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T12:33:13.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T12:33:13.402 INFO:tasks.ceph.mon.a:Started 2023-10-14T12:33:13.402 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T12:33:13.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T12:33:13.440 INFO:tasks.ceph.mon.b:Started 2023-10-14T12:33:13.441 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T12:33:13.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T12:33:13.443 INFO:tasks.ceph.mon.c:Started 2023-10-14T12:33:13.444 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T12:33:13.444 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T12:33:13.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T12:33:13.447 INFO:tasks.ceph.mgr.y:Started 2023-10-14T12:33:13.447 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T12:33:13.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T12:33:13.449 INFO:tasks.ceph.mgr.x:Started 2023-10-14T12:33:13.450 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T12:33:13.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T12:33:13.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.571+0000 7fc3c2937700 1 Processor -- start 2023-10-14T12:33:13.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.571+0000 7fc3c2937700 1 -- start start 2023-10-14T12:33:13.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c2937700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 0x7fc3bc06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c2937700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc3bc0cd770 0x7fc3bc0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c2937700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 0x7fc3bc0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c2937700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc0b3670 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c2937700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc070620 con 0x7fc3bc0cd770 2023-10-14T12:33:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c2937700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc070900 con 0x7fc3bc0b3220 2023-10-14T12:33:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 0x7fc3bc06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 0x7fc3bc06f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45588/0 (socket says 172.21.15.72:45588) 2023-10-14T12:33:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bbfff700 1 -- 172.21.15.72:0/1846684907 learned_addr learned my addr 172.21.15.72:0/1846684907 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:13.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bbfff700 1 -- 172.21.15.72:0/1846684907 >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 msgr2=0x7fc3bc06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T12:33:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bbfff700 1 -- 172.21.15.72:0/1846684907 >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 msgr2=0x7fc3bc06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T12:33:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bbfff700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 0x7fc3bc06f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T12:33:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bbfff700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 0x7fc3bc06f280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T12:33:13.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c0ed4700 1 --2- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 0x7fc3bc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:13.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.123:3300/0 conn(0x7fc3bc0cd770 0x7fc3bc0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:13.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c0ed4700 1 -- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 msgr2=0x7fc3bc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T12:33:13.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c0ed4700 1 -- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 msgr2=0x7fc3bc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T12:33:13.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c0ed4700 1 --2- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 0x7fc3bc0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T12:33:13.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bb7fe700 1 -- 172.21.15.72:0/1846684907 >> v2:172.21.15.123:3300/0 conn(0x7fc3bc0cd770 msgr2=0x7fc3bc0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T12:33:13.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bb7fe700 1 -- 172.21.15.72:0/1846684907 >> v2:172.21.15.123:3300/0 conn(0x7fc3bc0cd770 msgr2=0x7fc3bc0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T12:33:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3c0ed4700 1 --2- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 0x7fc3bc0cee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T12:33:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.123:3300/0 conn(0x7fc3bc0cd770 0x7fc3bc0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T12:33:13.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.572+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.123:3300/0 conn(0x7fc3bc0cd770 0x7fc3bc0b2ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T12:33:13.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3bbfff700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 0x7fc3bc06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:13.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.123:3300/0 conn(0x7fc3bc0cd770 0x7fc3bc0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:13.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3c0ed4700 1 --2- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 0x7fc3bc0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3bb7fe700 1 -- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 msgr2=0x7fc3bc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 0x7fc3bc0cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3bb7fe700 1 -- 172.21.15.72:0/1846684907 >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 msgr2=0x7fc3bc06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:13.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 0x7fc3bc06f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3bb7fe700 1 -- 172.21.15.72:0/1846684907 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc070be0 con 0x7fc3bc0cd770 2023-10-14T12:33:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3bbfff700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 0x7fc3bc06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3bc0cd770 0x7fc3bc0b2ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc06f7c0 tx=0x7fc3b0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffff553da87136a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3baffd700 1 -- 172.21.15.72:0/1846684907 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000c070 con 0x7fc3bc0cd770 2023-10-14T12:33:13.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3baffd700 1 -- 172.21.15.72:0/1846684907 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b0013610 con 0x7fc3bc0cd770 2023-10-14T12:33:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.773+0000 7fc3baffd700 1 -- 172.21.15.72:0/1846684907 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00139a0 con 0x7fc3bc0cd770 2023-10-14T12:33:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.774+0000 7fc3c2937700 1 -- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3bc0cd770 msgr2=0x7fc3bc0b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.774+0000 7fc3c2937700 1 --2- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3bc0cd770 0x7fc3bc0b2ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc06f7c0 tx=0x7fc3b0009b80 comp rx=0 tx=0).stop 2023-10-14T12:33:13.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.774+0000 7fc3c2937700 1 -- 172.21.15.72:0/1846684907 shutdown_connections 2023-10-14T12:33:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.774+0000 7fc3c2937700 1 --2- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0b3220 0x7fc3bc0cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.774+0000 7fc3c2937700 1 --2- 172.21.15.72:0/1846684907 >> v2:172.21.15.72:3300/0 conn(0x7fc3bc15b4e0 0x7fc3bc06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.774+0000 7fc3c2937700 1 --2- 172.21.15.72:0/1846684907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3bc0cd770 0x7fc3bc0b2ce0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.774+0000 7fc3c2937700 1 -- 172.21.15.72:0/1846684907 >> 172.21.15.72:0/1846684907 conn(0x7fc3bc0cdce0 msgr2=0x7fc3bc0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.774+0000 7fc3c2937700 1 -- 172.21.15.72:0/1846684907 shutdown_connections 2023-10-14T12:33:13.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.774+0000 7fc3c2937700 1 -- 172.21.15.72:0/1846684907 wait complete. 2023-10-14T12:33:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.776+0000 7fc3c2937700 1 Processor -- start 2023-10-14T12:33:13.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.776+0000 7fc3c2937700 1 -- start start 2023-10-14T12:33:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.777+0000 7fc3c2937700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3bc0b3220 0x7fc3bc0c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.777+0000 7fc3c2937700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0cd770 0x7fc3bc0c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.777+0000 7fc3c2937700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc15b4e0 0x7fc3bc0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.777+0000 7fc3c2937700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0c4670 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c2937700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc154da0 con 0x7fc3bc0b3220 2023-10-14T12:33:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c2937700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc157540 con 0x7fc3bc0cd770 2023-10-14T12:33:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c0ed4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc15b4e0 0x7fc3bc0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c0ed4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc15b4e0 0x7fc3bc0c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45626/0 (socket says 172.21.15.72:45626) 2023-10-14T12:33:13.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c0ed4700 1 -- 172.21.15.72:0/1792679477 learned_addr learned my addr 172.21.15.72:0/1792679477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3bbfff700 1 --2- 172.21.15.72:0/1792679477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3bc0b3220 0x7fc3bc0c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3bb7fe700 1 --2- 172.21.15.72:0/1792679477 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0cd770 0x7fc3bc0c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c0ed4700 1 -- 172.21.15.72:0/1792679477 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0cd770 msgr2=0x7fc3bc0c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:13.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c0ed4700 1 --2- 172.21.15.72:0/1792679477 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0cd770 0x7fc3bc0c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c0ed4700 1 -- 172.21.15.72:0/1792679477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3bc0b3220 msgr2=0x7fc3bc0c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c0ed4700 1 --2- 172.21.15.72:0/1792679477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3bc0b3220 0x7fc3bc0c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c0ed4700 1 -- 172.21.15.72:0/1792679477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac0095b0 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c0ed4700 1 --2- 172.21.15.72:0/1792679477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc15b4e0 0x7fc3bc0c5890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4004660 tx=0x7fc3b4004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:13.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3b8ff9700 1 -- 172.21.15.72:0/1792679477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4003bb0 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3b8ff9700 1 -- 172.21.15.72:0/1792679477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4007d10 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c2937700 1 -- 172.21.15.72:0/1792679477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b0009500 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3b8ff9700 1 -- 172.21.15.72:0/1792679477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4014650 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3c2937700 1 -- 172.21.15.72:0/1792679477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc154750 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.778+0000 7fc3b8ff9700 1 -- 172.21.15.72:0/1792679477 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc3b40147b0 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.779+0000 7fc3b8ff9700 1 -- 172.21.15.72:0/1792679477 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc3b401d980 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.779+0000 7fc3c2937700 1 -- 172.21.15.72:0/1792679477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc04ebb0 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.782+0000 7fc3b8ff9700 1 -- 172.21.15.72:0/1792679477 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc3b401d410 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.862+0000 7fc3c2937700 1 -- 172.21.15.72:0/1792679477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc3bc0c47b0 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.863+0000 7fc3b8ff9700 1 -- 172.21.15.72:0/1792679477 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc3b4014c40 con 0x7fc3bc15b4e0 2023-10-14T12:33:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.864+0000 7fc3c2937700 1 -- 172.21.15.72:0/1792679477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc15b4e0 msgr2=0x7fc3bc0c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.864+0000 7fc3c2937700 1 --2- 172.21.15.72:0/1792679477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc15b4e0 0x7fc3bc0c5890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4004660 tx=0x7fc3b4004970 comp rx=0 tx=0).stop 2023-10-14T12:33:13.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.864+0000 7fc3c2937700 1 -- 172.21.15.72:0/1792679477 shutdown_connections 2023-10-14T12:33:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.864+0000 7fc3c2937700 1 --2- 172.21.15.72:0/1792679477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3bc15b4e0 0x7fc3bc0c5890 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.864+0000 7fc3c2937700 1 --2- 172.21.15.72:0/1792679477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3bc0b3220 0x7fc3bc0c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.864+0000 7fc3c2937700 1 --2- 172.21.15.72:0/1792679477 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3bc0cd770 0x7fc3bc0c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.864+0000 7fc3c2937700 1 -- 172.21.15.72:0/1792679477 >> 172.21.15.72:0/1792679477 conn(0x7fc3bc0cdce0 msgr2=0x7fc3bc0c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:13.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.864+0000 7fc3c2937700 1 -- 172.21.15.72:0/1792679477 shutdown_connections 2023-10-14T12:33:13.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:13.865+0000 7fc3c2937700 1 -- 172.21.15.72:0/1792679477 wait complete. 2023-10-14T12:33:13.868 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2023-10-14T12:33:13.878 INFO:tasks.ceph:check_enable_crimson: False 2023-10-14T12:33:13.879 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T12:33:13.879 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:13.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T12:33:13.880 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:13.878+0000 7f66bd4ae200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T12:33:13.892 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:13.891+0000 7f783741d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T12:33:13.906 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:13.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T12:33:13.943 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:13.942+0000 7f66bd4ae200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T12:33:13.961 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:13.960+0000 7f783741d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T12:33:13.972 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:13.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T12:33:14.018 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:14.017+0000 7f66bd4ae200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T12:33:14.040 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:14.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T12:33:14.043 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:14.042+0000 7f783741d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T12:33:14.071 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:14.071 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T12:33:14.097 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:14.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T12:33:14.098 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:14.096+0000 7f66bd4ae200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T12:33:14.128 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:14.127+0000 7f783741d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T12:33:14.165 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:14.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T12:33:14.232 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:33:14.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T12:33:14.249 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:14.247+0000 7f66bd4ae200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T12:33:14.269 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:14.268+0000 7f783741d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T12:33:14.275 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new aad67034-de37-4ef6-87ca-dccb9878deaf 0 2023-10-14T12:33:14.436 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.435+0000 7f1a3b59e700 1 Processor -- start 2023-10-14T12:33:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.435+0000 7f1a3b59e700 1 -- start start 2023-10-14T12:33:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3b59e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1a3c06bf40 0x7f1a3c0b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c0cbb40 0x7f1a3c0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3b59e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3c0cc020 con 0x7f1a3c15a3d0 2023-10-14T12:33:14.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3b59e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3c0c9f80 con 0x7f1a3c06bf40 2023-10-14T12:33:14.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3b59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c0ca190 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3ad9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c0cbb40 0x7f1a3c0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a39d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1a3c06bf40 0x7f1a3c0b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.442 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3ad9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c0cbb40 0x7f1a3c0b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53646/0 (socket says 172.21.15.123:53646) 2023-10-14T12:33:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a39d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1a3c06bf40 0x7f1a3c0b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46824/0 (socket says 172.21.15.123:46824) 2023-10-14T12:33:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3ad9d700 1 -- 172.21.15.123:0/2639066676 learned_addr learned my addr 172.21.15.123:0/2639066676 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a39d9b700 1 -- 172.21.15.123:0/2639066676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c0cbb40 msgr2=0x7f1a3c0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a39d9b700 1 --2- 172.21.15.123:0/2639066676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c0cbb40 0x7f1a3c0b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a39d9b700 1 -- 172.21.15.123:0/2639066676 >> v1:172.21.15.72:6789/0 conn(0x7f1a3c15a3d0 legacy=0x7f1a3c06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a39d9b700 1 -- 172.21.15.123:0/2639066676 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0ca470 con 0x7f1a3c06bf40 2023-10-14T12:33:14.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3ad9d700 1 --2- 172.21.15.123:0/2639066676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c0cbb40 0x7f1a3c0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:14.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a39d9b700 1 --2- 172.21.15.123:0/2639066676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c06bf40 0x7f1a3c0b2c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009840 tx=0x7f1a30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7ee024755fabd8f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:14.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3959a700 1 -- 172.21.15.123:0/2639066676 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30011830 con 0x7f1a3c06bf40 2023-10-14T12:33:14.444 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3959a700 1 -- 172.21.15.123:0/2639066676 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a30011990 con 0x7f1a3c06bf40 2023-10-14T12:33:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.436+0000 7f1a3959a700 1 -- 172.21.15.123:0/2639066676 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30011d20 con 0x7f1a3c06bf40 2023-10-14T12:33:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.437+0000 7f1a3b59e700 1 -- 172.21.15.123:0/2639066676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c06bf40 msgr2=0x7f1a3c0b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.437+0000 7f1a3b59e700 1 --2- 172.21.15.123:0/2639066676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c06bf40 0x7f1a3c0b2c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009840 tx=0x7f1a30009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.437+0000 7f1a3b59e700 1 -- 172.21.15.123:0/2639066676 shutdown_connections 2023-10-14T12:33:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.437+0000 7f1a3b59e700 1 --2- 172.21.15.123:0/2639066676 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c0cbb40 0x7f1a3c0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.437+0000 7f1a3b59e700 1 --2- 172.21.15.123:0/2639066676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c06bf40 0x7f1a3c0b2c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.437+0000 7f1a3b59e700 1 -- 172.21.15.123:0/2639066676 >> 172.21.15.123:0/2639066676 conn(0x7f1a3c070f30 msgr2=0x7f1a3c071340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.437+0000 7f1a3b59e700 1 -- 172.21.15.123:0/2639066676 shutdown_connections 2023-10-14T12:33:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.437+0000 7f1a3b59e700 1 -- 172.21.15.123:0/2639066676 wait complete. 2023-10-14T12:33:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.438+0000 7f1a3b59e700 1 Processor -- start 2023-10-14T12:33:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.438+0000 7f1a3b59e700 1 -- start start 2023-10-14T12:33:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a3b59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a3c06bf40 0x7f1a3c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a3b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c0cbb40 0x7f1a3c15b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a3b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c15a3d0 0x7f1a3c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a3b59e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c150f60 con 0x7f1a3c06bf40 2023-10-14T12:33:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a3b59e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c151ae0 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a3b59e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1511b0 con 0x7f1a3c15a3d0 2023-10-14T12:33:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a39d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c0cbb40 0x7f1a3c15b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a39d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c0cbb40 0x7f1a3c15b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46830/0 (socket says 172.21.15.123:46830) 2023-10-14T12:33:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a39d9b700 1 -- 172.21.15.123:0/3048071347 learned_addr learned my addr 172.21.15.123:0/3048071347 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a3ad9d700 1 --2- 172.21.15.123:0/3048071347 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c15a3d0 0x7f1a3c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.439+0000 7f1a3a59c700 1 --2- 172.21.15.123:0/3048071347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a3c06bf40 0x7f1a3c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a39d9b700 1 -- 172.21.15.123:0/3048071347 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c15a3d0 msgr2=0x7f1a3c151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a39d9b700 1 --2- 172.21.15.123:0/3048071347 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c15a3d0 0x7f1a3c151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a39d9b700 1 -- 172.21.15.123:0/3048071347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a3c06bf40 msgr2=0x7f1a3c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a39d9b700 1 --2- 172.21.15.123:0/3048071347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a3c06bf40 0x7f1a3c0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a39d9b700 1 -- 172.21.15.123:0/3048071347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34009b30 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.455 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a39d9b700 1 --2- 172.21.15.123:0/3048071347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c0cbb40 0x7f1a3c15b5e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009fd0 tx=0x7f1a30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a2affd700 1 -- 172.21.15.123:0/3048071347 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a300036a0 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a2affd700 1 -- 172.21.15.123:0/3048071347 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3001f070 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a2affd700 1 -- 172.21.15.123:0/3048071347 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30003a60 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a3b59e700 1 -- 172.21.15.123:0/3048071347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a300094a0 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a3b59e700 1 -- 172.21.15.123:0/3048071347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c151770 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a2affd700 1 -- 172.21.15.123:0/3048071347 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1a30026480 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.440+0000 7f1a2affd700 1 -- 172.21.15.123:0/3048071347 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1a30021070 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.441+0000 7f1a3b59e700 1 -- 172.21.15.123:0/3048071347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3c151900 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.445+0000 7f1a2affd700 1 -- 172.21.15.123:0/3048071347 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1a3002b020 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.529 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.527+0000 7f1a3b59e700 1 -- 172.21.15.123:0/3048071347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aad67034-de37-4ef6-87ca-dccb9878deaf", "id": 0} v 0) v1 -- 0x7f1a3c0743d0 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.532 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.531+0000 7f1a2affd700 1 -- 172.21.15.123:0/3048071347 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aad67034-de37-4ef6-87ca-dccb9878deaf", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1a30015020 con 0x7f1a3c0cbb40 2023-10-14T12:33:14.533 INFO:teuthology.orchestra.run.smithi123.stdout:0 2023-10-14T12:33:14.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.532+0000 7f1a3b59e700 1 -- 172.21.15.123:0/3048071347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c0cbb40 msgr2=0x7f1a3c15b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.532+0000 7f1a3b59e700 1 --2- 172.21.15.123:0/3048071347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c0cbb40 0x7f1a3c15b5e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009fd0 tx=0x7f1a30004750 comp rx=0 tx=0).stop 2023-10-14T12:33:14.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.532+0000 7f1a3b59e700 1 -- 172.21.15.123:0/3048071347 shutdown_connections 2023-10-14T12:33:14.534 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.532+0000 7f1a3b59e700 1 --2- 172.21.15.123:0/3048071347 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1a3c15a3d0 0x7f1a3c151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.532+0000 7f1a3b59e700 1 --2- 172.21.15.123:0/3048071347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a3c06bf40 0x7f1a3c0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.532+0000 7f1a3b59e700 1 --2- 172.21.15.123:0/3048071347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a3c0cbb40 0x7f1a3c15b5e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.532+0000 7f1a3b59e700 1 -- 172.21.15.123:0/3048071347 >> 172.21.15.123:0/3048071347 conn(0x7f1a3c070f30 msgr2=0x7f1a3c1500a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:14.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.532+0000 7f1a3b59e700 1 -- 172.21.15.123:0/3048071347 shutdown_connections 2023-10-14T12:33:14.535 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.532+0000 7f1a3b59e700 1 -- 172.21.15.123:0/3048071347 wait complete. 2023-10-14T12:33:14.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new fc897685-c4a3-4298-aa8a-f4b2cd75378e 1 2023-10-14T12:33:14.657 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:14.656+0000 7f783741d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T12:33:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.675+0000 7fcb5410f700 1 Processor -- start 2023-10-14T12:33:14.677 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.675+0000 7fcb5410f700 1 -- start start 2023-10-14T12:33:14.679 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.676+0000 7fcb5410f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c0b33f0 0x7fcb4c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.676+0000 7fcb5410f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c070620 con 0x7fcb4c0cd770 2023-10-14T12:33:14.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.676+0000 7fcb5410f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c070900 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.676+0000 7fcb5410f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c070be0 con 0x7fcb4c0b33f0 2023-10-14T12:33:14.680 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.676+0000 7fcb516aa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c0b33f0 0x7fcb4c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.676+0000 7fcb51eab700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcb4c15b4e0 0x7fcb4c0b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49920/0 (socket says 172.21.15.123:49920) 2023-10-14T12:33:14.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.676+0000 7fcb51eab700 1 -- 172.21.15.123:0/1722833069 learned_addr learned my addr 172.21.15.123:0/1722833069 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-10-14T12:33:14.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb50ea9700 1 -- 172.21.15.123:0/1722833069 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065059759 0 0) 0x7fcb4c070900 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb50ea9700 1 -- 172.21.15.123:0/1722833069 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb380035b0 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.681 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb516aa700 1 -- 172.21.15.123:0/1722833069 >> v1:172.21.15.123:6789/0 conn(0x7fcb4c15b4e0 legacy=0x7fcb4c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb516aa700 1 -- 172.21.15.123:0/1722833069 >> v1:172.21.15.72:6789/0 conn(0x7fcb4c0cd770 legacy=0x7fcb4c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb516aa700 1 -- 172.21.15.123:0/1722833069 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c070ec0 con 0x7fcb4c0b33f0 2023-10-14T12:33:14.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb516aa700 1 --2- 172.21.15.123:0/1722833069 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c0b33f0 0x7fcb4c06f280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009870 tx=0x7fcb48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f49efe08120f2cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:14.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb50ea9700 1 -- 172.21.15.123:0/1722833069 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48011830 con 0x7fcb4c0b33f0 2023-10-14T12:33:14.682 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb50ea9700 1 -- 172.21.15.123:0/1722833069 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb48011990 con 0x7fcb4c0b33f0 2023-10-14T12:33:14.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb50ea9700 1 -- 172.21.15.123:0/1722833069 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48011d20 con 0x7fcb4c0b33f0 2023-10-14T12:33:14.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb5410f700 1 -- 172.21.15.123:0/1722833069 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c0b33f0 msgr2=0x7fcb4c06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.677+0000 7fcb5410f700 1 --2- 172.21.15.123:0/1722833069 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c0b33f0 0x7fcb4c06f280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009870 tx=0x7fcb48009b80 comp rx=0 tx=0).stop 2023-10-14T12:33:14.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.678+0000 7fcb5410f700 1 -- 172.21.15.123:0/1722833069 shutdown_connections 2023-10-14T12:33:14.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.678+0000 7fcb5410f700 1 --2- 172.21.15.123:0/1722833069 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c0b33f0 0x7fcb4c06f280 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.683 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.678+0000 7fcb5410f700 1 -- 172.21.15.123:0/1722833069 >> 172.21.15.123:0/1722833069 conn(0x7fcb4c0cdce0 msgr2=0x7fcb4c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:14.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.678+0000 7fcb5410f700 1 -- 172.21.15.123:0/1722833069 shutdown_connections 2023-10-14T12:33:14.684 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.678+0000 7fcb5410f700 1 -- 172.21.15.123:0/1722833069 wait complete. 2023-10-14T12:33:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.679+0000 7fcb5410f700 1 Processor -- start 2023-10-14T12:33:14.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.679+0000 7fcb5410f700 1 -- start start 2023-10-14T12:33:14.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb5410f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c0b33f0 0x7fcb4c1f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb5410f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0cd770 0x7fcb4c155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb5410f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c15b4e0 0x7fcb4c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.687 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb5410f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c1f6460 con 0x7fcb4c0b33f0 2023-10-14T12:33:14.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb5410f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c06d710 con 0x7fcb4c0cd770 2023-10-14T12:33:14.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb5410f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c06d150 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb516aa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0cd770 0x7fcb4c155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb526ac700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c15b4e0 0x7fcb4c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.688 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb526ac700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c15b4e0 0x7fcb4c156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53664/0 (socket says 172.21.15.123:53664) 2023-10-14T12:33:14.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb51eab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c0b33f0 0x7fcb4c1f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb526ac700 1 -- 172.21.15.123:0/1457695299 learned_addr learned my addr 172.21.15.123:0/1457695299 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:14.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb516aa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0cd770 0x7fcb4c155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46842/0 (socket says 172.21.15.123:46842) 2023-10-14T12:33:14.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb526ac700 1 -- 172.21.15.123:0/1457695299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0cd770 msgr2=0x7fcb4c155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.689 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb526ac700 1 --2- 172.21.15.123:0/1457695299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0cd770 0x7fcb4c155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb526ac700 1 -- 172.21.15.123:0/1457695299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c0b33f0 msgr2=0x7fcb4c1f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb526ac700 1 --2- 172.21.15.123:0/1457695299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c0b33f0 0x7fcb4c1f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb526ac700 1 -- 172.21.15.123:0/1457695299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480094a0 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb516aa700 1 --2- 172.21.15.123:0/1457695299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0cd770 0x7fcb4c155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:14.690 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb526ac700 1 --2- 172.21.15.123:0/1457695299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c15b4e0 0x7fcb4c156150 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400cc80 tx=0x7fcb4400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:14.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb427fc700 1 -- 172.21.15.123:0/1457695299 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44003c00 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb427fc700 1 -- 172.21.15.123:0/1457695299 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb44003d60 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb5410f700 1 -- 172.21.15.123:0/1457695299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c06d430 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb427fc700 1 -- 172.21.15.123:0/1457695299 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400aaa0 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb5410f700 1 -- 172.21.15.123:0/1457695299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c0c8bc0 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.691 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.680+0000 7fcb427fc700 1 -- 172.21.15.123:0/1457695299 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcb440050d0 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.681+0000 7fcb427fc700 1 -- 172.21.15.123:0/1457695299 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fcb440125f0 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.681+0000 7fcb5410f700 1 -- 172.21.15.123:0/1457695299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c0c8db0 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.692 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.684+0000 7fcb427fc700 1 -- 172.21.15.123:0/1457695299 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fcb44005510 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.732 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:14.730+0000 7f66bd4ae200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T12:33:14.775 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:14.774+0000 7f783741d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T12:33:14.781 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.778+0000 7fcb5410f700 1 -- 172.21.15.123:0/1457695299 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc897685-c4a3-4298-aa8a-f4b2cd75378e", "id": 1} v 0) v1 -- 0x7fcb4c04ebb0 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.784 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.783+0000 7fcb427fc700 1 -- 172.21.15.123:0/1457695299 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc897685-c4a3-4298-aa8a-f4b2cd75378e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcb44005780 con 0x7fcb4c15b4e0 2023-10-14T12:33:14.785 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-10-14T12:33:14.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.784+0000 7fcb5410f700 1 -- 172.21.15.123:0/1457695299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c15b4e0 msgr2=0x7fcb4c156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.784+0000 7fcb5410f700 1 --2- 172.21.15.123:0/1457695299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c15b4e0 0x7fcb4c156150 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400cc80 tx=0x7fcb4400cf90 comp rx=0 tx=0).stop 2023-10-14T12:33:14.786 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.784+0000 7fcb5410f700 1 -- 172.21.15.123:0/1457695299 shutdown_connections 2023-10-14T12:33:14.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.784+0000 7fcb5410f700 1 --2- 172.21.15.123:0/1457695299 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcb4c15b4e0 0x7fcb4c156150 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.784+0000 7fcb5410f700 1 --2- 172.21.15.123:0/1457695299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb4c0b33f0 0x7fcb4c1f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.787 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.784+0000 7fcb5410f700 1 --2- 172.21.15.123:0/1457695299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb4c0cd770 0x7fcb4c155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.784+0000 7fcb5410f700 1 -- 172.21.15.123:0/1457695299 >> 172.21.15.123:0/1457695299 conn(0x7fcb4c0cdce0 msgr2=0x7fcb4c15d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:14.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.784+0000 7fcb5410f700 1 -- 172.21.15.123:0/1457695299 shutdown_connections 2023-10-14T12:33:14.788 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.784+0000 7fcb5410f700 1 -- 172.21.15.123:0/1457695299 wait complete. 2023-10-14T12:33:14.798 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 15cb2503-e92a-47e3-8869-a8f8af67f0dd 2 2023-10-14T12:33:14.854 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:14.852+0000 7f66bd4ae200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T12:33:14.859 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:14.858+0000 7f783741d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T12:33:14.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.917+0000 7f0591be8700 1 Processor -- start 2023-10-14T12:33:14.919 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.917+0000 7f0591be8700 1 -- start start 2023-10-14T12:33:14.921 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f0591be8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c15d660 0x7f058c0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.921 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f0591be8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f058c0cd800 0x7f058c0ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.922 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f0591be8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c072b70 con 0x7f058c161c50 2023-10-14T12:33:14.922 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f0591be8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c162210 con 0x7f058c0cd800 2023-10-14T12:33:14.922 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f0591be8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c06a9c0 con 0x7f058c15d660 2023-10-14T12:33:14.922 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058b7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c15d660 0x7f058c0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.922 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058bfff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f058c161c50 0x7f058c06ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49936/0 (socket says 172.21.15.123:49936) 2023-10-14T12:33:14.923 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058bfff700 1 -- 172.21.15.123:0/3349450328 learned_addr learned my addr 172.21.15.123:0/3349450328 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-10-14T12:33:14.923 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058b7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c15d660 0x7f058c0cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53666/0 (socket says 172.21.15.123:53666) 2023-10-14T12:33:14.923 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058affd700 1 --2- 172.21.15.123:0/3349450328 >> v2:172.21.15.72:3300/0 conn(0x7f058c0cd800 0x7f058c0ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.923 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058b7fe700 1 -- 172.21.15.123:0/3349450328 >> v2:172.21.15.72:3300/0 conn(0x7f058c0cd800 msgr2=0x7f058c0ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:14.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058b7fe700 1 --2- 172.21.15.123:0/3349450328 >> v2:172.21.15.72:3300/0 conn(0x7f058c0cd800 0x7f058c0ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058b7fe700 1 -- 172.21.15.123:0/3349450328 >> v1:172.21.15.123:6789/0 conn(0x7f058c161c50 legacy=0x7f058c06ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058a7fc700 1 -- 172.21.15.123:0/3349450328 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126057645 0 0) 0x7f058c072b70 con 0x7f058c161c50 2023-10-14T12:33:14.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058b7fe700 1 -- 172.21.15.123:0/3349450328 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c06ac60 con 0x7f058c15d660 2023-10-14T12:33:14.924 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058b7fe700 1 --2- 172.21.15.123:0/3349450328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c15d660 0x7f058c0cde30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f057c009840 tx=0x7f057c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de0d0d6addbca0b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:14.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.918+0000 7f058a7fc700 1 -- 172.21.15.123:0/3349450328 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c011830 con 0x7f058c15d660 2023-10-14T12:33:14.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f058a7fc700 1 -- 172.21.15.123:0/3349450328 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c011990 con 0x7f058c15d660 2023-10-14T12:33:14.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f058a7fc700 1 -- 172.21.15.123:0/3349450328 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c011d20 con 0x7f058c15d660 2023-10-14T12:33:14.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f0591be8700 1 -- 172.21.15.123:0/3349450328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c15d660 msgr2=0x7f058c0cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.925 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f0591be8700 1 --2- 172.21.15.123:0/3349450328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c15d660 0x7f058c0cde30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f057c009840 tx=0x7f057c009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:14.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f0591be8700 1 -- 172.21.15.123:0/3349450328 shutdown_connections 2023-10-14T12:33:14.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f0591be8700 1 --2- 172.21.15.123:0/3349450328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c15d660 0x7f058c0cde30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f0591be8700 1 --2- 172.21.15.123:0/3349450328 >> v2:172.21.15.72:3300/0 conn(0x7f058c0cd800 0x7f058c0ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f0591be8700 1 -- 172.21.15.123:0/3349450328 >> 172.21.15.123:0/3349450328 conn(0x7f058c0ccce0 msgr2=0x7f058c0cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:14.926 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f0591be8700 1 -- 172.21.15.123:0/3349450328 shutdown_connections 2023-10-14T12:33:14.927 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.919+0000 7f0591be8700 1 -- 172.21.15.123:0/3349450328 wait complete. 2023-10-14T12:33:14.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.920+0000 7f0591be8700 1 Processor -- start 2023-10-14T12:33:14.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f0591be8700 1 -- start start 2023-10-14T12:33:14.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f0591be8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c0cd800 0x7f058c142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.929 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f0591be8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f058c15d660 0x7f058c0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f0591be8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c161c50 0x7f058c13fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f0591be8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c15f3c0 con 0x7f058c161c50 2023-10-14T12:33:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f0591be8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0c67e0 con 0x7f058c15d660 2023-10-14T12:33:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f0591be8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c15f660 con 0x7f058c0cd800 2023-10-14T12:33:14.930 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f058affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f058c15d660 0x7f058c0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f058affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f058c15d660 0x7f058c0c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46854/0 (socket says 172.21.15.123:46854) 2023-10-14T12:33:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f058affd700 1 -- 172.21.15.123:0/1653931118 learned_addr learned my addr 172.21.15.123:0/1653931118 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f058b7fe700 1 --2- 172.21.15.123:0/1653931118 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c0cd800 0x7f058c142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.921+0000 7f058bfff700 1 --2- 172.21.15.123:0/1653931118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c161c50 0x7f058c13fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:14.931 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f058affd700 1 -- 172.21.15.123:0/1653931118 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c0cd800 msgr2=0x7f058c142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f058affd700 1 --2- 172.21.15.123:0/1653931118 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c0cd800 0x7f058c142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f058affd700 1 -- 172.21.15.123:0/1653931118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c161c50 msgr2=0x7f058c13fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f058affd700 1 --2- 172.21.15.123:0/1653931118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c161c50 0x7f058c13fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f058affd700 1 -- 172.21.15.123:0/1653931118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0094a0 con 0x7f058c15d660 2023-10-14T12:33:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f058affd700 1 --2- 172.21.15.123:0/1653931118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f058c15d660 0x7f058c0c62a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f058000e9b0 tx=0x7f058000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:14.932 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f0573fff700 1 -- 172.21.15.123:0/1653931118 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0580009710 con 0x7f058c15d660 2023-10-14T12:33:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f0573fff700 1 -- 172.21.15.123:0/1653931118 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058000c850 con 0x7f058c15d660 2023-10-14T12:33:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f0591be8700 1 -- 172.21.15.123:0/1653931118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c15f940 con 0x7f058c15d660 2023-10-14T12:33:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f0573fff700 1 -- 172.21.15.123:0/1653931118 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058000cbc0 con 0x7f058c15d660 2023-10-14T12:33:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f0591be8700 1 -- 172.21.15.123:0/1653931118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c15ff00 con 0x7f058c15d660 2023-10-14T12:33:14.933 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f0573fff700 1 -- 172.21.15.123:0/1653931118 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0580005d20 con 0x7f058c15d660 2023-10-14T12:33:14.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.922+0000 7f0573fff700 1 -- 172.21.15.123:0/1653931118 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f05800067a0 con 0x7f058c15d660 2023-10-14T12:33:14.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.923+0000 7f0591be8700 1 -- 172.21.15.123:0/1653931118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c0701a0 con 0x7f058c15d660 2023-10-14T12:33:14.934 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:14.925+0000 7f0573fff700 1 -- 172.21.15.123:0/1653931118 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0580021060 con 0x7f058c15d660 2023-10-14T12:33:14.939 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:14.938+0000 7f783741d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T12:33:14.941 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:14.940+0000 7f66bd4ae200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T12:33:15.009 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.007+0000 7f0591be8700 1 -- 172.21.15.123:0/1653931118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "15cb2503-e92a-47e3-8869-a8f8af67f0dd", "id": 2} v 0) v1 -- 0x7f058c1600f0 con 0x7f058c15d660 2023-10-14T12:33:15.014 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.013+0000 7f0573fff700 1 -- 172.21.15.123:0/1653931118 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15cb2503-e92a-47e3-8869-a8f8af67f0dd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0580017070 con 0x7f058c15d660 2023-10-14T12:33:15.014 INFO:teuthology.orchestra.run.smithi123.stdout:2 2023-10-14T12:33:15.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.013+0000 7f0591be8700 1 -- 172.21.15.123:0/1653931118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f058c15d660 msgr2=0x7f058c0c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.016 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.014+0000 7f0591be8700 1 --2- 172.21.15.123:0/1653931118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f058c15d660 0x7f058c0c62a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f058000e9b0 tx=0x7f058000ecc0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.014+0000 7f0591be8700 1 -- 172.21.15.123:0/1653931118 shutdown_connections 2023-10-14T12:33:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.014+0000 7f0591be8700 1 --2- 172.21.15.123:0/1653931118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f058c161c50 0x7f058c13fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.014+0000 7f0591be8700 1 --2- 172.21.15.123:0/1653931118 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f058c0cd800 0x7f058c142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.014+0000 7f0591be8700 1 --2- 172.21.15.123:0/1653931118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f058c15d660 0x7f058c0c62a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.014+0000 7f0591be8700 1 -- 172.21.15.123:0/1653931118 >> 172.21.15.123:0/1653931118 conn(0x7f058c0ccce0 msgr2=0x7f058c0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.014+0000 7f0591be8700 1 -- 172.21.15.123:0/1653931118 shutdown_connections 2023-10-14T12:33:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.014+0000 7f0591be8700 1 -- 172.21.15.123:0/1653931118 wait complete. 2023-10-14T12:33:15.025 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:15.023+0000 7f66bd4ae200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T12:33:15.027 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 0b24a761-4c74-4d3d-b9cd-ee1988066154 3 2023-10-14T12:33:15.149 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.148+0000 7fac46e05700 1 Processor -- start 2023-10-14T12:33:15.150 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.148+0000 7fac46e05700 1 -- start start 2023-10-14T12:33:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.148+0000 7fac46e05700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac4015ef90 0x7fac400b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.148+0000 7fac46e05700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac401612e0 con 0x7fac400cee30 2023-10-14T12:33:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.148+0000 7fac46e05700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac401615c0 con 0x7fac400b3220 2023-10-14T12:33:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.148+0000 7fac46e05700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac401618a0 con 0x7fac4015ef90 2023-10-14T12:33:15.152 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac4015ef90 0x7fac400b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3ffff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac4015ef90 0x7fac400b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46860/0 (socket says 172.21.15.123:46860) 2023-10-14T12:33:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3ffff700 1 -- 172.21.15.123:0/2422537736 learned_addr learned my addr 172.21.15.123:0/2422537736 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3ffff700 1 -- 172.21.15.123:0/2422537736 >> v1:172.21.15.123:6789/0 conn(0x7fac400b3220 legacy=0x7fac4015dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3ffff700 1 -- 172.21.15.123:0/2422537736 >> v1:172.21.15.72:6789/0 conn(0x7fac400cee30 legacy=0x7fac400cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.153 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3ffff700 1 -- 172.21.15.123:0/2422537736 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40161b80 con 0x7fac4015ef90 2023-10-14T12:33:15.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3ffff700 1 --2- 172.21.15.123:0/2422537736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 0x7fac400b2ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0098f0 tx=0x7fac2c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=524f783ef5825a3d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:15.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3f7fe700 1 -- 172.21.15.123:0/2422537736 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c00b8a0 con 0x7fac4015ef90 2023-10-14T12:33:15.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3f7fe700 1 -- 172.21.15.123:0/2422537736 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c00ba00 con 0x7fac4015ef90 2023-10-14T12:33:15.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.149+0000 7fac3f7fe700 1 -- 172.21.15.123:0/2422537736 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c00bd90 con 0x7fac4015ef90 2023-10-14T12:33:15.154 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.150+0000 7fac46e05700 1 -- 172.21.15.123:0/2422537736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 msgr2=0x7fac400b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.150+0000 7fac46e05700 1 --2- 172.21.15.123:0/2422537736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 0x7fac400b2ce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0098f0 tx=0x7fac2c009c00 comp rx=0 tx=0).stop 2023-10-14T12:33:15.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.150+0000 7fac46e05700 1 -- 172.21.15.123:0/2422537736 shutdown_connections 2023-10-14T12:33:15.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.150+0000 7fac46e05700 1 --2- 172.21.15.123:0/2422537736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 0x7fac400b2ce0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.150+0000 7fac46e05700 1 -- 172.21.15.123:0/2422537736 >> 172.21.15.123:0/2422537736 conn(0x7fac400cdce0 msgr2=0x7fac400ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:15.155 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.150+0000 7fac46e05700 1 -- 172.21.15.123:0/2422537736 shutdown_connections 2023-10-14T12:33:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.150+0000 7fac46e05700 1 -- 172.21.15.123:0/2422537736 wait complete. 2023-10-14T12:33:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.151+0000 7fac46e05700 1 Processor -- start 2023-10-14T12:33:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.151+0000 7fac46e05700 1 -- start start 2023-10-14T12:33:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac46e05700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac400b3220 0x7fac40158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac46e05700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fac400cee30 0x7fac401e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac46e05700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 0x7fac40153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac46e05700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac401577d0 con 0x7fac400b3220 2023-10-14T12:33:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac46e05700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac40157ab0 con 0x7fac4015ef90 2023-10-14T12:33:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac46e05700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac40157d90 con 0x7fac400cee30 2023-10-14T12:33:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac3ffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fac400cee30 0x7fac401e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac453a2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 0x7fac40153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac3ffff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fac400cee30 0x7fac401e84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53686/0 (socket says 172.21.15.123:53686) 2023-10-14T12:33:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac3ffff700 1 -- 172.21.15.123:0/13474198 learned_addr learned my addr 172.21.15.123:0/13474198 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.152+0000 7fac44ba1700 1 --2- 172.21.15.123:0/13474198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac400b3220 0x7fac40158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac453a2700 1 -- 172.21.15.123:0/13474198 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fac400cee30 msgr2=0x7fac401e84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac453a2700 1 --2- 172.21.15.123:0/13474198 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fac400cee30 0x7fac401e84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac453a2700 1 -- 172.21.15.123:0/13474198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac400b3220 msgr2=0x7fac40158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac453a2700 1 --2- 172.21.15.123:0/13474198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac400b3220 0x7fac40158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac453a2700 1 -- 172.21.15.123:0/13474198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c009550 con 0x7fac4015ef90 2023-10-14T12:33:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac3ffff700 1 --2- 172.21.15.123:0/13474198 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fac400cee30 0x7fac401e84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac453a2700 1 --2- 172.21.15.123:0/13474198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 0x7fac40153b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac3800cb90 tx=0x7fac3800cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac3d7fa700 1 -- 172.21.15.123:0/13474198 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38003c00 con 0x7fac4015ef90 2023-10-14T12:33:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac3d7fa700 1 -- 172.21.15.123:0/13474198 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac38003d60 con 0x7fac4015ef90 2023-10-14T12:33:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac3d7fa700 1 -- 172.21.15.123:0/13474198 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3800aa80 con 0x7fac4015ef90 2023-10-14T12:33:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac46e05700 1 -- 172.21.15.123:0/13474198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac40158070 con 0x7fac4015ef90 2023-10-14T12:33:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac46e05700 1 -- 172.21.15.123:0/13474198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac400cb120 con 0x7fac4015ef90 2023-10-14T12:33:15.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac3d7fa700 1 -- 172.21.15.123:0/13474198 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fac380050d0 con 0x7fac4015ef90 2023-10-14T12:33:15.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.153+0000 7fac3d7fa700 1 -- 172.21.15.123:0/13474198 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fac38005810 con 0x7fac4015ef90 2023-10-14T12:33:15.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.154+0000 7fac46e05700 1 -- 172.21.15.123:0/13474198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac40158590 con 0x7fac4015ef90 2023-10-14T12:33:15.163 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.156+0000 7fac3d7fa700 1 -- 172.21.15.123:0/13474198 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fac40158590 con 0x7fac4015ef90 2023-10-14T12:33:15.241 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.239+0000 7fac46e05700 1 -- 172.21.15.123:0/13474198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b24a761-4c74-4d3d-b9cd-ee1988066154", "id": 3} v 0) v1 -- 0x7fac400cb2b0 con 0x7fac4015ef90 2023-10-14T12:33:15.246 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.245+0000 7fac3d7fa700 1 -- 172.21.15.123:0/13474198 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b24a761-4c74-4d3d-b9cd-ee1988066154", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac38005380 con 0x7fac4015ef90 2023-10-14T12:33:15.247 INFO:teuthology.orchestra.run.smithi123.stdout:3 2023-10-14T12:33:15.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.246+0000 7fac46e05700 1 -- 172.21.15.123:0/13474198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 msgr2=0x7fac40153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.246+0000 7fac46e05700 1 --2- 172.21.15.123:0/13474198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 0x7fac40153b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac3800cb90 tx=0x7fac3800cea0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.246+0000 7fac46e05700 1 -- 172.21.15.123:0/13474198 shutdown_connections 2023-10-14T12:33:15.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.246+0000 7fac46e05700 1 --2- 172.21.15.123:0/13474198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac4015ef90 0x7fac40153b20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.248 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.246+0000 7fac46e05700 1 --2- 172.21.15.123:0/13474198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac400b3220 0x7fac40158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.246+0000 7fac46e05700 1 --2- 172.21.15.123:0/13474198 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fac400cee30 0x7fac401e84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.246+0000 7fac46e05700 1 -- 172.21.15.123:0/13474198 >> 172.21.15.123:0/13474198 conn(0x7fac400cdce0 msgr2=0x7fac400ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:15.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.246+0000 7fac46e05700 1 -- 172.21.15.123:0/13474198 shutdown_connections 2023-10-14T12:33:15.249 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.246+0000 7fac46e05700 1 -- 172.21.15.123:0/13474198 wait complete. 2023-10-14T12:33:15.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new dc36583e-d434-4fc9-a666-e1dcaee5a548 4 2023-10-14T12:33:15.377 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:15.376+0000 7f783741d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T12:33:15.378 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.377+0000 7f73541d3700 1 Processor -- start 2023-10-14T12:33:15.379 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.377+0000 7f73541d3700 1 -- start start 2023-10-14T12:33:15.380 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f73541d3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f734c15dec0 0x7f734c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f73541d3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f73541d3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c0cba90 con 0x7f734c15a250 2023-10-14T12:33:15.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f73541d3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734c0cb510 con 0x7f734c15dec0 2023-10-14T12:33:15.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f73541d3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c071ec0 con 0x7f734c15e350 2023-10-14T12:33:15.381 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f735176e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f734c15dec0 0x7f734c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f7352770700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f735176e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f734c15dec0 0x7f734c06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46872/0 (socket says 172.21.15.123:46872) 2023-10-14T12:33:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f7352770700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c06daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53694/0 (socket says 172.21.15.123:53694) 2023-10-14T12:33:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f735176e700 1 -- 172.21.15.123:0/555925644 learned_addr learned my addr 172.21.15.123:0/555925644 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.378+0000 7f7351f6f700 1 --1- 172.21.15.123:0/555925644 >> v1:172.21.15.123:6789/0 conn(0x7f734c15a250 0x7f734c0717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49956/0 (socket says 172.21.15.123:49956) 2023-10-14T12:33:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f7352770700 1 -- 172.21.15.123:0/555925644 >> v2:172.21.15.123:3300/0 conn(0x7f734c15dec0 msgr2=0x7f734c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f7352770700 1 --2- 172.21.15.123:0/555925644 >> v2:172.21.15.123:3300/0 conn(0x7f734c15dec0 0x7f734c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f7352770700 1 -- 172.21.15.123:0/555925644 >> v1:172.21.15.123:6789/0 conn(0x7f734c15a250 legacy=0x7f734c0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f7352770700 1 -- 172.21.15.123:0/555925644 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c15ee40 con 0x7f734c15e350 2023-10-14T12:33:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f735176e700 1 --2- 172.21.15.123:0/555925644 >> v2:172.21.15.123:3300/0 conn(0x7f734c15dec0 0x7f734c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f7352770700 1 --2- 172.21.15.123:0/555925644 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c06daf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7344009d90 tx=0x7f734400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19beedee24f22e81 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:15.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f7350f6d700 1 -- 172.21.15.123:0/555925644 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400e070 con 0x7f734c15e350 2023-10-14T12:33:15.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f7350f6d700 1 -- 172.21.15.123:0/555925644 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734400bb20 con 0x7f734c15e350 2023-10-14T12:33:15.384 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f7350f6d700 1 -- 172.21.15.123:0/555925644 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344012430 con 0x7f734c15e350 2023-10-14T12:33:15.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f73541d3700 1 -- 172.21.15.123:0/555925644 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 msgr2=0x7f734c06daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f73541d3700 1 --2- 172.21.15.123:0/555925644 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c06daf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7344009d90 tx=0x7f734400b330 comp rx=0 tx=0).stop 2023-10-14T12:33:15.387 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f73541d3700 1 -- 172.21.15.123:0/555925644 shutdown_connections 2023-10-14T12:33:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f73541d3700 1 --2- 172.21.15.123:0/555925644 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c06daf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f73541d3700 1 --2- 172.21.15.123:0/555925644 >> v2:172.21.15.123:3300/0 conn(0x7f734c15dec0 0x7f734c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.379+0000 7f73541d3700 1 -- 172.21.15.123:0/555925644 >> 172.21.15.123:0/555925644 conn(0x7f734c0ccbe0 msgr2=0x7f734c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.380+0000 7f73541d3700 1 -- 172.21.15.123:0/555925644 shutdown_connections 2023-10-14T12:33:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.380+0000 7f73541d3700 1 -- 172.21.15.123:0/555925644 wait complete. 2023-10-14T12:33:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.381+0000 7f73541d3700 1 Processor -- start 2023-10-14T12:33:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.381+0000 7f73541d3700 1 -- start start 2023-10-14T12:33:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.381+0000 7f73541d3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c15a250 0x7f734c147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.381+0000 7f73541d3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c15dec0 0x7f734c0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.381+0000 7f73541d3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.391 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.381+0000 7f73541d3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c147ab0 con 0x7f734c15a250 2023-10-14T12:33:15.392 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.381+0000 7f73541d3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0b3b20 con 0x7f734c15dec0 2023-10-14T12:33:15.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.381+0000 7f73541d3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0b3e00 con 0x7f734c15e350 2023-10-14T12:33:15.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f735176e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c15dec0 0x7f734c0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f7352770700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.393 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f735176e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c15dec0 0x7f734c0cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46878/0 (socket says 172.21.15.123:46878) 2023-10-14T12:33:15.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f735176e700 1 -- 172.21.15.123:0/3330002912 learned_addr learned my addr 172.21.15.123:0/3330002912 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:15.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f7351f6f700 1 --2- 172.21.15.123:0/3330002912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c15a250 0x7f734c147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f735176e700 1 -- 172.21.15.123:0/3330002912 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 msgr2=0x7f734c0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.394 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f735176e700 1 --2- 172.21.15.123:0/3330002912 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f735176e700 1 -- 172.21.15.123:0/3330002912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c15a250 msgr2=0x7f734c147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f735176e700 1 --2- 172.21.15.123:0/3330002912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c15a250 0x7f734c147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f735176e700 1 -- 172.21.15.123:0/3330002912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c00b7f0 con 0x7f734c15dec0 2023-10-14T12:33:15.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f735176e700 1 --2- 172.21.15.123:0/3330002912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c15dec0 0x7f734c0cbe20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f733c010fa0 tx=0x7f733c00e640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:15.395 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f73427fc700 1 -- 172.21.15.123:0/3330002912 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00eea0 con 0x7f734c15dec0 2023-10-14T12:33:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f73427fc700 1 -- 172.21.15.123:0/3330002912 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c011650 con 0x7f734c15dec0 2023-10-14T12:33:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f73427fc700 1 -- 172.21.15.123:0/3330002912 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0119c0 con 0x7f734c15dec0 2023-10-14T12:33:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f73541d3700 1 -- 172.21.15.123:0/3330002912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7344009a70 con 0x7f734c15dec0 2023-10-14T12:33:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f73541d3700 1 -- 172.21.15.123:0/3330002912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c0b43c0 con 0x7f734c15dec0 2023-10-14T12:33:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f73427fc700 1 -- 172.21.15.123:0/3330002912 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f733c005a20 con 0x7f734c15dec0 2023-10-14T12:33:15.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.382+0000 7f73427fc700 1 -- 172.21.15.123:0/3330002912 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f733c019440 con 0x7f734c15dec0 2023-10-14T12:33:15.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.383+0000 7f73541d3700 1 -- 172.21.15.123:0/3330002912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c04ebb0 con 0x7f734c15dec0 2023-10-14T12:33:15.397 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.387+0000 7f73427fc700 1 -- 172.21.15.123:0/3330002912 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f733c01e070 con 0x7f734c15dec0 2023-10-14T12:33:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.469+0000 7f73541d3700 1 -- 172.21.15.123:0/3330002912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc36583e-d434-4fc9-a666-e1dcaee5a548", "id": 4} v 0) v1 -- 0x7f734c0b60e0 con 0x7f734c15dec0 2023-10-14T12:33:15.476 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.475+0000 7f73427fc700 1 -- 172.21.15.123:0/3330002912 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc36583e-d434-4fc9-a666-e1dcaee5a548", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f733c011e20 con 0x7f734c15dec0 2023-10-14T12:33:15.477 INFO:teuthology.orchestra.run.smithi123.stdout:4 2023-10-14T12:33:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.476+0000 7f73541d3700 1 -- 172.21.15.123:0/3330002912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c15dec0 msgr2=0x7f734c0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.476+0000 7f73541d3700 1 --2- 172.21.15.123:0/3330002912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c15dec0 0x7f734c0cbe20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f733c010fa0 tx=0x7f733c00e640 comp rx=0 tx=0).stop 2023-10-14T12:33:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.476+0000 7f73541d3700 1 -- 172.21.15.123:0/3330002912 shutdown_connections 2023-10-14T12:33:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.476+0000 7f73541d3700 1 --2- 172.21.15.123:0/3330002912 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f734c15e350 0x7f734c0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.476+0000 7f73541d3700 1 --2- 172.21.15.123:0/3330002912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f734c15a250 0x7f734c147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.476+0000 7f73541d3700 1 --2- 172.21.15.123:0/3330002912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734c15dec0 0x7f734c0cbe20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.476+0000 7f73541d3700 1 -- 172.21.15.123:0/3330002912 >> 172.21.15.123:0/3330002912 conn(0x7f734c0ccbe0 msgr2=0x7f734c06e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.476+0000 7f73541d3700 1 -- 172.21.15.123:0/3330002912 shutdown_connections 2023-10-14T12:33:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.476+0000 7f73541d3700 1 -- 172.21.15.123:0/3330002912 wait complete. 2023-10-14T12:33:15.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 1a649928-b273-427d-bfaf-b9e603647d4e 5 2023-10-14T12:33:15.492 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:15.489+0000 7f66bd4ae200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T12:33:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.609+0000 7f34189b8700 1 Processor -- start 2023-10-14T12:33:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.609+0000 7f34189b8700 1 -- start start 2023-10-14T12:33:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f34189b8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f341415c770 0x7f341415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f34189b8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34140d06d0 0x7f34140d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f34189b8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34140cdbc0 0x7f34140ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f34189b8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34140d1070 con 0x7f341415c770 2023-10-14T12:33:15.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f34189b8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34140ce590 con 0x7f34140d06d0 2023-10-14T12:33:15.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f34189b8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341415f1b0 con 0x7f34140cdbc0 2023-10-14T12:33:15.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f3411d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34140d06d0 0x7f34140d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.615 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34140cdbc0 0x7f34140ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f3411d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34140d06d0 0x7f34140d0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46884/0 (socket says 172.21.15.123:46884) 2023-10-14T12:33:15.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34140cdbc0 0x7f34140ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53706/0 (socket says 172.21.15.123:53706) 2023-10-14T12:33:15.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f3411d9b700 1 -- 172.21.15.123:0/1137127619 learned_addr learned my addr 172.21.15.123:0/1137127619 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:15.616 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f341259c700 1 --2- 172.21.15.123:0/1137127619 >> v2:172.21.15.72:3300/0 conn(0x7f341415c770 0x7f341415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f3412d9d700 1 -- 172.21.15.123:0/1137127619 >> v2:172.21.15.123:3300/0 conn(0x7f34140d06d0 msgr2=0x7f34140d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:15.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f3412d9d700 1 --2- 172.21.15.123:0/1137127619 >> v2:172.21.15.123:3300/0 conn(0x7f34140d06d0 0x7f34140d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f3412d9d700 1 -- 172.21.15.123:0/1137127619 >> v2:172.21.15.72:3300/0 conn(0x7f341415c770 msgr2=0x7f341415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:15.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.610+0000 7f3412d9d700 1 --2- 172.21.15.123:0/1137127619 >> v2:172.21.15.72:3300/0 conn(0x7f341415c770 0x7f341415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.617 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.611+0000 7f3412d9d700 1 -- 172.21.15.123:0/1137127619 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341415f490 con 0x7f34140cdbc0 2023-10-14T12:33:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.611+0000 7f3411d9b700 1 --2- 172.21.15.123:0/1137127619 >> v2:172.21.15.123:3300/0 conn(0x7f34140d06d0 0x7f34140d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.611+0000 7f3412d9d700 1 --2- 172.21.15.123:0/1137127619 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34140cdbc0 0x7f34140ce050 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34140c82f0 tx=0x7f340c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de1264fd1b025e0f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.611+0000 7f341159a700 1 -- 172.21.15.123:0/1137127619 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c00e070 con 0x7f34140cdbc0 2023-10-14T12:33:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.611+0000 7f341159a700 1 -- 172.21.15.123:0/1137127619 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c00bb20 con 0x7f34140cdbc0 2023-10-14T12:33:15.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.611+0000 7f341159a700 1 -- 172.21.15.123:0/1137127619 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c012430 con 0x7f34140cdbc0 2023-10-14T12:33:15.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.611+0000 7f34189b8700 1 -- 172.21.15.123:0/1137127619 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34140cdbc0 msgr2=0x7f34140ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.611+0000 7f34189b8700 1 --2- 172.21.15.123:0/1137127619 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34140cdbc0 0x7f34140ce050 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f34140c82f0 tx=0x7f340c00b330 comp rx=0 tx=0).stop 2023-10-14T12:33:15.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.612+0000 7f34189b8700 1 -- 172.21.15.123:0/1137127619 shutdown_connections 2023-10-14T12:33:15.619 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.612+0000 7f34189b8700 1 --2- 172.21.15.123:0/1137127619 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f34140cdbc0 0x7f34140ce050 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.612+0000 7f34189b8700 1 --2- 172.21.15.123:0/1137127619 >> v2:172.21.15.72:3300/0 conn(0x7f341415c770 0x7f341415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.612+0000 7f34189b8700 1 --2- 172.21.15.123:0/1137127619 >> v2:172.21.15.123:3300/0 conn(0x7f34140d06d0 0x7f34140d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.612+0000 7f34189b8700 1 -- 172.21.15.123:0/1137127619 >> 172.21.15.123:0/1137127619 conn(0x7f341406a820 msgr2=0x7f341406ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:15.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.612+0000 7f34189b8700 1 -- 172.21.15.123:0/1137127619 shutdown_connections 2023-10-14T12:33:15.620 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.612+0000 7f34189b8700 1 -- 172.21.15.123:0/1137127619 wait complete. 2023-10-14T12:33:15.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.613+0000 7f34189b8700 1 Processor -- start 2023-10-14T12:33:15.623 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.613+0000 7f34189b8700 1 -- start start 2023-10-14T12:33:15.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f34189b8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34140cdbc0 0x7f341406b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f34189b8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34140d06d0 0x7f34140afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f34189b8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f341415c770 0x7f34140b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.624 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f34189b8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414152050 con 0x7f34140d06d0 2023-10-14T12:33:15.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f34189b8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414157050 con 0x7f34140cdbc0 2023-10-14T12:33:15.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f34189b8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34141572a0 con 0x7f341415c770 2023-10-14T12:33:15.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f341415c770 0x7f34140b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.625 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3412d9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f341415c770 0x7f34140b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53712/0 (socket says 172.21.15.123:53712) 2023-10-14T12:33:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3412d9d700 1 -- 172.21.15.123:0/2380478763 learned_addr learned my addr 172.21.15.123:0/2380478763 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3411d9b700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34140d06d0 0x7f34140afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f341259c700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34140cdbc0 0x7f341406b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3412d9d700 1 -- 172.21.15.123:0/2380478763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34140cdbc0 msgr2=0x7f341406b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.626 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3412d9d700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34140cdbc0 0x7f341406b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3412d9d700 1 -- 172.21.15.123:0/2380478763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34140d06d0 msgr2=0x7f34140afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3412d9d700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34140d06d0 0x7f34140afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3412d9d700 1 -- 172.21.15.123:0/2380478763 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3408009550 con 0x7f341415c770 2023-10-14T12:33:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3411d9b700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34140d06d0 0x7f34140afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3412d9d700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f341415c770 0x7f34140b3160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f340c014040 tx=0x7f340c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:15.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.614+0000 7f3402ffd700 1 -- 172.21.15.123:0/2380478763 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c0048b0 con 0x7f341415c770 2023-10-14T12:33:15.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.615+0000 7f3402ffd700 1 -- 172.21.15.123:0/2380478763 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c020070 con 0x7f341415c770 2023-10-14T12:33:15.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.615+0000 7f34189b8700 1 -- 172.21.15.123:0/2380478763 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340c009a70 con 0x7f341415c770 2023-10-14T12:33:15.628 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.615+0000 7f3402ffd700 1 -- 172.21.15.123:0/2380478763 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c0276c0 con 0x7f341415c770 2023-10-14T12:33:15.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.615+0000 7f34189b8700 1 -- 172.21.15.123:0/2380478763 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3414157860 con 0x7f341415c770 2023-10-14T12:33:15.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.615+0000 7f3402ffd700 1 -- 172.21.15.123:0/2380478763 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f340c027b20 con 0x7f341415c770 2023-10-14T12:33:15.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.615+0000 7f3402ffd700 1 -- 172.21.15.123:0/2380478763 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f340c022070 con 0x7f341415c770 2023-10-14T12:33:15.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.616+0000 7f34189b8700 1 -- 172.21.15.123:0/2380478763 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341404ebb0 con 0x7f341415c770 2023-10-14T12:33:15.629 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.618+0000 7f3402ffd700 1 -- 172.21.15.123:0/2380478763 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f340c02c020 con 0x7f341415c770 2023-10-14T12:33:15.702 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.701+0000 7f34189b8700 1 -- 172.21.15.123:0/2380478763 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1a649928-b273-427d-bfaf-b9e603647d4e", "id": 5} v 0) v1 -- 0x7f341406be70 con 0x7f341415c770 2023-10-14T12:33:15.707 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.706+0000 7f3402ffd700 1 -- 172.21.15.123:0/2380478763 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a649928-b273-427d-bfaf-b9e603647d4e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f340c012c70 con 0x7f341415c770 2023-10-14T12:33:15.708 INFO:teuthology.orchestra.run.smithi123.stdout:5 2023-10-14T12:33:15.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.707+0000 7f34189b8700 1 -- 172.21.15.123:0/2380478763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f341415c770 msgr2=0x7f34140b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.707+0000 7f34189b8700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f341415c770 0x7f34140b3160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f340c014040 tx=0x7f340c004ad0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.707+0000 7f34189b8700 1 -- 172.21.15.123:0/2380478763 shutdown_connections 2023-10-14T12:33:15.709 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.707+0000 7f34189b8700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f341415c770 0x7f34140b3160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.707+0000 7f34189b8700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34140cdbc0 0x7f341406b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.707+0000 7f34189b8700 1 --2- 172.21.15.123:0/2380478763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34140d06d0 0x7f34140afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.707+0000 7f34189b8700 1 -- 172.21.15.123:0/2380478763 >> 172.21.15.123:0/2380478763 conn(0x7f341406a820 msgr2=0x7f3414155420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.707+0000 7f34189b8700 1 -- 172.21.15.123:0/2380478763 shutdown_connections 2023-10-14T12:33:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.707+0000 7f34189b8700 1 -- 172.21.15.123:0/2380478763 wait complete. 2023-10-14T12:33:15.721 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new 49ad0825-b198-49f9-844f-300dbb4a95a4 6 2023-10-14T12:33:15.843 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.842+0000 7f21d31b8700 1 Processor -- start 2023-10-14T12:33:15.844 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.842+0000 7f21d31b8700 1 -- start start 2023-10-14T12:33:15.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.842+0000 7f21d31b8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc15b4e0 0x7f21cc06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.842+0000 7f21d31b8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21cc0cd770 0x7f21cc0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.846 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.842+0000 7f21d31b8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc070620 con 0x7f21cc0b3220 2023-10-14T12:33:15.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.842+0000 7f21d31b8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc0b36b0 con 0x7f21cc0cd770 2023-10-14T12:33:15.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.842+0000 7f21d31b8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc070900 con 0x7f21cc15b4e0 2023-10-14T12:33:15.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21cbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21cc0cd770 0x7f21cc0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21d0f54700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc15b4e0 0x7f21cc06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.847 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21cbfff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21cc0cd770 0x7f21cc0b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46896/0 (socket says 172.21.15.123:46896) 2023-10-14T12:33:15.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21d0f54700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc15b4e0 0x7f21cc06f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53714/0 (socket says 172.21.15.123:53714) 2023-10-14T12:33:15.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21cbfff700 1 -- 172.21.15.123:0/497896658 learned_addr learned my addr 172.21.15.123:0/497896658 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:15.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21d0f54700 1 -- 172.21.15.123:0/497896658 >> v2:172.21.15.123:3300/0 conn(0x7f21cc0cd770 msgr2=0x7f21cc0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:15.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21d0f54700 1 --2- 172.21.15.123:0/497896658 >> v2:172.21.15.123:3300/0 conn(0x7f21cc0cd770 0x7f21cc0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.848 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21d0f54700 1 -- 172.21.15.123:0/497896658 >> v1:172.21.15.123:6789/0 conn(0x7f21cc0b3220 legacy=0x7f21cc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21d0f54700 1 -- 172.21.15.123:0/497896658 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc070be0 con 0x7f21cc15b4e0 2023-10-14T12:33:15.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21cbfff700 1 --2- 172.21.15.123:0/497896658 >> v2:172.21.15.123:3300/0 conn(0x7f21cc0cd770 0x7f21cc0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:15.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21d0f54700 1 --2- 172.21.15.123:0/497896658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc15b4e0 0x7f21cc06f280 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21c000dc60 tx=0x7f21c000df70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33bcb94c8788b0d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:15.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21cb7fe700 1 -- 172.21.15.123:0/497896658 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0012070 con 0x7f21cc15b4e0 2023-10-14T12:33:15.849 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21cb7fe700 1 -- 172.21.15.123:0/497896658 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c000d2e0 con 0x7f21cc15b4e0 2023-10-14T12:33:15.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.843+0000 7f21cb7fe700 1 -- 172.21.15.123:0/497896658 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c000f900 con 0x7f21cc15b4e0 2023-10-14T12:33:15.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.844+0000 7f21d31b8700 1 -- 172.21.15.123:0/497896658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc15b4e0 msgr2=0x7f21cc06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.844+0000 7f21d31b8700 1 --2- 172.21.15.123:0/497896658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc15b4e0 0x7f21cc06f280 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21c000dc60 tx=0x7f21c000df70 comp rx=0 tx=0).stop 2023-10-14T12:33:15.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.844+0000 7f21d31b8700 1 -- 172.21.15.123:0/497896658 shutdown_connections 2023-10-14T12:33:15.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.844+0000 7f21d31b8700 1 --2- 172.21.15.123:0/497896658 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc15b4e0 0x7f21cc06f280 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.850 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.844+0000 7f21d31b8700 1 --2- 172.21.15.123:0/497896658 >> v2:172.21.15.123:3300/0 conn(0x7f21cc0cd770 0x7f21cc0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.844+0000 7f21d31b8700 1 -- 172.21.15.123:0/497896658 >> 172.21.15.123:0/497896658 conn(0x7f21cc0cdce0 msgr2=0x7f21cc0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:15.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.844+0000 7f21d31b8700 1 -- 172.21.15.123:0/497896658 shutdown_connections 2023-10-14T12:33:15.851 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.844+0000 7f21d31b8700 1 -- 172.21.15.123:0/497896658 wait complete. 2023-10-14T12:33:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.846+0000 7f21d31b8700 1 Processor -- start 2023-10-14T12:33:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.846+0000 7f21d31b8700 1 -- start start 2023-10-14T12:33:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d31b8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc0b3220 0x7f21cc159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d31b8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21cc0cd770 0x7f21cc1e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.854 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d31b8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21cc15b4e0 0x7f21cc0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d31b8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc1e4130 con 0x7f21cc15b4e0 2023-10-14T12:33:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d31b8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc15a0e0 con 0x7f21cc0cd770 2023-10-14T12:33:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d31b8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc1e34b0 con 0x7f21cc0b3220 2023-10-14T12:33:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d0f54700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc0b3220 0x7f21cc159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21cbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21cc0cd770 0x7f21cc1e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21cbfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21cc0cd770 0x7f21cc1e2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46902/0 (socket says 172.21.15.123:46902) 2023-10-14T12:33:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d0f54700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc0b3220 0x7f21cc159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53720/0 (socket says 172.21.15.123:53720) 2023-10-14T12:33:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21cbfff700 1 -- 172.21.15.123:0/1905832399 learned_addr learned my addr 172.21.15.123:0/1905832399 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d1755700 1 --2- 172.21.15.123:0/1905832399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21cc15b4e0 0x7f21cc0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:15.856 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21cbfff700 1 -- 172.21.15.123:0/1905832399 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc0b3220 msgr2=0x7f21cc159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21cbfff700 1 --2- 172.21.15.123:0/1905832399 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc0b3220 0x7f21cc159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21cbfff700 1 -- 172.21.15.123:0/1905832399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21cc15b4e0 msgr2=0x7f21cc0c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21cbfff700 1 --2- 172.21.15.123:0/1905832399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21cc15b4e0 0x7f21cc0c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21cbfff700 1 -- 172.21.15.123:0/1905832399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8009550 con 0x7f21cc0cd770 2023-10-14T12:33:15.857 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21d1755700 1 --2- 172.21.15.123:0/1905832399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21cc15b4e0 0x7f21cc0c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.847+0000 7f21cbfff700 1 --2- 172.21.15.123:0/1905832399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21cc0cd770 0x7f21cc1e2c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21b800ebe0 tx=0x7f21b800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.848+0000 7f21c97fa700 1 -- 172.21.15.123:0/1905832399 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800c850 con 0x7f21cc0cd770 2023-10-14T12:33:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.848+0000 7f21c97fa700 1 -- 172.21.15.123:0/1905832399 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800c9b0 con 0x7f21cc0cd770 2023-10-14T12:33:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.848+0000 7f21d31b8700 1 -- 172.21.15.123:0/1905832399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c000d940 con 0x7f21cc0cd770 2023-10-14T12:33:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.848+0000 7f21c97fa700 1 -- 172.21.15.123:0/1905832399 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800cd20 con 0x7f21cc0cd770 2023-10-14T12:33:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.848+0000 7f21d31b8700 1 -- 172.21.15.123:0/1905832399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc1e3a70 con 0x7f21cc0cd770 2023-10-14T12:33:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.848+0000 7f21c97fa700 1 -- 172.21.15.123:0/1905832399 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f21b8013770 con 0x7f21cc0cd770 2023-10-14T12:33:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.848+0000 7f21c97fa700 1 -- 172.21.15.123:0/1905832399 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f21b801cd60 con 0x7f21cc0cd770 2023-10-14T12:33:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.849+0000 7f21d31b8700 1 -- 172.21.15.123:0/1905832399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc1e4270 con 0x7f21cc0cd770 2023-10-14T12:33:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.851+0000 7f21c97fa700 1 -- 172.21.15.123:0/1905832399 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f21cc1e4270 con 0x7f21cc0cd770 2023-10-14T12:33:15.968 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.967+0000 7f21d31b8700 1 -- 172.21.15.123:0/1905832399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49ad0825-b198-49f9-844f-300dbb4a95a4", "id": 6} v 0) v1 -- 0x7f21cc04ebb0 con 0x7f21cc0cd770 2023-10-14T12:33:15.977 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.975+0000 7f21c97fa700 1 -- 172.21.15.123:0/1905832399 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49ad0825-b198-49f9-844f-300dbb4a95a4", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f21b802b0b0 con 0x7f21cc0cd770 2023-10-14T12:33:15.977 INFO:teuthology.orchestra.run.smithi123.stdout:6 2023-10-14T12:33:15.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.976+0000 7f21d31b8700 1 -- 172.21.15.123:0/1905832399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21cc0cd770 msgr2=0x7f21cc1e2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:15.978 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.976+0000 7f21d31b8700 1 --2- 172.21.15.123:0/1905832399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21cc0cd770 0x7f21cc1e2c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21b800ebe0 tx=0x7f21b800eef0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.976+0000 7f21d31b8700 1 -- 172.21.15.123:0/1905832399 shutdown_connections 2023-10-14T12:33:15.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.976+0000 7f21d31b8700 1 --2- 172.21.15.123:0/1905832399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21cc15b4e0 0x7f21cc0c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.976+0000 7f21d31b8700 1 --2- 172.21.15.123:0/1905832399 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21cc0b3220 0x7f21cc159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.976+0000 7f21d31b8700 1 --2- 172.21.15.123:0/1905832399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21cc0cd770 0x7f21cc1e2c60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:15.979 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.976+0000 7f21d31b8700 1 -- 172.21.15.123:0/1905832399 >> 172.21.15.123:0/1905832399 conn(0x7f21cc0cdce0 msgr2=0x7f21cc0d1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:15.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.976+0000 7f21d31b8700 1 -- 172.21.15.123:0/1905832399 shutdown_connections 2023-10-14T12:33:15.980 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:15.976+0000 7f21d31b8700 1 -- 172.21.15.123:0/1905832399 wait complete. 2023-10-14T12:33:15.989 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd new fd405b85-8c7b-480f-873c-19728fe5f160 7 2023-10-14T12:33:16.032 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:16.031+0000 7f783741d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T12:33:16.100 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:16.099+0000 7f783741d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T12:33:16.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.110+0000 7f384c731700 1 Processor -- start 2023-10-14T12:33:16.112 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.110+0000 7f384c731700 1 -- start start 2023-10-14T12:33:16.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.111+0000 7f384c731700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f3844071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:16.114 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.111+0000 7f384c731700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38440ce520 con 0x7f384415a710 2023-10-14T12:33:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.111+0000 7f384c731700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38440cdf60 con 0x7f384415a330 2023-10-14T12:33:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.111+0000 7f384c731700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384415e5e0 con 0x7f38440ce740 2023-10-14T12:33:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.111+0000 7f384a4cd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f384415a330 0x7f38440725c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49992/0 (socket says 172.21.15.123:49992) 2023-10-14T12:33:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.111+0000 7f384a4cd700 1 -- 172.21.15.123:0/2758837278 learned_addr learned my addr 172.21.15.123:0/2758837278 (peer_addr_for_me v1:172.21.15.123:0/0) 2023-10-14T12:33:16.115 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.111+0000 7f384acce700 1 --2- 172.21.15.123:0/2758837278 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f3844071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.112+0000 7f38494cb700 1 -- 172.21.15.123:0/2758837278 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606014353 0 0) 0x7f38440cdf60 con 0x7f384415a330 2023-10-14T12:33:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.112+0000 7f384acce700 1 -- 172.21.15.123:0/2758837278 >> v1:172.21.15.123:6789/0 conn(0x7f384415a330 legacy=0x7f38440725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.112+0000 7f384acce700 1 -- 172.21.15.123:0/2758837278 >> v1:172.21.15.72:6789/0 conn(0x7f384415a710 legacy=0x7f384415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.112+0000 7f384acce700 1 -- 172.21.15.123:0/2758837278 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440ce240 con 0x7f38440ce740 2023-10-14T12:33:16.116 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.112+0000 7f384acce700 1 --2- 172.21.15.123:0/2758837278 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f3844071880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f383c009dc0 tx=0x7f383c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91952541e72febf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:16.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.112+0000 7f38494cb700 1 -- 172.21.15.123:0/2758837278 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00e070 con 0x7f38440ce740 2023-10-14T12:33:16.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.112+0000 7f38494cb700 1 -- 172.21.15.123:0/2758837278 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00bad0 con 0x7f38440ce740 2023-10-14T12:33:16.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.112+0000 7f38494cb700 1 -- 172.21.15.123:0/2758837278 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c00be80 con 0x7f38440ce740 2023-10-14T12:33:16.117 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.112+0000 7f384c731700 1 -- 172.21.15.123:0/2758837278 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 msgr2=0x7f3844071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.113+0000 7f384c731700 1 --2- 172.21.15.123:0/2758837278 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f3844071880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f383c009dc0 tx=0x7f383c00b330 comp rx=0 tx=0).stop 2023-10-14T12:33:16.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.113+0000 7f384c731700 1 -- 172.21.15.123:0/2758837278 shutdown_connections 2023-10-14T12:33:16.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.113+0000 7f384c731700 1 --2- 172.21.15.123:0/2758837278 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f3844071880 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.113+0000 7f384c731700 1 -- 172.21.15.123:0/2758837278 >> 172.21.15.123:0/2758837278 conn(0x7f38440ccce0 msgr2=0x7f38440cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:16.118 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.113+0000 7f384c731700 1 -- 172.21.15.123:0/2758837278 shutdown_connections 2023-10-14T12:33:16.119 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.113+0000 7f384c731700 1 -- 172.21.15.123:0/2758837278 wait complete. 2023-10-14T12:33:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.114+0000 7f384c731700 1 Processor -- start 2023-10-14T12:33:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.114+0000 7f384c731700 1 -- start start 2023-10-14T12:33:16.121 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.114+0000 7f384c731700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f384415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384c731700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384415a330 0x7f3844158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384c731700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f384415a710 0x7f38440b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384c731700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38440ae0d0 con 0x7f384415a330 2023-10-14T12:33:16.122 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384c731700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844159310 con 0x7f384415a710 2023-10-14T12:33:16.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384c731700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38440acdc0 con 0x7f38440ce740 2023-10-14T12:33:16.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384a4cd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f384415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:16.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384a4cd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f384415d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.123:53732/0 (socket says 172.21.15.123:53732) 2023-10-14T12:33:16.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384acce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f384415a710 0x7f38440b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:16.123 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384a4cd700 1 -- 172.21.15.123:0/2180125218 learned_addr learned my addr 172.21.15.123:0/2180125218 (peer_addr_for_me v2:172.21.15.123:0/0) 2023-10-14T12:33:16.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f3849ccc700 1 --2- 172.21.15.123:0/2180125218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384415a330 0x7f3844158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:16.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384a4cd700 1 -- 172.21.15.123:0/2180125218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f384415a710 msgr2=0x7f38440b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384a4cd700 1 --2- 172.21.15.123:0/2180125218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f384415a710 0x7f38440b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384a4cd700 1 -- 172.21.15.123:0/2180125218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384415a330 msgr2=0x7f3844158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.124 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384a4cd700 1 --2- 172.21.15.123:0/2180125218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384415a330 0x7f3844158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384a4cd700 1 -- 172.21.15.123:0/2180125218 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c009a70 con 0x7f38440ce740 2023-10-14T12:33:16.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384acce700 1 --2- 172.21.15.123:0/2180125218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f384415a710 0x7f38440b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:16.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384a4cd700 1 --2- 172.21.15.123:0/2180125218 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f384415d7d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f384000c520 tx=0x7f384000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:16.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f383affd700 1 -- 172.21.15.123:0/2180125218 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840004c80 con 0x7f38440ce740 2023-10-14T12:33:16.125 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f383affd700 1 -- 172.21.15.123:0/2180125218 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840004e00 con 0x7f38440ce740 2023-10-14T12:33:16.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384c731700 1 -- 172.21.15.123:0/2180125218 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38440ad0a0 con 0x7f38440ce740 2023-10-14T12:33:16.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f383affd700 1 -- 172.21.15.123:0/2180125218 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840007310 con 0x7f38440ce740 2023-10-14T12:33:16.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.115+0000 7f384c731700 1 -- 172.21.15.123:0/2180125218 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38440ad660 con 0x7f38440ce740 2023-10-14T12:33:16.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.116+0000 7f383affd700 1 -- 172.21.15.123:0/2180125218 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f384001d3f0 con 0x7f38440ce740 2023-10-14T12:33:16.126 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.116+0000 7f384c731700 1 -- 172.21.15.123:0/2180125218 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384415e1e0 con 0x7f38440ce740 2023-10-14T12:33:16.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.116+0000 7f383affd700 1 -- 172.21.15.123:0/2180125218 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f384001dd00 con 0x7f38440ce740 2023-10-14T12:33:16.127 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.120+0000 7f383affd700 1 -- 172.21.15.123:0/2180125218 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f384415e1e0 con 0x7f38440ce740 2023-10-14T12:33:16.146 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:16.145+0000 7f66bd4ae200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T12:33:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.203+0000 7f384c731700 1 -- 172.21.15.123:0/2180125218 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fd405b85-8c7b-480f-873c-19728fe5f160", "id": 7} v 0) v1 -- 0x7f384404ebb0 con 0x7f38440ce740 2023-10-14T12:33:16.212 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.211+0000 7f383affd700 1 -- 172.21.15.123:0/2180125218 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd405b85-8c7b-480f-873c-19728fe5f160", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f384001d7d0 con 0x7f38440ce740 2023-10-14T12:33:16.213 INFO:teuthology.orchestra.run.smithi123.stdout:7 2023-10-14T12:33:16.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.212+0000 7f384c731700 1 -- 172.21.15.123:0/2180125218 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 msgr2=0x7f384415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.212+0000 7f384c731700 1 --2- 172.21.15.123:0/2180125218 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f384415d7d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f384000c520 tx=0x7f384000c830 comp rx=0 tx=0).stop 2023-10-14T12:33:16.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.212+0000 7f384c731700 1 -- 172.21.15.123:0/2180125218 shutdown_connections 2023-10-14T12:33:16.214 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.212+0000 7f384c731700 1 --2- 172.21.15.123:0/2180125218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f384415a710 0x7f38440b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.212+0000 7f384c731700 1 --2- 172.21.15.123:0/2180125218 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38440ce740 0x7f384415d7d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.212+0000 7f384c731700 1 --2- 172.21.15.123:0/2180125218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f384415a330 0x7f3844158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.212+0000 7f384c731700 1 -- 172.21.15.123:0/2180125218 >> 172.21.15.123:0/2180125218 conn(0x7f38440ccce0 msgr2=0x7f38440b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.212+0000 7f384c731700 1 -- 172.21.15.123:0/2180125218 shutdown_connections 2023-10-14T12:33:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2023-10-14T12:33:16.212+0000 7f384c731700 1 -- 172.21.15.123:0/2180125218 wait complete. 2023-10-14T12:33:16.217 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:16.216+0000 7f66bd4ae200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T12:33:16.225 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T12:33:16.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T12:33:16.228 INFO:tasks.ceph.osd.0:Started 2023-10-14T12:33:16.228 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T12:33:16.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T12:33:16.230 INFO:tasks.ceph.osd.1:Started 2023-10-14T12:33:16.231 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T12:33:16.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T12:33:16.233 INFO:tasks.ceph.osd.2:Started 2023-10-14T12:33:16.233 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T12:33:16.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T12:33:16.236 INFO:tasks.ceph.osd.3:Started 2023-10-14T12:33:16.236 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T12:33:16.236 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T12:33:16.239 INFO:tasks.ceph.osd.4:Started 2023-10-14T12:33:16.239 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T12:33:16.239 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T12:33:16.241 INFO:tasks.ceph.osd.5:Started 2023-10-14T12:33:16.242 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T12:33:16.242 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T12:33:16.244 INFO:tasks.ceph.osd.6:Started 2023-10-14T12:33:16.244 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T12:33:16.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T12:33:16.247 INFO:tasks.ceph.osd.7:Started 2023-10-14T12:33:16.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:16.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.424+0000 7f5412d4b700 1 Processor -- start 2023-10-14T12:33:16.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.424+0000 7f5412d4b700 1 -- start start 2023-10-14T12:33:16.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.425+0000 7f5412d4b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f540c15daa0 0x7f540c0af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:16.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.425+0000 7f5412d4b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c15ed10 con 0x7f540c071f60 2023-10-14T12:33:16.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.425+0000 7f5412d4b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c15de80 con 0x7f540c0af560 2023-10-14T12:33:16.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.425+0000 7f5412d4b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c15e100 con 0x7f540c15daa0 2023-10-14T12:33:16.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.425+0000 7f5410ae7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f540c15daa0 0x7f540c0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:16.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.425+0000 7f54112e8700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f540c071f60 0x7f540c06d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51956/0 (socket says 172.21.15.72:51956) 2023-10-14T12:33:16.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.425+0000 7f54112e8700 1 -- 172.21.15.72:0/1724518828 learned_addr learned my addr 172.21.15.72:0/1724518828 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f5410ae7700 1 -- 172.21.15.72:0/1724518828 >> v1:172.21.15.123:6789/0 conn(0x7f540c0af560 legacy=0x7f540c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f5410ae7700 1 -- 172.21.15.72:0/1724518828 >> v1:172.21.15.72:6789/0 conn(0x7f540c071f60 legacy=0x7f540c06d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f5410ae7700 1 -- 172.21.15.72:0/1724518828 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c15e3e0 con 0x7f540c15daa0 2023-10-14T12:33:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f540b7fe700 1 -- 172.21.15.72:0/1724518828 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882072529 0 0) 0x7f540c15ed10 con 0x7f540c071f60 2023-10-14T12:33:16.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f5410ae7700 1 --2- 172.21.15.72:0/1724518828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 0x7f540c0af020 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5400009840 tx=0x7f5400009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae271d6e5b8ba09 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f540b7fe700 1 -- 172.21.15.72:0/1724518828 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400011830 con 0x7f540c15daa0 2023-10-14T12:33:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f540b7fe700 1 -- 172.21.15.72:0/1724518828 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5400011990 con 0x7f540c15daa0 2023-10-14T12:33:16.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f540b7fe700 1 -- 172.21.15.72:0/1724518828 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400011d20 con 0x7f540c15daa0 2023-10-14T12:33:16.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f5412d4b700 1 -- 172.21.15.72:0/1724518828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 msgr2=0x7f540c0af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.426+0000 7f5412d4b700 1 --2- 172.21.15.72:0/1724518828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 0x7f540c0af020 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5400009840 tx=0x7f5400009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:16.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.427+0000 7f5412d4b700 1 -- 172.21.15.72:0/1724518828 shutdown_connections 2023-10-14T12:33:16.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.427+0000 7f5412d4b700 1 --2- 172.21.15.72:0/1724518828 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 0x7f540c0af020 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.427+0000 7f5412d4b700 1 -- 172.21.15.72:0/1724518828 >> 172.21.15.72:0/1724518828 conn(0x7f540c0d0180 msgr2=0x7f540c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:16.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.427+0000 7f5412d4b700 1 -- 172.21.15.72:0/1724518828 shutdown_connections 2023-10-14T12:33:16.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.427+0000 7f5412d4b700 1 -- 172.21.15.72:0/1724518828 wait complete. 2023-10-14T12:33:16.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.428+0000 7f5412d4b700 1 Processor -- start 2023-10-14T12:33:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.428+0000 7f5412d4b700 1 -- start start 2023-10-14T12:33:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f5412d4b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f540c071f60 0x7f540c0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f5412d4b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0af560 0x7f540c0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f5412d4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 0x7f540c0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:16.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f5412d4b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0b1000 con 0x7f540c15daa0 2023-10-14T12:33:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f5412d4b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0b1250 con 0x7f540c0af560 2023-10-14T12:33:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f5412d4b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0b1530 con 0x7f540c071f60 2023-10-14T12:33:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54112e8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 0x7f540c0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54112e8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 0x7f540c0c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45662/0 (socket says 172.21.15.72:45662) 2023-10-14T12:33:16.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54112e8700 1 -- 172.21.15.72:0/753085042 learned_addr learned my addr 172.21.15.72:0/753085042 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f540bfff700 1 --2- 172.21.15.72:0/753085042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0af560 0x7f540c0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f5410ae7700 1 --2- 172.21.15.72:0/753085042 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f540c071f60 0x7f540c0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54112e8700 1 -- 172.21.15.72:0/753085042 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f540c071f60 msgr2=0x7f540c0c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54112e8700 1 --2- 172.21.15.72:0/753085042 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f540c071f60 0x7f540c0c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54112e8700 1 -- 172.21.15.72:0/753085042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0af560 msgr2=0x7f540c0b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54112e8700 1 --2- 172.21.15.72:0/753085042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0af560 0x7f540c0b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54112e8700 1 -- 172.21.15.72:0/753085042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54000094a0 con 0x7f540c15daa0 2023-10-14T12:33:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54112e8700 1 --2- 172.21.15.72:0/753085042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 0x7f540c0c84a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f540400cba0 tx=0x7f540400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54097fa700 1 -- 172.21.15.72:0/753085042 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400aaa0 con 0x7f540c15daa0 2023-10-14T12:33:16.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54097fa700 1 -- 172.21.15.72:0/753085042 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400ac20 con 0x7f540c15daa0 2023-10-14T12:33:16.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f5412d4b700 1 -- 172.21.15.72:0/753085042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c0b1810 con 0x7f540c15daa0 2023-10-14T12:33:16.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f54097fa700 1 -- 172.21.15.72:0/753085042 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040070d0 con 0x7f540c15daa0 2023-10-14T12:33:16.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.429+0000 7f5412d4b700 1 -- 172.21.15.72:0/753085042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c0b1dd0 con 0x7f540c15daa0 2023-10-14T12:33:16.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.430+0000 7f54097fa700 1 -- 172.21.15.72:0/753085042 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5404007530 con 0x7f540c15daa0 2023-10-14T12:33:16.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.430+0000 7f54097fa700 1 -- 172.21.15.72:0/753085042 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5404012ad0 con 0x7f540c15daa0 2023-10-14T12:33:16.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.431+0000 7f5412d4b700 1 -- 172.21.15.72:0/753085042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c0b1ff0 con 0x7f540c15daa0 2023-10-14T12:33:16.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.433+0000 7f54097fa700 1 -- 172.21.15.72:0/753085042 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5404018070 con 0x7f540c15daa0 2023-10-14T12:33:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.501+0000 7f5412d4b700 1 -- 172.21.15.72:0/753085042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f540c04ebb0 con 0x7f540c15daa0 2023-10-14T12:33:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.502+0000 7f54097fa700 1 -- 172.21.15.72:0/753085042 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f540401d440 con 0x7f540c15daa0 2023-10-14T12:33:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:16.504 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":10,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:16.205452+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:16.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.502+0000 7f5412d4b700 1 -- 172.21.15.72:0/753085042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 msgr2=0x7f540c0c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.502+0000 7f5412d4b700 1 --2- 172.21.15.72:0/753085042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 0x7f540c0c84a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f540400cba0 tx=0x7f540400ceb0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.502+0000 7f5412d4b700 1 -- 172.21.15.72:0/753085042 shutdown_connections 2023-10-14T12:33:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.502+0000 7f5412d4b700 1 --2- 172.21.15.72:0/753085042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c15daa0 0x7f540c0c84a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.502+0000 7f5412d4b700 1 --2- 172.21.15.72:0/753085042 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f540c071f60 0x7f540c0c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.502+0000 7f5412d4b700 1 --2- 172.21.15.72:0/753085042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f540c0af560 0x7f540c0b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.503+0000 7f5412d4b700 1 -- 172.21.15.72:0/753085042 >> 172.21.15.72:0/753085042 conn(0x7f540c0d0180 msgr2=0x7f540c0afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.503+0000 7f5412d4b700 1 -- 172.21.15.72:0/753085042 shutdown_connections 2023-10-14T12:33:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:16.503+0000 7f5412d4b700 1 -- 172.21.15.72:0/753085042 wait complete. 2023-10-14T12:33:16.520 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T12:33:16.520 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T12:33:16.839 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-14T12:33:16.838+0000 7f2972930640 -1 Falling back to public interface 2023-10-14T12:33:16.848 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-10-14T12:33:16.846+0000 7fc5c04b0640 -1 Falling back to public interface 2023-10-14T12:33:16.851 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-14T12:33:16.850+0000 7f1274983640 -1 Falling back to public interface 2023-10-14T12:33:16.854 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-14T12:33:16.853+0000 7fdd95909640 -1 Falling back to public interface 2023-10-14T12:33:16.856 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:16.855+0000 7f783741d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:33:16.858 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-14T12:33:16.857+0000 7ffa16e6b640 -1 Falling back to public interface 2023-10-14T12:33:16.861 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-10-14T12:33:16.859+0000 7f8afdb43640 -1 Falling back to public interface 2023-10-14T12:33:16.861 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-10-14T12:33:16.859+0000 7fb1ca129640 -1 Falling back to public interface 2023-10-14T12:33:16.864 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-10-14T12:33:16.863+0000 7f1c0ad8c640 -1 Falling back to public interface 2023-10-14T12:33:16.935 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:16.933+0000 7f783741d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T12:33:16.949 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:16.947+0000 7f66bd4ae200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:33:17.025 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:17.024+0000 7f66bd4ae200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T12:33:17.074 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:17.073+0000 7f783741d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:33:17.167 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:17.165+0000 7f66bd4ae200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:33:17.311 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:17.309+0000 7f783741d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T12:33:17.326 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:17.397 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:17.396+0000 7f66bd4ae200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T12:33:17.444 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.443+0000 7fbfc5b88700 1 Processor -- start 2023-10-14T12:33:17.444 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.443+0000 7fbfc5b88700 1 -- start start 2023-10-14T12:33:17.447 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfc5b88700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfc015d7b0 0x7fbfc006c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:17.447 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfc5b88700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc00cdd20 0x7fbfc00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:17.447 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfc5b88700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc006bbd0 con 0x7fbfc015db90 2023-10-14T12:33:17.447 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfc5b88700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc006c200 con 0x7fbfc015d7b0 2023-10-14T12:33:17.448 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfc5b88700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00ce6d0 con 0x7fbfc00cdd20 2023-10-14T12:33:17.448 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfc015d7b0 0x7fbfc006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:17.448 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbeffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbfc015db90 0x7fbfc015dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:51966/0 (socket says 172.21.15.72:51966) 2023-10-14T12:33:17.448 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbeffd700 1 -- 172.21.15.72:0/2215224631 learned_addr learned my addr 172.21.15.72:0/2215224631 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:17.448 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbffff700 1 --2- 172.21.15.72:0/2215224631 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc00cdd20 0x7fbfc00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:17.449 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbf7fe700 1 -- 172.21.15.72:0/2215224631 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc00cdd20 msgr2=0x7fbfc00ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:17.449 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbf7fe700 1 --2- 172.21.15.72:0/2215224631 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc00cdd20 0x7fbfc00ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:17.449 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbf7fe700 1 -- 172.21.15.72:0/2215224631 >> v1:172.21.15.72:6789/0 conn(0x7fbfc015db90 legacy=0x7fbfc015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:17.449 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbf7fe700 1 -- 172.21.15.72:0/2215224631 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc015e7b0 con 0x7fbfc015d7b0 2023-10-14T12:33:17.449 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbe7fc700 1 -- 172.21.15.72:0/2215224631 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137634988 0 0) 0x7fbfc006bbd0 con 0x7fbfc015db90 2023-10-14T12:33:17.450 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbffff700 1 --2- 172.21.15.72:0/2215224631 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc00cdd20 0x7fbfc00ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:17.450 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbf7fe700 1 --2- 172.21.15.72:0/2215224631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc015d7b0 0x7fbfc006c620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009840 tx=0x7fbfb0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4577d99c693973a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:17.450 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbe7fc700 1 -- 172.21.15.72:0/2215224631 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0011830 con 0x7fbfc015d7b0 2023-10-14T12:33:17.450 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbe7fc700 1 -- 172.21.15.72:0/2215224631 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb0011990 con 0x7fbfc015d7b0 2023-10-14T12:33:17.450 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.444+0000 7fbfbe7fc700 1 -- 172.21.15.72:0/2215224631 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0011d20 con 0x7fbfc015d7b0 2023-10-14T12:33:17.451 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.445+0000 7fbfc5b88700 1 -- 172.21.15.72:0/2215224631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc015d7b0 msgr2=0x7fbfc006c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:17.451 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.445+0000 7fbfc5b88700 1 --2- 172.21.15.72:0/2215224631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc015d7b0 0x7fbfc006c620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009840 tx=0x7fbfb0009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:17.451 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.445+0000 7fbfc5b88700 1 -- 172.21.15.72:0/2215224631 shutdown_connections 2023-10-14T12:33:17.451 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.445+0000 7fbfc5b88700 1 --2- 172.21.15.72:0/2215224631 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc00cdd20 0x7fbfc00ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:17.451 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.445+0000 7fbfc5b88700 1 --2- 172.21.15.72:0/2215224631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc015d7b0 0x7fbfc006c620 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:17.451 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.445+0000 7fbfc5b88700 1 -- 172.21.15.72:0/2215224631 >> 172.21.15.72:0/2215224631 conn(0x7fbfc006a820 msgr2=0x7fbfc006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:17.452 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.445+0000 7fbfc5b88700 1 -- 172.21.15.72:0/2215224631 shutdown_connections 2023-10-14T12:33:17.452 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.445+0000 7fbfc5b88700 1 -- 172.21.15.72:0/2215224631 wait complete. 2023-10-14T12:33:17.454 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.447+0000 7fbfc5b88700 1 Processor -- start 2023-10-14T12:33:17.455 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.447+0000 7fbfc5b88700 1 -- start start 2023-10-14T12:33:17.455 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfc5b88700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc00cdd20 0x7fbfc014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:17.455 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfc5b88700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc015d7b0 0x7fbfc00c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:17.455 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfc5b88700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc015db90 0x7fbfc00ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:17.455 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfc5b88700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00c4ff0 con 0x7fbfc00cdd20 2023-10-14T12:33:17.456 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfc5b88700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00cb0f0 con 0x7fbfc015db90 2023-10-14T12:33:17.456 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfc5b88700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00c52b0 con 0x7fbfc015d7b0 2023-10-14T12:33:17.456 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc00cdd20 0x7fbfc014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:17.456 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc00cdd20 0x7fbfc014fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45670/0 (socket says 172.21.15.72:45670) 2023-10-14T12:33:17.456 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbf7fe700 1 -- 172.21.15.72:0/3810307357 learned_addr learned my addr 172.21.15.72:0/3810307357 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:17.457 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbeffd700 1 --2- 172.21.15.72:0/3810307357 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc015d7b0 0x7fbfc00c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:17.457 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbffff700 1 --2- 172.21.15.72:0/3810307357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc015db90 0x7fbfc00ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:17.457 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbf7fe700 1 -- 172.21.15.72:0/3810307357 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc015d7b0 msgr2=0x7fbfc00c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:17.457 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbf7fe700 1 --2- 172.21.15.72:0/3810307357 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc015d7b0 0x7fbfc00c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:17.457 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbf7fe700 1 -- 172.21.15.72:0/3810307357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc015db90 msgr2=0x7fbfc00ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:17.457 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbf7fe700 1 --2- 172.21.15.72:0/3810307357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc015db90 0x7fbfc00ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:17.458 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbf7fe700 1 -- 172.21.15.72:0/3810307357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00094a0 con 0x7fbfc00cdd20 2023-10-14T12:33:17.458 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.448+0000 7fbfbf7fe700 1 --2- 172.21.15.72:0/3810307357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc00cdd20 0x7fbfc014fde0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00090b0 tx=0x7fbfb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:17.458 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.449+0000 7fbfa7fff700 1 -- 172.21.15.72:0/3810307357 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00036a0 con 0x7fbfc00cdd20 2023-10-14T12:33:17.458 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.449+0000 7fbfa7fff700 1 -- 172.21.15.72:0/3810307357 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb001f070 con 0x7fbfc00cdd20 2023-10-14T12:33:17.458 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.449+0000 7fbfc5b88700 1 -- 172.21.15.72:0/3810307357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc00c5590 con 0x7fbfc00cdd20 2023-10-14T12:33:17.459 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.449+0000 7fbfa7fff700 1 -- 172.21.15.72:0/3810307357 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0003a60 con 0x7fbfc00cdd20 2023-10-14T12:33:17.459 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.449+0000 7fbfc5b88700 1 -- 172.21.15.72:0/3810307357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc0150d20 con 0x7fbfc00cdd20 2023-10-14T12:33:17.459 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.449+0000 7fbfa7fff700 1 -- 172.21.15.72:0/3810307357 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbfb0026480 con 0x7fbfc00cdd20 2023-10-14T12:33:17.459 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.449+0000 7fbfa7fff700 1 -- 172.21.15.72:0/3810307357 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbfb0021070 con 0x7fbfc00cdd20 2023-10-14T12:33:17.459 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.450+0000 7fbfc5b88700 1 -- 172.21.15.72:0/3810307357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc00c4df0 con 0x7fbfc00cdd20 2023-10-14T12:33:17.460 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.452+0000 7fbfa7fff700 1 -- 172.21.15.72:0/3810307357 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbfb0015020 con 0x7fbfc00cdd20 2023-10-14T12:33:17.523 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.521+0000 7fbfc5b88700 1 -- 172.21.15.72:0/3810307357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfc004ebb0 con 0x7fbfc00cdd20 2023-10-14T12:33:17.523 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.522+0000 7fbfa7fff700 1 -- 172.21.15.72:0/3810307357 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fbfb00267e0 con 0x7fbfc00cdd20 2023-10-14T12:33:17.524 INFO:teuthology.misc.health.smithi072.stdout: 2023-10-14T12:33:17.524 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":10,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:16.205452+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:17.525 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.523+0000 7fbfc5b88700 1 -- 172.21.15.72:0/3810307357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc00cdd20 msgr2=0x7fbfc014fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:17.525 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.523+0000 7fbfc5b88700 1 --2- 172.21.15.72:0/3810307357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc00cdd20 0x7fbfc014fde0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00090b0 tx=0x7fbfb0004750 comp rx=0 tx=0).stop 2023-10-14T12:33:17.525 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.523+0000 7fbfc5b88700 1 -- 172.21.15.72:0/3810307357 shutdown_connections 2023-10-14T12:33:17.526 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.523+0000 7fbfc5b88700 1 --2- 172.21.15.72:0/3810307357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfc015db90 0x7fbfc00ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:17.526 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.523+0000 7fbfc5b88700 1 --2- 172.21.15.72:0/3810307357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc00cdd20 0x7fbfc014fde0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:17.526 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.523+0000 7fbfc5b88700 1 --2- 172.21.15.72:0/3810307357 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbfc015d7b0 0x7fbfc00c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:17.526 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.523+0000 7fbfc5b88700 1 -- 172.21.15.72:0/3810307357 >> 172.21.15.72:0/3810307357 conn(0x7fbfc006a820 msgr2=0x7fbfc00b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:17.526 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.523+0000 7fbfc5b88700 1 -- 172.21.15.72:0/3810307357 shutdown_connections 2023-10-14T12:33:17.527 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:17.523+0000 7fbfc5b88700 1 -- 172.21.15.72:0/3810307357 wait complete. 2023-10-14T12:33:17.528 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:17.527+0000 7f783741d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T12:33:17.535 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T12:33:17.608 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:17.607+0000 7f66bd4ae200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T12:33:17.662 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:17.660+0000 7f783741d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T12:33:17.742 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:17.741+0000 7f66bd4ae200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T12:33:17.881 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:17.880+0000 7f783741d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T12:33:17.959 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:17.958+0000 7f66bd4ae200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T12:33:18.037 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:18.036+0000 7f783741d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T12:33:18.115 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:18.114+0000 7f66bd4ae200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T12:33:18.152 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:18.150+0000 7f783741d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T12:33:18.230 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:18.228+0000 7f66bd4ae200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T12:33:18.477 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:18.476+0000 7f783741d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T12:33:18.550 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:18.549+0000 7f66bd4ae200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T12:33:18.578 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:18.577+0000 7f783741d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T12:33:18.648 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:18.646+0000 7f66bd4ae200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T12:33:18.764 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:18.763+0000 7f783741d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T12:33:18.833 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:18.832+0000 7f66bd4ae200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T12:33:19.359 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:19.358+0000 7f783741d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T12:33:19.436 INFO:tasks.ceph.mgr.x.smithi123.stderr:2023-10-14T12:33:19.435+0000 7f66bd4ae200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T12:33:20.348 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-14T12:33:20.347+0000 7f1274983640 -1 osd.1 0 log_to_monitors true 2023-10-14T12:33:20.387 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:20.385+0000 7f77ef3ab700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T12:33:20.387 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-10-14T12:33:20.386+0000 7f77ef3ab700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T12:33:20.400 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-14T12:33:20.399+0000 7f2972930640 -1 osd.0 0 log_to_monitors true 2023-10-14T12:33:20.409 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-14T12:33:20.408+0000 7ffa16e6b640 -1 osd.3 0 log_to_monitors true 2023-10-14T12:33:20.412 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-14T12:33:20.411+0000 7fdd95909640 -1 osd.2 0 log_to_monitors true 2023-10-14T12:33:20.412 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-10-14T12:33:20.411+0000 7f8afdb43640 -1 osd.5 0 log_to_monitors true 2023-10-14T12:33:20.418 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-10-14T12:33:20.416+0000 7fb1ca129640 -1 osd.6 0 log_to_monitors true 2023-10-14T12:33:20.418 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-10-14T12:33:20.416+0000 7f1c0ad8c640 -1 osd.7 0 log_to_monitors true 2023-10-14T12:33:20.419 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-10-14T12:33:20.418+0000 7fc5c04b0640 -1 osd.4 0 log_to_monitors true 2023-10-14T12:33:23.483 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-10-14T12:33:23.480+0000 7f1bff144700 -1 osd.7 0 waiting for initial osdmap 2023-10-14T12:33:23.493 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-14T12:33:23.492+0000 7f2966ce8700 -1 osd.0 0 waiting for initial osdmap 2023-10-14T12:33:23.498 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-14T12:33:23.497+0000 7ffa0b223700 -1 osd.3 0 waiting for initial osdmap 2023-10-14T12:33:23.501 INFO:tasks.ceph.osd.7.smithi123.stderr:2023-10-14T12:33:23.500+0000 7f1bf6d1e700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:33:23.508 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-10-14T12:33:23.506+0000 7f8af1efb700 -1 osd.5 0 waiting for initial osdmap 2023-10-14T12:33:23.511 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-10-14T12:33:23.510+0000 7ffa02dfd700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:33:23.512 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-10-14T12:33:23.511+0000 7f295e8c2700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:33:23.516 INFO:tasks.ceph.osd.5.smithi123.stderr:2023-10-14T12:33:23.515+0000 7f8ae9ad5700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:33:23.527 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-14T12:33:23.526+0000 7f1268d3b700 -1 osd.1 0 waiting for initial osdmap 2023-10-14T12:33:23.541 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-10-14T12:33:23.540+0000 7f1260915700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:33:23.563 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-10-14T12:33:23.562+0000 7fc5b4868700 -1 osd.4 0 waiting for initial osdmap 2023-10-14T12:33:23.576 INFO:tasks.ceph.osd.4.smithi123.stderr:2023-10-14T12:33:23.575+0000 7fc5ac442700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:33:23.591 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-10-14T12:33:23.588+0000 7fb1be4e1700 -1 osd.6 0 waiting for initial osdmap 2023-10-14T12:33:23.606 INFO:tasks.ceph.osd.6.smithi123.stderr:2023-10-14T12:33:23.605+0000 7fb1b60bb700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:33:23.722 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-14T12:33:23.721+0000 7fdd89cc1700 -1 osd.2 0 waiting for initial osdmap 2023-10-14T12:33:23.736 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-10-14T12:33:23.735+0000 7fdd8189b700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:33:24.342 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:24.456 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.454+0000 7feba135a700 1 Processor -- start 2023-10-14T12:33:24.456 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.454+0000 7feba135a700 1 -- start start 2023-10-14T12:33:24.462 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.455+0000 7feba135a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb9c072350 0x7feb9c1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.462 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.455+0000 7feba135a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0717b0 con 0x7feb9c06ff50 2023-10-14T12:33:24.462 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.455+0000 7feba135a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c06b760 con 0x7feb9c15dc50 2023-10-14T12:33:24.462 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.455+0000 7feba135a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c15e030 con 0x7feb9c072350 2023-10-14T12:33:24.463 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.455+0000 7feb9a7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feb9c06ff50 0x7feb9c071c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52076/0 (socket says 172.21.15.72:52076) 2023-10-14T12:33:24.463 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.455+0000 7feb9a7fc700 1 -- 172.21.15.72:0/3587968485 learned_addr learned my addr 172.21.15.72:0/3587968485 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:24.463 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.455+0000 7feb9b7fe700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb9c072350 0x7feb9c1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.463 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.455+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082421381 0 0) 0x7feb9c0717b0 con 0x7feb9c06ff50 2023-10-14T12:33:24.464 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb840035b0 con 0x7feb9c06ff50 2023-10-14T12:33:24.464 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876156757 0 0) 0x7feb9c06b760 con 0x7feb9c15dc50 2023-10-14T12:33:24.464 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb9c0717b0 con 0x7feb9c15dc50 2023-10-14T12:33:24.464 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1449041233 0 0) 0x7feb840035b0 con 0x7feb9c06ff50 2023-10-14T12:33:24.465 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb9c072350 msgr2=0x7feb9c1689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:24.465 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb9c072350 0x7feb9c1689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.465 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 >> v1:172.21.15.123:6789/0 conn(0x7feb9c15dc50 legacy=0x7feb9c0ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.465 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c06b1e0 con 0x7feb9c06ff50 2023-10-14T12:33:24.465 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7feb8c001670 con 0x7feb9c06ff50 2023-10-14T12:33:24.466 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 >> v1:172.21.15.72:6789/0 conn(0x7feb9c06ff50 legacy=0x7feb9c071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.466 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84003bc0 0x7feb84003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.466 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb9c072350 0x7feb84004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.466 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb84004d90 0x7feb84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.467 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c15e030 con 0x7feb84003bc0 2023-10-14T12:33:24.467 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8400bba0 con 0x7feb84004d90 2023-10-14T12:33:24.467 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8400bd30 con 0x7feb9c072350 2023-10-14T12:33:24.467 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb9affd700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84003bc0 0x7feb84003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.467 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb9a7fc700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb9c072350 0x7feb84004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.468 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb9b7fe700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb84004d90 0x7feb84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.468 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb9affd700 1 -- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb9c072350 msgr2=0x7feb84004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:24.468 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb9affd700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb9c072350 0x7feb84004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.468 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb9affd700 1 -- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb84004d90 msgr2=0x7feb84005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:24.469 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb9affd700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb84004d90 0x7feb84005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.469 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb9affd700 1 -- 172.21.15.72:0/3587968485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840035b0 con 0x7feb84003bc0 2023-10-14T12:33:24.469 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb9affd700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84003bc0 0x7feb84003fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb90001970 tx=0x7feb84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b64ed9a30c432eb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:24.469 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.456+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90001430 con 0x7feb84003bc0 2023-10-14T12:33:24.469 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.457+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb900052d0 con 0x7feb84003bc0 2023-10-14T12:33:24.470 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.457+0000 7feb99ffb700 1 -- 172.21.15.72:0/3587968485 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90003680 con 0x7feb84003bc0 2023-10-14T12:33:24.470 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.457+0000 7feba135a700 1 -- 172.21.15.72:0/3587968485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84003bc0 msgr2=0x7feb84003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.470 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.457+0000 7feba135a700 1 --2- 172.21.15.72:0/3587968485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84003bc0 0x7feb84003fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb90001970 tx=0x7feb84005880 comp rx=0 tx=0).stop 2023-10-14T12:33:24.470 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.457+0000 7feb9b7fe700 1 -- 172.21.15.72:0/3587968485 reap_dead start 2023-10-14T12:33:24.471 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.457+0000 7feba135a700 1 -- 172.21.15.72:0/3587968485 shutdown_connections 2023-10-14T12:33:24.471 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.457+0000 7feba135a700 1 -- 172.21.15.72:0/3587968485 >> 172.21.15.72:0/3587968485 conn(0x7feb9c0b1db0 msgr2=0x7feb9c0b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:24.471 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.457+0000 7feba135a700 1 -- 172.21.15.72:0/3587968485 shutdown_connections 2023-10-14T12:33:24.472 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.457+0000 7feba135a700 1 -- 172.21.15.72:0/3587968485 wait complete. 2023-10-14T12:33:24.472 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.458+0000 7feba135a700 1 Processor -- start 2023-10-14T12:33:24.472 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.458+0000 7feba135a700 1 -- start start 2023-10-14T12:33:24.472 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feba135a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb84003bc0 0x7feb9c154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.472 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feba135a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c0c6740 0x7feb9c0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.473 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feba135a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb9c0c6070 0x7feb9c0c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.473 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feba135a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c6520 con 0x7feb9c0c6070 2023-10-14T12:33:24.473 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feba135a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c46e0 con 0x7feb9c0c6740 2023-10-14T12:33:24.473 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feba135a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0c5220 con 0x7feb84003bc0 2023-10-14T12:33:24.473 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feb9b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb9c0c6070 0x7feb9c0c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.474 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feb9b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb9c0c6070 0x7feb9c0c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45790/0 (socket says 172.21.15.72:45790) 2023-10-14T12:33:24.474 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feb9b7fe700 1 -- 172.21.15.72:0/1168890759 learned_addr learned my addr 172.21.15.72:0/1168890759 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:24.474 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feb9affd700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb84003bc0 0x7feb9c154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.475 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feb9a7fc700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c0c6740 0x7feb9c0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.475 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feb9b7fe700 1 -- 172.21.15.72:0/1168890759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb84003bc0 msgr2=0x7feb9c154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.475 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feb9b7fe700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb84003bc0 0x7feb9c154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.475 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feb9b7fe700 1 -- 172.21.15.72:0/1168890759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c0c6740 msgr2=0x7feb9c0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.475 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.459+0000 7feb9b7fe700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c0c6740 0x7feb9c0c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.476 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.460+0000 7feb9b7fe700 1 -- 172.21.15.72:0/1168890759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c161170 con 0x7feb9c0c6070 2023-10-14T12:33:24.476 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.460+0000 7feb9b7fe700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb9c0c6070 0x7feb9c0c75b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feb9c067d90 tx=0x7feb94011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:24.476 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.460+0000 7feb837fe700 1 -- 172.21.15.72:0/1168890759 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9400e040 con 0x7feb9c0c6070 2023-10-14T12:33:24.476 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.460+0000 7feb837fe700 1 -- 172.21.15.72:0/1168890759 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9400f040 con 0x7feb9c0c6070 2023-10-14T12:33:24.477 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.460+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c0c48f0 con 0x7feb9c0c6070 2023-10-14T12:33:24.477 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.460+0000 7feb837fe700 1 -- 172.21.15.72:0/1168890759 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9400fde0 con 0x7feb9c0c6070 2023-10-14T12:33:24.477 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.460+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0c4eb0 con 0x7feb9c0c6070 2023-10-14T12:33:24.477 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.461+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c0c3bb0 con 0x7feb9c0c6070 2023-10-14T12:33:24.478 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.461+0000 7feb837fe700 1 -- 172.21.15.72:0/1168890759 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7feb94022460 con 0x7feb9c0c6070 2023-10-14T12:33:24.479 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.462+0000 7feb837fe700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb8806ae70 0x7feb8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.479 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.462+0000 7feb837fe700 1 -- 172.21.15.72:0/1168890759 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7feb940899a0 con 0x7feb9c0c6070 2023-10-14T12:33:24.479 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.462+0000 7feb9affd700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb8806ae70 0x7feb8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.479 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.462+0000 7feb9affd700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb8806ae70 0x7feb8806d330 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feb90015040 tx=0x7feb9000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:24.479 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.466+0000 7feb837fe700 1 -- 172.21.15.72:0/1168890759 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb940559a0 con 0x7feb9c0c6070 2023-10-14T12:33:24.665 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.663+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb9c0c5040 con 0x7feb9c0c6070 2023-10-14T12:33:24.665 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.664+0000 7feb837fe700 1 -- 172.21.15.72:0/1168890759 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10908 (secure 0 0 0) 0x7feb94058fc0 con 0x7feb9c0c6070 2023-10-14T12:33:24.666 INFO:teuthology.misc.health.smithi072.stdout: 2023-10-14T12:33:24.666 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":13,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:24.501229+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:24.668 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb8806ae70 msgr2=0x7feb8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.668 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb8806ae70 0x7feb8806d330 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feb90015040 tx=0x7feb9000a000 comp rx=0 tx=0).stop 2023-10-14T12:33:24.668 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb9c0c6070 msgr2=0x7feb9c0c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.668 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb9c0c6070 0x7feb9c0c75b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feb9c067d90 tx=0x7feb94011f80 comp rx=0 tx=0).stop 2023-10-14T12:33:24.669 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 shutdown_connections 2023-10-14T12:33:24.669 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb8806ae70 0x7feb8806d330 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.669 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb9c0c6070 0x7feb9c0c75b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.669 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feb84003bc0 0x7feb9c154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.669 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 --2- 172.21.15.72:0/1168890759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c0c6740 0x7feb9c0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.670 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 >> 172.21.15.72:0/1168890759 conn(0x7feb9c0b1db0 msgr2=0x7feb9c0b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:24.670 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 shutdown_connections 2023-10-14T12:33:24.670 INFO:teuthology.misc.health.smithi072.stderr:2023-10-14T12:33:24.666+0000 7feba135a700 1 -- 172.21.15.72:0/1168890759 wait complete. 2023-10-14T12:33:24.678 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T12:33:24.679 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T12:33:24.679 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T12:33:24.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T12:33:24.682 INFO:tasks.ceph.mds.a:Started 2023-10-14T12:33:24.682 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T12:33:24.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T12:33:24.685 INFO:tasks.ceph.mds.c:Started 2023-10-14T12:33:24.686 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T12:33:24.686 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T12:33:24.689 INFO:tasks.ceph.mds.b:Started 2023-10-14T12:33:24.689 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T12:33:24.689 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T12:33:24.691 INFO:tasks.ceph.mds.d:Started 2023-10-14T12:33:24.692 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T12:33:24.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:24.763 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-10-14T12:33:24.763 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-10-14T12:33:24.777 INFO:tasks.ceph.mds.b.smithi123.stdout:starting mds.b at 2023-10-14T12:33:24.778 INFO:tasks.ceph.mds.d.smithi123.stdout:starting mds.d at 2023-10-14T12:33:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.822+0000 7f4a66a39700 1 Processor -- start 2023-10-14T12:33:24.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.822+0000 7f4a66a39700 1 -- start start 2023-10-14T12:33:24.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.822+0000 7f4a66a39700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 0x7f4a600b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a66a39700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a60161180 con 0x7f4a600cf6b0 2023-10-14T12:33:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a66a39700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a60161460 con 0x7f4a600b3240 2023-10-14T12:33:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a66a39700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600b36c0 con 0x7f4a6015b300 2023-10-14T12:33:24.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a64fd6700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4a600cf6b0 0x7f4a6006bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52244/0 (socket says 172.21.15.72:52244) 2023-10-14T12:33:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a64fd6700 1 -- 172.21.15.72:0/1732181758 learned_addr learned my addr 172.21.15.72:0/1732181758 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5ffff700 1 --2- 172.21.15.72:0/1732181758 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 0x7f4a600b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5effd700 1 -- 172.21.15.72:0/1732181758 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149646694 0 0) 0x7f4a60161180 con 0x7f4a600cf6b0 2023-10-14T12:33:24.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5effd700 1 -- 172.21.15.72:0/1732181758 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a480035b0 con 0x7f4a600cf6b0 2023-10-14T12:33:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5effd700 1 -- 172.21.15.72:0/1732181758 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003661047 0 0) 0x7f4a60161460 con 0x7f4a600b3240 2023-10-14T12:33:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5effd700 1 -- 172.21.15.72:0/1732181758 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a60161180 con 0x7f4a600b3240 2023-10-14T12:33:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5effd700 1 -- 172.21.15.72:0/1732181758 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3170711475 0 0) 0x7f4a480035b0 con 0x7f4a600cf6b0 2023-10-14T12:33:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1732181758 >> v1:172.21.15.123:6789/0 conn(0x7f4a600b3240 legacy=0x7f4a600cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1732181758 >> v1:172.21.15.72:6789/0 conn(0x7f4a600cf6b0 legacy=0x7f4a6006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5ffff700 1 -- 172.21.15.72:0/1732181758 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60161740 con 0x7f4a6015b300 2023-10-14T12:33:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5ffff700 1 --2- 172.21.15.72:0/1732181758 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 0x7f4a600b2d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009870 tx=0x7f4a50009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7897cd0489cc54be server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.823+0000 7f4a5effd700 1 -- 172.21.15.72:0/1732181758 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a580019f0 con 0x7f4a6015b300 2023-10-14T12:33:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.824+0000 7f4a5effd700 1 -- 172.21.15.72:0/1732181758 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50004030 con 0x7f4a6015b300 2023-10-14T12:33:24.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.824+0000 7f4a5effd700 1 -- 172.21.15.72:0/1732181758 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500043c0 con 0x7f4a6015b300 2023-10-14T12:33:24.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.824+0000 7f4a66a39700 1 -- 172.21.15.72:0/1732181758 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 msgr2=0x7f4a600b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.824+0000 7f4a66a39700 1 --2- 172.21.15.72:0/1732181758 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 0x7f4a600b2d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009870 tx=0x7f4a50009b80 comp rx=0 tx=0).stop 2023-10-14T12:33:24.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.824+0000 7f4a66a39700 1 -- 172.21.15.72:0/1732181758 shutdown_connections 2023-10-14T12:33:24.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.824+0000 7f4a66a39700 1 --2- 172.21.15.72:0/1732181758 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 0x7f4a600b2d00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.824+0000 7f4a66a39700 1 -- 172.21.15.72:0/1732181758 >> 172.21.15.72:0/1732181758 conn(0x7f4a600cdd00 msgr2=0x7f4a600ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.824+0000 7f4a66a39700 1 -- 172.21.15.72:0/1732181758 shutdown_connections 2023-10-14T12:33:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.824+0000 7f4a66a39700 1 -- 172.21.15.72:0/1732181758 wait complete. 2023-10-14T12:33:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.825+0000 7f4a66a39700 1 Processor -- start 2023-10-14T12:33:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a66a39700 1 -- start start 2023-10-14T12:33:24.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a66a39700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a600b3240 0x7f4a601f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a66a39700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a600cf6b0 0x7f4a60156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a66a39700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 0x7f4a600cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a66a39700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a601f7340 con 0x7f4a600cf6b0 2023-10-14T12:33:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a66a39700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a601573f0 con 0x7f4a600b3240 2023-10-14T12:33:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a66a39700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60144790 con 0x7f4a6015b300 2023-10-14T12:33:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a5f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a600cf6b0 0x7f4a60156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a5f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a600cf6b0 0x7f4a60156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45950/0 (socket says 172.21.15.72:45950) 2023-10-14T12:33:24.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a5f7fe700 1 -- 172.21.15.72:0/2334600574 learned_addr learned my addr 172.21.15.72:0/2334600574 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:24.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a64fd6700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 0x7f4a600cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.826+0000 7f4a5ffff700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a600b3240 0x7f4a601f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a5f7fe700 1 -- 172.21.15.72:0/2334600574 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 msgr2=0x7f4a600cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a5f7fe700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 0x7f4a600cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a5f7fe700 1 -- 172.21.15.72:0/2334600574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a600b3240 msgr2=0x7f4a601f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a5f7fe700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a600b3240 0x7f4a601f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a5f7fe700 1 -- 172.21.15.72:0/2334600574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500094a0 con 0x7f4a600cf6b0 2023-10-14T12:33:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a5f7fe700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a600cf6b0 0x7f4a60156eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a540011e0 tx=0x7f4a5400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a5cff9700 1 -- 172.21.15.72:0/2334600574 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540054e0 con 0x7f4a600cf6b0 2023-10-14T12:33:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a5cff9700 1 -- 172.21.15.72:0/2334600574 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54003680 con 0x7f4a600cf6b0 2023-10-14T12:33:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a60144a50 con 0x7f4a600cf6b0 2023-10-14T12:33:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a5cff9700 1 -- 172.21.15.72:0/2334600574 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a54003a30 con 0x7f4a600cf6b0 2023-10-14T12:33:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.827+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a60145010 con 0x7f4a600cf6b0 2023-10-14T12:33:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.828+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6004ebb0 con 0x7f4a600cf6b0 2023-10-14T12:33:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.828+0000 7f4a5cff9700 1 -- 172.21.15.72:0/2334600574 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f4a54003b90 con 0x7f4a600cf6b0 2023-10-14T12:33:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.829+0000 7f4a5cff9700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4a4c06aea0 0x7f4a4c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.829+0000 7f4a5cff9700 1 -- 172.21.15.72:0/2334600574 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f4a540883e0 con 0x7f4a600cf6b0 2023-10-14T12:33:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.829+0000 7f4a5ffff700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4a4c06aea0 0x7f4a4c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.829+0000 7f4a5ffff700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4a4c06aea0 0x7f4a4c06d360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a500090b0 tx=0x7f4a50008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:24.833+0000 7f4a5cff9700 1 -- 172.21.15.72:0/2334600574 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a54053a40 con 0x7f4a600cf6b0 2023-10-14T12:33:25.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.024+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a600c49b0 con 0x7f4a600cf6b0 2023-10-14T12:33:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.025+0000 7f4a5cff9700 1 -- 172.21.15.72:0/2334600574 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10908 (secure 0 0 0) 0x7f4a54017090 con 0x7f4a600cf6b0 2023-10-14T12:33:25.026 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:25.027 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":13,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:24.501229+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.026+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4a4c06aea0 msgr2=0x7f4a4c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.026+0000 7f4a66a39700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4a4c06aea0 0x7f4a4c06d360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a500090b0 tx=0x7f4a50008030 comp rx=0 tx=0).stop 2023-10-14T12:33:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.026+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a600cf6b0 msgr2=0x7f4a60156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:25.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.026+0000 7f4a66a39700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a600cf6b0 0x7f4a60156eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a540011e0 tx=0x7f4a5400ca30 comp rx=0 tx=0).stop 2023-10-14T12:33:25.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.027+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 shutdown_connections 2023-10-14T12:33:25.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.027+0000 7f4a66a39700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4a4c06aea0 0x7f4a4c06d360 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.027+0000 7f4a66a39700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4a6015b300 0x7f4a600cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.027+0000 7f4a66a39700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a600b3240 0x7f4a601f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.027+0000 7f4a66a39700 1 --2- 172.21.15.72:0/2334600574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a600cf6b0 0x7f4a60156eb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.027+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 >> 172.21.15.72:0/2334600574 conn(0x7f4a600cdd00 msgr2=0x7f4a6015bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:25.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.027+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 shutdown_connections 2023-10-14T12:33:25.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.027+0000 7f4a66a39700 1 -- 172.21.15.72:0/2334600574 wait complete. 2023-10-14T12:33:25.040 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-14T12:33:25.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:33:25.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.160+0000 7f2ef1370700 1 Processor -- start 2023-10-14T12:33:25.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.160+0000 7f2ef1370700 1 -- start start 2023-10-14T12:33:25.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.160+0000 7f2ef1370700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2eec160b50 0x7f2eec0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:25.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ef1370700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0b5700 0x7f2eec0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:25.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ef1370700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eec0b94b0 con 0x7f2eec0b9000 2023-10-14T12:33:25.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ef1370700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec0d0010 con 0x7f2eec160b50 2023-10-14T12:33:25.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ef1370700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0d02f0 con 0x7f2eec0b5700 2023-10-14T12:33:25.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2eea7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2eec0b9000 0x7f2eec0b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52254/0 (socket says 172.21.15.72:52254) 2023-10-14T12:33:25.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2eea7fc700 1 -- 172.21.15.72:0/286487048 learned_addr learned my addr 172.21.15.72:0/286487048 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:25.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2eeaffd700 1 --2- 172.21.15.72:0/286487048 >> v2:172.21.15.123:3300/0 conn(0x7f2eec160b50 0x7f2eec0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:25.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2eeb7fe700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0b5700 0x7f2eec0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:25.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887632825 0 0) 0x7f2eec0b94b0 con 0x7f2eec0b9000 2023-10-14T12:33:25.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed40035b0 con 0x7f2eec0b9000 2023-10-14T12:33:25.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4191349115 0 0) 0x7f2ed40035b0 con 0x7f2eec0b9000 2023-10-14T12:33:25.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0b5700 msgr2=0x7f2eec0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0b5700 0x7f2eec0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 >> v2:172.21.15.123:3300/0 conn(0x7f2eec160b50 msgr2=0x7f2eec0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 --2- 172.21.15.72:0/286487048 >> v2:172.21.15.123:3300/0 conn(0x7f2eec160b50 0x7f2eec0cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec0d05d0 con 0x7f2eec0b9000 2023-10-14T12:33:25.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f2ee0001670 con 0x7f2eec0b9000 2023-10-14T12:33:25.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 >> v1:172.21.15.72:6789/0 conn(0x7f2eec0b9000 legacy=0x7f2eec0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:25.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2ed4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:25.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ed4004850 0x7f2ed4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:25.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0b5700 0x7f2ed4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0d0010 con 0x7f2ed4003a00 2023-10-14T12:33:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0d02f0 con 0x7f2ed4004850 2023-10-14T12:33:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed400ba40 con 0x7f2eec0b5700 2023-10-14T12:33:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2eeaffd700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2ed4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:25.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2eea7fc700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ed4004850 0x7f2ed4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.161+0000 7f2eeb7fe700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0b5700 0x7f2ed4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2eeaffd700 1 -- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0b5700 msgr2=0x7f2ed4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2eeaffd700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0b5700 0x7f2ed4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2eeaffd700 1 -- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ed4004850 msgr2=0x7f2ed4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2eeaffd700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ed4004850 0x7f2ed4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2eeaffd700 1 -- 172.21.15.72:0/286487048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40035b0 con 0x7f2ed4003a00 2023-10-14T12:33:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2eeaffd700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2ed4003e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009b60 tx=0x7f2ed4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eafd69039a10cef server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00e6c0 con 0x7f2ed4003a00 2023-10-14T12:33:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc00e820 con 0x7f2ed4003a00 2023-10-14T12:33:25.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2ee9ffb700 1 -- 172.21.15.72:0/286487048 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00eb90 con 0x7f2ed4003a00 2023-10-14T12:33:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2ef1370700 1 -- 172.21.15.72:0/286487048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 msgr2=0x7f2ed4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2ef1370700 1 --2- 172.21.15.72:0/286487048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2ed4003e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009b60 tx=0x7f2ed4005880 comp rx=0 tx=0).stop 2023-10-14T12:33:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2eeb7fe700 1 -- 172.21.15.72:0/286487048 reap_dead start 2023-10-14T12:33:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2ef1370700 1 -- 172.21.15.72:0/286487048 shutdown_connections 2023-10-14T12:33:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2ef1370700 1 -- 172.21.15.72:0/286487048 >> 172.21.15.72:0/286487048 conn(0x7f2eec06bc70 msgr2=0x7f2eec06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:25.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2ef1370700 1 -- 172.21.15.72:0/286487048 shutdown_connections 2023-10-14T12:33:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.162+0000 7f2ef1370700 1 -- 172.21.15.72:0/286487048 wait complete. 2023-10-14T12:33:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.164+0000 7f2ef1370700 1 Processor -- start 2023-10-14T12:33:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.164+0000 7f2ef1370700 1 -- start start 2023-10-14T12:33:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2ef1370700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2eec155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:25.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2ef1370700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eec1545d0 0x7f2eec0cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:25.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2ef1370700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0ccef0 0x7f2eec0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:25.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2ef1370700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec155a50 con 0x7f2ed4003a00 2023-10-14T12:33:25.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2ef1370700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec154a50 con 0x7f2eec1545d0 2023-10-14T12:33:25.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2ef1370700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec0cd450 con 0x7f2eec0ccef0 2023-10-14T12:33:25.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2eeaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2eec155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2eeaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2eec155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:45966/0 (socket says 172.21.15.72:45966) 2023-10-14T12:33:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2eeaffd700 1 -- 172.21.15.72:0/924958452 learned_addr learned my addr 172.21.15.72:0/924958452 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2eea7fc700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eec1545d0 0x7f2eec0cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:25.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.165+0000 7f2eeb7fe700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0ccef0 0x7f2eec0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2eeaffd700 1 -- 172.21.15.72:0/924958452 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0ccef0 msgr2=0x7f2eec0b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2eeaffd700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0ccef0 0x7f2eec0b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2eeaffd700 1 -- 172.21.15.72:0/924958452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eec1545d0 msgr2=0x7f2eec0cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2eeaffd700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eec1545d0 0x7f2eec0cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2eeaffd700 1 -- 172.21.15.72:0/924958452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec0cd730 con 0x7f2ed4003a00 2023-10-14T12:33:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2eeb7fe700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0ccef0 0x7f2eec0b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2eeaffd700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2eec155ee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4004760 tx=0x7f2edc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2ed37fe700 1 -- 172.21.15.72:0/924958452 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc00e6c0 con 0x7f2ed4003a00 2023-10-14T12:33:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2ed37fe700 1 -- 172.21.15.72:0/924958452 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc003ab0 con 0x7f2ed4003a00 2023-10-14T12:33:25.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eec155400 con 0x7f2ed4003a00 2023-10-14T12:33:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2ed37fe700 1 -- 172.21.15.72:0/924958452 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc003e60 con 0x7f2ed4003a00 2023-10-14T12:33:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.166+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eec1568c0 con 0x7f2ed4003a00 2023-10-14T12:33:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.167+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eec04ebb0 con 0x7f2ed4003a00 2023-10-14T12:33:25.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.167+0000 7f2ed37fe700 1 -- 172.21.15.72:0/924958452 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f2edc013470 con 0x7f2ed4003a00 2023-10-14T12:33:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.168+0000 7f2ed37fe700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2ed806ae70 0x7f2ed806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.168+0000 7f2eea7fc700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2ed806ae70 0x7f2ed806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:25.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.168+0000 7f2ed37fe700 1 -- 172.21.15.72:0/924958452 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f2edc08a820 con 0x7f2ed4003a00 2023-10-14T12:33:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.168+0000 7f2eea7fc700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2ed806ae70 0x7f2ed806d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0001050 tx=0x7f2ee0000fe0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:25.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.172+0000 7f2ed37fe700 1 -- 172.21.15.72:0/924958452 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2edc056030 con 0x7f2ed4003a00 2023-10-14T12:33:25.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.405+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2eec0c6870 con 0x7f2ed4003a00 2023-10-14T12:33:25.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.420+0000 7f2ed37fe700 1 -- 172.21.15.72:0/924958452 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f2edc017540 con 0x7f2ed4003a00 2023-10-14T12:33:25.421 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:25.422 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-14T12:33:25.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2ed806ae70 msgr2=0x7f2ed806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2ed806ae70 0x7f2ed806d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0001050 tx=0x7f2ee0000fe0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 msgr2=0x7f2eec155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2eec155ee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4004760 tx=0x7f2edc0047c0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 shutdown_connections 2023-10-14T12:33:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2ed806ae70 0x7f2ed806d330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2eec0ccef0 0x7f2eec0b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ed4003a00 0x7f2eec155ee0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 --2- 172.21.15.72:0/924958452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2eec1545d0 0x7f2eec0cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:25.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 >> 172.21.15.72:0/924958452 conn(0x7f2eec06bc70 msgr2=0x7f2eec0b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 shutdown_connections 2023-10-14T12:33:25.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:25.422+0000 7f2ef1370700 1 -- 172.21.15.72:0/924958452 wait complete. 2023-10-14T12:33:25.427 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 2 2023-10-14T12:33:27.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:33:27.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.563+0000 7f6a05959700 1 Processor -- start 2023-10-14T12:33:27.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.563+0000 7f6a05959700 1 -- start start 2023-10-14T12:33:27.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.564+0000 7f6a05959700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a000ca7d0 0x7f6a000cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.564+0000 7f6a05959700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0015ca20 con 0x7f6a0015f000 2023-10-14T12:33:27.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.564+0000 7f6a05959700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a000726b0 con 0x7f6a0006a820 2023-10-14T12:33:27.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.564+0000 7f6a05959700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a000718f0 con 0x7f6a000ca7d0 2023-10-14T12:33:27.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.564+0000 7f69ff7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6a0015f000 0x7f6a0015f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52354/0 (socket says 172.21.15.72:52354) 2023-10-14T12:33:27.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.564+0000 7f69ff7fe700 1 -- 172.21.15.72:0/2595411579 learned_addr learned my addr 172.21.15.72:0/2595411579 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:27.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fe7fc700 1 --2- 172.21.15.72:0/2595411579 >> v2:172.21.15.123:3300/0 conn(0x7f6a000ca7d0 0x7f6a000cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fdffb700 1 -- 172.21.15.72:0/2595411579 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569884040 0 0) 0x7f6a0015ca20 con 0x7f6a0015f000 2023-10-14T12:33:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fdffb700 1 -- 172.21.15.72:0/2595411579 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e80035b0 con 0x7f6a0015f000 2023-10-14T12:33:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fe7fc700 1 -- 172.21.15.72:0/2595411579 >> v1:172.21.15.123:6789/0 conn(0x7f6a0006a820 legacy=0x7f6a0006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fe7fc700 1 -- 172.21.15.72:0/2595411579 >> v1:172.21.15.72:6789/0 conn(0x7f6a0015f000 legacy=0x7f6a0015f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fe7fc700 1 -- 172.21.15.72:0/2595411579 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a00071bd0 con 0x7f6a000ca7d0 2023-10-14T12:33:27.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fe7fc700 1 --2- 172.21.15.72:0/2595411579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a000ca7d0 0x7f6a000cc310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009840 tx=0x7f69f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71317a2009cd699a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:27.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fdffb700 1 -- 172.21.15.72:0/2595411579 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4011830 con 0x7f6a000ca7d0 2023-10-14T12:33:27.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fdffb700 1 -- 172.21.15.72:0/2595411579 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4011990 con 0x7f6a000ca7d0 2023-10-14T12:33:27.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.565+0000 7f69fdffb700 1 -- 172.21.15.72:0/2595411579 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4011d20 con 0x7f6a000ca7d0 2023-10-14T12:33:27.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.566+0000 7f6a05959700 1 -- 172.21.15.72:0/2595411579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a000ca7d0 msgr2=0x7f6a000cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.566+0000 7f6a05959700 1 --2- 172.21.15.72:0/2595411579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a000ca7d0 0x7f6a000cc310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009840 tx=0x7f69f4009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:27.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.566+0000 7f6a05959700 1 -- 172.21.15.72:0/2595411579 shutdown_connections 2023-10-14T12:33:27.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.566+0000 7f6a05959700 1 --2- 172.21.15.72:0/2595411579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a000ca7d0 0x7f6a000cc310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.566+0000 7f6a05959700 1 -- 172.21.15.72:0/2595411579 >> 172.21.15.72:0/2595411579 conn(0x7f6a000d0180 msgr2=0x7f6a000d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:27.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.566+0000 7f6a05959700 1 -- 172.21.15.72:0/2595411579 shutdown_connections 2023-10-14T12:33:27.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.566+0000 7f6a05959700 1 -- 172.21.15.72:0/2595411579 wait complete. 2023-10-14T12:33:27.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.567+0000 7f6a05959700 1 Processor -- start 2023-10-14T12:33:27.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.567+0000 7f6a05959700 1 -- start start 2023-10-14T12:33:27.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f6a05959700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0006a820 0x7f6a000b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f6a05959700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a000ca7d0 0x7f6a001f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f6a05959700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a0015f000 0x7f6a001f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f6a05959700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000b3440 con 0x7f6a0015f000 2023-10-14T12:33:27.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f6a05959700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a000c7690 con 0x7f6a0006a820 2023-10-14T12:33:27.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f6a05959700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a001f1fa0 con 0x7f6a000ca7d0 2023-10-14T12:33:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f69ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a0015f000 0x7f6a001f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f69ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a0015f000 0x7f6a001f1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46062/0 (socket says 172.21.15.72:46062) 2023-10-14T12:33:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f69ff7fe700 1 -- 172.21.15.72:0/96497397 learned_addr learned my addr 172.21.15.72:0/96497397 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:27.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f69feffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0006a820 0x7f6a000b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.568+0000 7f69fe7fc700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a000ca7d0 0x7f6a001f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f69ff7fe700 1 -- 172.21.15.72:0/96497397 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a000ca7d0 msgr2=0x7f6a001f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f69ff7fe700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a000ca7d0 0x7f6a001f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f69ff7fe700 1 -- 172.21.15.72:0/96497397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0006a820 msgr2=0x7f6a000b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f69ff7fe700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0006a820 0x7f6a000b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f69ff7fe700 1 -- 172.21.15.72:0/96497397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40094a0 con 0x7f6a0015f000 2023-10-14T12:33:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f69ff7fe700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a0015f000 0x7f6a001f1940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69f80014b0 tx=0x7f69f800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f69e7fff700 1 -- 172.21.15.72:0/96497397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f800a9e0 con 0x7f6a0015f000 2023-10-14T12:33:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f69e7fff700 1 -- 172.21.15.72:0/96497397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f800ab40 con 0x7f6a0015f000 2023-10-14T12:33:27.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a000b2df0 con 0x7f6a0015f000 2023-10-14T12:33:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f69e7fff700 1 -- 172.21.15.72:0/96497397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f8012400 con 0x7f6a0015f000 2023-10-14T12:33:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.569+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a000c9d40 con 0x7f6a0015f000 2023-10-14T12:33:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.570+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a00067d10 con 0x7f6a0015f000 2023-10-14T12:33:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.571+0000 7f69e7fff700 1 -- 172.21.15.72:0/96497397 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f69f8007d50 con 0x7f6a0015f000 2023-10-14T12:33:27.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.571+0000 7f69e7fff700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f69ec06ae70 0x7f69ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.571+0000 7f69feffd700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f69ec06ae70 0x7f69ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.571+0000 7f69e7fff700 1 -- 172.21.15.72:0/96497397 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f69f8088a10 con 0x7f6a0015f000 2023-10-14T12:33:27.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.571+0000 7f69feffd700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f69ec06ae70 0x7f69ec06d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a0009ce30 tx=0x7f69f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:27.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.576+0000 7f69e7fff700 1 -- 172.21.15.72:0/96497397 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f69f8053ef0 con 0x7f6a0015f000 2023-10-14T12:33:27.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.831+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a0004ebb0 con 0x7f6a0015f000 2023-10-14T12:33:27.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.832+0000 7f69e7fff700 1 -- 172.21.15.72:0/96497397 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f69f8017020 con 0x7f6a0015f000 2023-10-14T12:33:27.834 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:27.834 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T12:33:27.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f69ec06ae70 msgr2=0x7f69ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f69ec06ae70 0x7f69ec06d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a0009ce30 tx=0x7f69f0009040 comp rx=0 tx=0).stop 2023-10-14T12:33:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a0015f000 msgr2=0x7f6a001f1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a0015f000 0x7f6a001f1940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69f80014b0 tx=0x7f69f800cd50 comp rx=0 tx=0).stop 2023-10-14T12:33:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 shutdown_connections 2023-10-14T12:33:27.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f69ec06ae70 0x7f69ec06d330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a0015f000 0x7f6a001f1940 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a0006a820 0x7f6a000b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 --2- 172.21.15.72:0/96497397 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6a000ca7d0 0x7f6a001f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 >> 172.21.15.72:0/96497397 conn(0x7f6a000d0180 msgr2=0x7f6a0006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:27.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 shutdown_connections 2023-10-14T12:33:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.834+0000 7f6a05959700 1 -- 172.21.15.72:0/96497397 wait complete. 2023-10-14T12:33:27.838 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 3 2023-10-14T12:33:27.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:27.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.972+0000 7f9bd83bc700 1 Processor -- start 2023-10-14T12:33:27.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.972+0000 7f9bd83bc700 1 -- start start 2023-10-14T12:33:27.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.972+0000 7f9bd83bc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9bd0152470 0x7f9bd00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.972+0000 7f9bd83bc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd00cb8d0 0x7f9bd00b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd83bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd0070d70 con 0x7f9bd00b3240 2023-10-14T12:33:27.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd83bc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00b36d0 con 0x7f9bd0152470 2023-10-14T12:33:27.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd83bc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0071200 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd6959700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9bd00b3240 0x7f9bd00b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52380/0 (socket says 172.21.15.72:52380) 2023-10-14T12:33:27.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd6959700 1 -- 172.21.15.72:0/602834080 learned_addr learned my addr 172.21.15.72:0/602834080 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:27.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd6158700 1 --2- 172.21.15.72:0/602834080 >> v2:172.21.15.123:3300/0 conn(0x7f9bd0152470 0x7f9bd00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd5957700 1 --2- 172.21.15.72:0/602834080 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd00cb8d0 0x7f9bd00b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd5156700 1 -- 172.21.15.72:0/602834080 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112890463 0 0) 0x7f9bd0070d70 con 0x7f9bd00b3240 2023-10-14T12:33:27.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd5156700 1 -- 172.21.15.72:0/602834080 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bbc0035b0 con 0x7f9bd00b3240 2023-10-14T12:33:27.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd6158700 1 -- 172.21.15.72:0/602834080 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd00cb8d0 msgr2=0x7f9bd00b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:27.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd6158700 1 --2- 172.21.15.72:0/602834080 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd00cb8d0 0x7f9bd00b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd6158700 1 -- 172.21.15.72:0/602834080 >> v1:172.21.15.72:6789/0 conn(0x7f9bd00b3240 legacy=0x7f9bd00b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd6158700 1 -- 172.21.15.72:0/602834080 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd0070440 con 0x7f9bd0152470 2023-10-14T12:33:27.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd5957700 1 --2- 172.21.15.72:0/602834080 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd00cb8d0 0x7f9bd00b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:27.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd6158700 1 --2- 172.21.15.72:0/602834080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd0152470 0x7f9bd00cd570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009840 tx=0x7f9bc0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb5e728a1e09505 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:27.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd5156700 1 -- 172.21.15.72:0/602834080 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0011830 con 0x7f9bd0152470 2023-10-14T12:33:27.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd5156700 1 -- 172.21.15.72:0/602834080 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc0011990 con 0x7f9bd0152470 2023-10-14T12:33:27.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.973+0000 7f9bd5156700 1 -- 172.21.15.72:0/602834080 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0011d20 con 0x7f9bd0152470 2023-10-14T12:33:27.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.974+0000 7f9bd83bc700 1 -- 172.21.15.72:0/602834080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd0152470 msgr2=0x7f9bd00cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.974+0000 7f9bd83bc700 1 --2- 172.21.15.72:0/602834080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd0152470 0x7f9bd00cd570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009840 tx=0x7f9bc0009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:27.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.974+0000 7f9bd83bc700 1 -- 172.21.15.72:0/602834080 shutdown_connections 2023-10-14T12:33:27.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.974+0000 7f9bd83bc700 1 --2- 172.21.15.72:0/602834080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd0152470 0x7f9bd00cd570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.974+0000 7f9bd83bc700 1 --2- 172.21.15.72:0/602834080 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd00cb8d0 0x7f9bd00b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.974+0000 7f9bd83bc700 1 -- 172.21.15.72:0/602834080 >> 172.21.15.72:0/602834080 conn(0x7f9bd00cdd00 msgr2=0x7f9bd00ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:27.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.974+0000 7f9bd83bc700 1 -- 172.21.15.72:0/602834080 shutdown_connections 2023-10-14T12:33:27.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.974+0000 7f9bd83bc700 1 -- 172.21.15.72:0/602834080 wait complete. 2023-10-14T12:33:27.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.975+0000 7f9bd83bc700 1 Processor -- start 2023-10-14T12:33:27.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.975+0000 7f9bd83bc700 1 -- start start 2023-10-14T12:33:27.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd83bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd00b3240 0x7f9bd014a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd83bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd00cb8d0 0x7f9bd00c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd83bc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd0152470 0x7f9bd015d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd83bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c7d70 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd83bc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd01f44c0 con 0x7f9bd00b3240 2023-10-14T12:33:27.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd83bc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd01f47a0 con 0x7f9bd0152470 2023-10-14T12:33:27.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd5957700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd00cb8d0 0x7f9bd00c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd5957700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd00cb8d0 0x7f9bd00c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46084/0 (socket says 172.21.15.72:46084) 2023-10-14T12:33:27.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd5957700 1 -- 172.21.15.72:0/3634601515 learned_addr learned my addr 172.21.15.72:0/3634601515 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:27.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd6158700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd00b3240 0x7f9bd014a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd6959700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd0152470 0x7f9bd015d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd5957700 1 -- 172.21.15.72:0/3634601515 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd0152470 msgr2=0x7f9bd015d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd5957700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd0152470 0x7f9bd015d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd5957700 1 -- 172.21.15.72:0/3634601515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd00b3240 msgr2=0x7f9bd014a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd5957700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd00b3240 0x7f9bd014a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd5957700 1 -- 172.21.15.72:0/3634601515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc0094a0 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.976+0000 7f9bd6158700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd00b3240 0x7f9bd014a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.977+0000 7f9bd5957700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd00cb8d0 0x7f9bd00c95e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00ebe0 tx=0x7f9bcc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:27.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.977+0000 7f9bc6ffd700 1 -- 172.21.15.72:0/3634601515 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc00c850 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.977+0000 7f9bc6ffd700 1 -- 172.21.15.72:0/3634601515 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc00c9b0 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.977+0000 7f9bc6ffd700 1 -- 172.21.15.72:0/3634601515 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc00cd40 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.977+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc00094a0 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.977+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd01f4d60 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.978+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd004ebb0 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.978+0000 7f9bc6ffd700 1 -- 172.21.15.72:0/3634601515 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f9bcc013470 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.978+0000 7f9bc6ffd700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9bb406ae70 0x7f9bb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.979+0000 7f9bc6ffd700 1 -- 172.21.15.72:0/3634601515 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9bcc089590 con 0x7f9bd00cb8d0 2023-10-14T12:33:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.979+0000 7f9bd6158700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9bb406ae70 0x7f9bb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:27.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.979+0000 7f9bd6158700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9bb406ae70 0x7f9bb406d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009fd0 tx=0x7f9bc001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:27.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:27.983+0000 7f9bc6ffd700 1 -- 172.21.15.72:0/3634601515 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9bcc054a70 con 0x7f9bd00cb8d0 2023-10-14T12:33:28.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.178+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bd006f630 con 0x7f9bd00cb8d0 2023-10-14T12:33:28.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.223+0000 7f9bc6ffd700 1 -- 172.21.15.72:0/3634601515 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f9bcc00cea0 con 0x7f9bd00cb8d0 2023-10-14T12:33:28.225 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:28.225 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:27.781413+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:28.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9bb406ae70 msgr2=0x7f9bb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9bb406ae70 0x7f9bb406d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009fd0 tx=0x7f9bc001c040 comp rx=0 tx=0).stop 2023-10-14T12:33:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd00cb8d0 msgr2=0x7f9bd00c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd00cb8d0 0x7f9bd00c95e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00ebe0 tx=0x7f9bcc00eef0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 shutdown_connections 2023-10-14T12:33:28.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9bb406ae70 0x7f9bb406d330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9bd0152470 0x7f9bd015d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd00b3240 0x7f9bd014a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 --2- 172.21.15.72:0/3634601515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bd00cb8d0 0x7f9bd00c95e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 >> 172.21.15.72:0/3634601515 conn(0x7f9bd00cdd00 msgr2=0x7f9bd01512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:28.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 shutdown_connections 2023-10-14T12:33:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.226+0000 7f9bd83bc700 1 -- 172.21.15.72:0/3634601515 wait complete. 2023-10-14T12:33:28.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:33:28.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:33:28.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.363+0000 7fad05ab7700 1 Processor -- start 2023-10-14T12:33:28.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.363+0000 7fad05ab7700 1 -- start start 2023-10-14T12:33:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7fad05ab7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad0015b4e0 0x7fad0006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7fad05ab7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad000cd770 0x7fad000b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7fad05ab7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000b3670 con 0x7fad000b3220 2023-10-14T12:33:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7fad05ab7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad00070620 con 0x7fad0015b4e0 2023-10-14T12:33:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7fad05ab7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad00070900 con 0x7fad000cd770 2023-10-14T12:33:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7facff7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad0015b4e0 0x7fad0006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7facfffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fad000b3220 0x7fad000cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52402/0 (socket says 172.21.15.72:52402) 2023-10-14T12:33:28.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7facfffff700 1 -- 172.21.15.72:0/2182399531 learned_addr learned my addr 172.21.15.72:0/2182399531 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7facfeffd700 1 --2- 172.21.15.72:0/2182399531 >> v2:172.21.15.123:3300/0 conn(0x7fad000cd770 0x7fad000b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7facff7fe700 1 -- 172.21.15.72:0/2182399531 >> v2:172.21.15.123:3300/0 conn(0x7fad000cd770 msgr2=0x7fad000b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7facff7fe700 1 --2- 172.21.15.72:0/2182399531 >> v2:172.21.15.123:3300/0 conn(0x7fad000cd770 0x7fad000b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7facff7fe700 1 -- 172.21.15.72:0/2182399531 >> v1:172.21.15.72:6789/0 conn(0x7fad000b3220 legacy=0x7fad000cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7facff7fe700 1 -- 172.21.15.72:0/2182399531 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00070be0 con 0x7fad0015b4e0 2023-10-14T12:33:28.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.364+0000 7facfe7fc700 1 -- 172.21.15.72:0/2182399531 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270308235 0 0) 0x7facf8001490 con 0x7fad000b3220 2023-10-14T12:33:28.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7facff7fe700 1 --2- 172.21.15.72:0/2182399531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0015b4e0 0x7fad0006f280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad0006f7c0 tx=0x7facf4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2c2be7133ef7ae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:28.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7facfe7fc700 1 -- 172.21.15.72:0/2182399531 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4011830 con 0x7fad0015b4e0 2023-10-14T12:33:28.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7facfe7fc700 1 -- 172.21.15.72:0/2182399531 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf4011990 con 0x7fad0015b4e0 2023-10-14T12:33:28.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7facfe7fc700 1 -- 172.21.15.72:0/2182399531 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4011d20 con 0x7fad0015b4e0 2023-10-14T12:33:28.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7fad05ab7700 1 -- 172.21.15.72:0/2182399531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0015b4e0 msgr2=0x7fad0006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7fad05ab7700 1 --2- 172.21.15.72:0/2182399531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0015b4e0 0x7fad0006f280 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad0006f7c0 tx=0x7facf4009b20 comp rx=0 tx=0).stop 2023-10-14T12:33:28.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7fad05ab7700 1 -- 172.21.15.72:0/2182399531 shutdown_connections 2023-10-14T12:33:28.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7fad05ab7700 1 --2- 172.21.15.72:0/2182399531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad0015b4e0 0x7fad0006f280 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7fad05ab7700 1 --2- 172.21.15.72:0/2182399531 >> v2:172.21.15.123:3300/0 conn(0x7fad000cd770 0x7fad000b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7fad05ab7700 1 -- 172.21.15.72:0/2182399531 >> 172.21.15.72:0/2182399531 conn(0x7fad000cdce0 msgr2=0x7fad000ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:28.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7fad05ab7700 1 -- 172.21.15.72:0/2182399531 shutdown_connections 2023-10-14T12:33:28.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.365+0000 7fad05ab7700 1 -- 172.21.15.72:0/2182399531 wait complete. 2023-10-14T12:33:28.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.367+0000 7fad05ab7700 1 Processor -- start 2023-10-14T12:33:28.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.367+0000 7fad05ab7700 1 -- start start 2023-10-14T12:33:28.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7fad05ab7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000b3220 0x7fad001484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7fad05ab7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad000cd770 0x7fad000c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7fad05ab7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fad0015b4e0 0x7fad000c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7fad05ab7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad001e3bf0 con 0x7fad000cd770 2023-10-14T12:33:28.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7fad05ab7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad00148d00 con 0x7fad000b3220 2023-10-14T12:33:28.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7fad05ab7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad00148fe0 con 0x7fad0015b4e0 2023-10-14T12:33:28.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad000cd770 0x7fad000c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad000cd770 0x7fad000c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46108/0 (socket says 172.21.15.72:46108) 2023-10-14T12:33:28.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfeffd700 1 -- 172.21.15.72:0/431794320 learned_addr learned my addr 172.21.15.72:0/431794320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facff7fe700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000b3220 0x7fad001484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfffff700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fad0015b4e0 0x7fad000c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfeffd700 1 -- 172.21.15.72:0/431794320 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fad0015b4e0 msgr2=0x7fad000c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfeffd700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fad0015b4e0 0x7fad000c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfeffd700 1 -- 172.21.15.72:0/431794320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000b3220 msgr2=0x7fad001484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfeffd700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000b3220 0x7fad001484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfeffd700 1 -- 172.21.15.72:0/431794320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40094a0 con 0x7fad000cd770 2023-10-14T12:33:28.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7facfeffd700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad000cd770 0x7fad000c4160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7facf000e980 tx=0x7facf000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:28.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7face7fff700 1 -- 172.21.15.72:0/431794320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0009710 con 0x7fad000cd770 2023-10-14T12:33:28.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.368+0000 7face7fff700 1 -- 172.21.15.72:0/431794320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf000c690 con 0x7fad000cd770 2023-10-14T12:33:28.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.369+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad001492c0 con 0x7fad000cd770 2023-10-14T12:33:28.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.369+0000 7face7fff700 1 -- 172.21.15.72:0/431794320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000ca40 con 0x7fad000cd770 2023-10-14T12:33:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.369+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad00146720 con 0x7fad000cd770 2023-10-14T12:33:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.370+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad00146910 con 0x7fad000cd770 2023-10-14T12:33:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.370+0000 7face7fff700 1 -- 172.21.15.72:0/431794320 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7facf000cba0 con 0x7fad000cd770 2023-10-14T12:33:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.371+0000 7face7fff700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7facec06ae70 0x7facec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.371+0000 7face7fff700 1 -- 172.21.15.72:0/431794320 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7facf00891d0 con 0x7fad000cd770 2023-10-14T12:33:28.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.371+0000 7facff7fe700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7facec06ae70 0x7facec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.371+0000 7facff7fe700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7facec06ae70 0x7facec06d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7facf40090b0 tx=0x7facf401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:28.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.376+0000 7face7fff700 1 -- 172.21.15.72:0/431794320 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7facf00546b0 con 0x7fad000cd770 2023-10-14T12:33:28.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.567+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad0004ebb0 con 0x7fad000cd770 2023-10-14T12:33:28.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.567+0000 7face7fff700 1 -- 172.21.15.72:0/431794320 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7facf0057cd0 con 0x7fad000cd770 2023-10-14T12:33:28.569 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:33:28.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7facec06ae70 msgr2=0x7facec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7facec06ae70 0x7facec06d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7facf40090b0 tx=0x7facf401c040 comp rx=0 tx=0).stop 2023-10-14T12:33:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad000cd770 msgr2=0x7fad000c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad000cd770 0x7fad000c4160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7facf000e980 tx=0x7facf000ec90 comp rx=0 tx=0).stop 2023-10-14T12:33:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 shutdown_connections 2023-10-14T12:33:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7facec06ae70 0x7facec06d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fad0015b4e0 0x7fad000c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000b3220 0x7fad001484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 --2- 172.21.15.72:0/431794320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad000cd770 0x7fad000c4160 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.569+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 >> 172.21.15.72:0/431794320 conn(0x7fad000cdce0 msgr2=0x7fad000c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.570+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 shutdown_connections 2023-10-14T12:33:28.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.570+0000 7fad05ab7700 1 -- 172.21.15.72:0/431794320 wait complete. 2023-10-14T12:33:28.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T12:33:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.701+0000 7f364b06a700 1 Processor -- start 2023-10-14T12:33:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.701+0000 7f364b06a700 1 -- start start 2023-10-14T12:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.702+0000 7f364b06a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f364415daa0 0x7f36440af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.702+0000 7f364b06a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364415ed10 con 0x7f3644071f60 2023-10-14T12:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.702+0000 7f364b06a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364415de80 con 0x7f36440af560 2023-10-14T12:33:28.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.702+0000 7f364b06a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364415e100 con 0x7f364415daa0 2023-10-14T12:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.702+0000 7f3649607700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3644071f60 0x7f364406d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52416/0 (socket says 172.21.15.72:52416) 2023-10-14T12:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.702+0000 7f3649607700 1 -- 172.21.15.72:0/3928087942 learned_addr learned my addr 172.21.15.72:0/3928087942 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.702+0000 7f3648e06700 1 --2- 172.21.15.72:0/3928087942 >> v2:172.21.15.123:3300/0 conn(0x7f364415daa0 0x7f36440af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.702+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338581711 0 0) 0x7f364415ed10 con 0x7f3644071f60 2023-10-14T12:33:28.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.702+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36340035b0 con 0x7f3644071f60 2023-10-14T12:33:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2534060921 0 0) 0x7f36340035b0 con 0x7f3644071f60 2023-10-14T12:33:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 >> v2:172.21.15.123:3300/0 conn(0x7f364415daa0 msgr2=0x7f36440af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 --2- 172.21.15.72:0/3928087942 >> v2:172.21.15.123:3300/0 conn(0x7f364415daa0 0x7f36440af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 >> v1:172.21.15.123:6789/0 conn(0x7f36440af560 legacy=0x7f3644071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364415e3e0 con 0x7f3644071f60 2023-10-14T12:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f363c001a40 con 0x7f3644071f60 2023-10-14T12:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 >> v1:172.21.15.72:6789/0 conn(0x7f3644071f60 legacy=0x7f364406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3634003a00 0x7f3634003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3634004850 0x7f3634004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f363400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364415e100 con 0x7f3634005210 2023-10-14T12:33:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363400c0b0 con 0x7f3634004850 2023-10-14T12:33:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363400c270 con 0x7f3634003a00 2023-10-14T12:33:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3649607700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f363400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3648e06700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3634003a00 0x7f3634003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3643fff700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3634004850 0x7f3634004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3649607700 1 -- 172.21.15.72:0/3928087942 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3634003a00 msgr2=0x7f3634003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3649607700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3634003a00 0x7f3634003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3649607700 1 -- 172.21.15.72:0/3928087942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3634004850 msgr2=0x7f3634004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:28.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3649607700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3634004850 0x7f3634004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3649607700 1 -- 172.21.15.72:0/3928087942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340035b0 con 0x7f3634005210 2023-10-14T12:33:28.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3649607700 1 -- 172.21.15.72:0/3928087942 reap_dead start 2023-10-14T12:33:28.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f3649607700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f363400ba10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f363c00a7d0 tx=0x7f3634005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c44020ab8c7b1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:28.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c012600 con 0x7f3634005210 2023-10-14T12:33:28.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c012760 con 0x7f3634005210 2023-10-14T12:33:28.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.703+0000 7f36437fe700 1 -- 172.21.15.72:0/3928087942 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c012b10 con 0x7f3634005210 2023-10-14T12:33:28.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.704+0000 7f364b06a700 1 -- 172.21.15.72:0/3928087942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 msgr2=0x7f363400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.704+0000 7f364b06a700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f363400ba10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f363c00a7d0 tx=0x7f3634005880 comp rx=0 tx=0).stop 2023-10-14T12:33:28.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.704+0000 7f364b06a700 1 -- 172.21.15.72:0/3928087942 shutdown_connections 2023-10-14T12:33:28.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.704+0000 7f364b06a700 1 --2- 172.21.15.72:0/3928087942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f363400ba10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.704+0000 7f364b06a700 1 -- 172.21.15.72:0/3928087942 >> 172.21.15.72:0/3928087942 conn(0x7f36440d0180 msgr2=0x7f36440d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.704+0000 7f364b06a700 1 -- 172.21.15.72:0/3928087942 shutdown_connections 2023-10-14T12:33:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.704+0000 7f364b06a700 1 -- 172.21.15.72:0/3928087942 wait complete. 2023-10-14T12:33:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.705+0000 7f364b06a700 1 Processor -- start 2023-10-14T12:33:28.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.705+0000 7f364b06a700 1 -- start start 2023-10-14T12:33:28.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f364b06a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f36440c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f364b06a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f364415b7d0 0x7f364415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f364b06a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36440b0d10 0x7f36440b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f364b06a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36441f3dc0 con 0x7f3634005210 2023-10-14T12:33:28.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f364b06a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36440b1d20 con 0x7f36440b0d10 2023-10-14T12:33:28.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f364b06a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36440b1a40 con 0x7f364415b7d0 2023-10-14T12:33:28.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f3648e06700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f36440c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f3648e06700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f36440c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46126/0 (socket says 172.21.15.72:46126) 2023-10-14T12:33:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f3648e06700 1 -- 172.21.15.72:0/3680092151 learned_addr learned my addr 172.21.15.72:0/3680092151 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f3649607700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36440b0d10 0x7f36440b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.706+0000 7f3643fff700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f364415b7d0 0x7f364415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f3648e06700 1 -- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f364415b7d0 msgr2=0x7f364415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f3648e06700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f364415b7d0 0x7f364415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f3648e06700 1 -- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36440b0d10 msgr2=0x7f36440b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f3648e06700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36440b0d10 0x7f36440b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f3648e06700 1 -- 172.21.15.72:0/3680092151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36440c3d80 con 0x7f3634005210 2023-10-14T12:33:28.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f3649607700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36440b0d10 0x7f36440b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:28.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f3643fff700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f364415b7d0 0x7f364415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:28.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f3648e06700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f36440c5fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36380119a0 tx=0x7f3638011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:28.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f36417fa700 1 -- 172.21.15.72:0/3680092151 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363800f940 con 0x7f3634005210 2023-10-14T12:33:28.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f36417fa700 1 -- 172.21.15.72:0/3680092151 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363800faa0 con 0x7f3634005210 2023-10-14T12:33:28.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36440c4060 con 0x7f3634005210 2023-10-14T12:33:28.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f36417fa700 1 -- 172.21.15.72:0/3680092151 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363800fe30 con 0x7f3634005210 2023-10-14T12:33:28.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.707+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364415c190 con 0x7f3634005210 2023-10-14T12:33:28.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.708+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364404ebb0 con 0x7f3634005210 2023-10-14T12:33:28.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.708+0000 7f36417fa700 1 -- 172.21.15.72:0/3680092151 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f3638014440 con 0x7f3634005210 2023-10-14T12:33:28.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.709+0000 7f36417fa700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f362806ae70 0x7f362806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:28.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.709+0000 7f36417fa700 1 -- 172.21.15.72:0/3680092151 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f36380897f0 con 0x7f3634005210 2023-10-14T12:33:28.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.709+0000 7f3643fff700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f362806ae70 0x7f362806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:28.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.709+0000 7f3643fff700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f362806ae70 0x7f362806d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36440cbfc0 tx=0x7f3630009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:28.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.713+0000 7f36417fa700 1 -- 172.21.15.72:0/3680092151 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3638054d60 con 0x7f3634005210 2023-10-14T12:33:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.907+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f36440cb460 con 0x7f3634005210 2023-10-14T12:33:28.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.907+0000 7f36417fa700 1 -- 172.21.15.72:0/3680092151 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3638058380 con 0x7f3634005210 2023-10-14T12:33:28.909 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:28.910 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-10-14T12:33:28.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:33:28.910 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-10-14T12:33:28.910 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-10-14T12:33:28.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:33:28.911 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-10-14T12:33:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.909+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f362806ae70 msgr2=0x7f362806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.909+0000 7f364b06a700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f362806ae70 0x7f362806d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36440cbfc0 tx=0x7f3630009040 comp rx=0 tx=0).stop 2023-10-14T12:33:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.909+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 msgr2=0x7f36440c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.909+0000 7f364b06a700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f36440c5fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36380119a0 tx=0x7f3638011d60 comp rx=0 tx=0).stop 2023-10-14T12:33:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.909+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 shutdown_connections 2023-10-14T12:33:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.909+0000 7f364b06a700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f362806ae70 0x7f362806d330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.910+0000 7f364b06a700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36440b0d10 0x7f36440b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.910+0000 7f364b06a700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3634005210 0x7f36440c5fa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.910+0000 7f364b06a700 1 --2- 172.21.15.72:0/3680092151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f364415b7d0 0x7f364415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:28.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.910+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 >> 172.21.15.72:0/3680092151 conn(0x7f36440d0180 msgr2=0x7f36440adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.910+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 shutdown_connections 2023-10-14T12:33:28.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:28.910+0000 7f364b06a700 1 -- 172.21.15.72:0/3680092151 wait complete. 2023-10-14T12:33:28.923 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T12:33:28.923 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T12:33:29.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.045+0000 7f503318b700 1 Processor -- start 2023-10-14T12:33:29.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.045+0000 7f503318b700 1 -- start start 2023-10-14T12:33:29.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f503318b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c15b4e0 0x7f502c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f503318b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f502c0cd770 0x7f502c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f503318b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f502c0b3220 0x7f502c0cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f503318b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502c0b36b0 con 0x7f502c0b3220 2023-10-14T12:33:29.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f503318b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502c070620 con 0x7f502c0cd770 2023-10-14T12:33:29.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f503318b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c070900 con 0x7f502c15b4e0 2023-10-14T12:33:29.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5031728700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f502c0b3220 0x7f502c0cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5031728700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f502c0b3220 0x7f502c0cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46138/0 (socket says 172.21.15.72:46138) 2023-10-14T12:33:29.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5031728700 1 -- 172.21.15.72:0/2784016498 learned_addr learned my addr 172.21.15.72:0/2784016498 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:29.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f502bfff700 1 --2- 172.21.15.72:0/2784016498 >> v2:172.21.15.123:3300/0 conn(0x7f502c0cd770 0x7f502c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5030f27700 1 --2- 172.21.15.72:0/2784016498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c15b4e0 0x7f502c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5031728700 1 -- 172.21.15.72:0/2784016498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c15b4e0 msgr2=0x7f502c06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:29.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5031728700 1 --2- 172.21.15.72:0/2784016498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c15b4e0 0x7f502c06f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5031728700 1 -- 172.21.15.72:0/2784016498 >> v2:172.21.15.123:3300/0 conn(0x7f502c0cd770 msgr2=0x7f502c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:29.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5031728700 1 --2- 172.21.15.72:0/2784016498 >> v2:172.21.15.123:3300/0 conn(0x7f502c0cd770 0x7f502c0b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5031728700 1 -- 172.21.15.72:0/2784016498 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c070be0 con 0x7f502c0b3220 2023-10-14T12:33:29.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f502bfff700 1 --2- 172.21.15.72:0/2784016498 >> v2:172.21.15.123:3300/0 conn(0x7f502c0cd770 0x7f502c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:29.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.046+0000 7f5031728700 1 --2- 172.21.15.72:0/2784016498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0b3220 0x7f502c0cee30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f502c0d22c0 tx=0x7f502400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd452d525c65430 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:29.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f502b7fe700 1 -- 172.21.15.72:0/2784016498 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502400e070 con 0x7f502c0b3220 2023-10-14T12:33:29.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f502b7fe700 1 -- 172.21.15.72:0/2784016498 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502400b9c0 con 0x7f502c0b3220 2023-10-14T12:33:29.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f502b7fe700 1 -- 172.21.15.72:0/2784016498 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502400bd70 con 0x7f502c0b3220 2023-10-14T12:33:29.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f503318b700 1 -- 172.21.15.72:0/2784016498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0b3220 msgr2=0x7f502c0cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f503318b700 1 --2- 172.21.15.72:0/2784016498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0b3220 0x7f502c0cee30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f502c0d22c0 tx=0x7f502400b330 comp rx=0 tx=0).stop 2023-10-14T12:33:29.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f503318b700 1 -- 172.21.15.72:0/2784016498 shutdown_connections 2023-10-14T12:33:29.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f503318b700 1 --2- 172.21.15.72:0/2784016498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0b3220 0x7f502c0cee30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f503318b700 1 --2- 172.21.15.72:0/2784016498 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c15b4e0 0x7f502c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f503318b700 1 --2- 172.21.15.72:0/2784016498 >> v2:172.21.15.123:3300/0 conn(0x7f502c0cd770 0x7f502c0b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f503318b700 1 -- 172.21.15.72:0/2784016498 >> 172.21.15.72:0/2784016498 conn(0x7f502c0cdce0 msgr2=0x7f502c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:29.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f503318b700 1 -- 172.21.15.72:0/2784016498 shutdown_connections 2023-10-14T12:33:29.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.047+0000 7f503318b700 1 -- 172.21.15.72:0/2784016498 wait complete. 2023-10-14T12:33:29.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.048+0000 7f503318b700 1 Processor -- start 2023-10-14T12:33:29.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.048+0000 7f503318b700 1 -- start start 2023-10-14T12:33:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.049+0000 7f503318b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c0b3220 0x7f502c1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.049+0000 7f503318b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0cd770 0x7f502c1e2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.049+0000 7f503318b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f502c15b4e0 0x7f502c0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.049+0000 7f503318b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c1e21d0 con 0x7f502c0cd770 2023-10-14T12:33:29.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.049+0000 7f503318b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c1e15c0 con 0x7f502c15b4e0 2023-10-14T12:33:29.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.049+0000 7f503318b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c1e18a0 con 0x7f502c0b3220 2023-10-14T12:33:29.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.049+0000 7f502bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0cd770 0x7f502c1e2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.049+0000 7f502bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0cd770 0x7f502c1e2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46142/0 (socket says 172.21.15.72:46142) 2023-10-14T12:33:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.049+0000 7f502bfff700 1 -- 172.21.15.72:0/931892263 learned_addr learned my addr 172.21.15.72:0/931892263 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f5030f27700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c0b3220 0x7f502c1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f5031728700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f502c15b4e0 0x7f502c0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f502bfff700 1 -- 172.21.15.72:0/931892263 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c0b3220 msgr2=0x7f502c1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f502bfff700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c0b3220 0x7f502c1575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f502bfff700 1 -- 172.21.15.72:0/931892263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f502c15b4e0 msgr2=0x7f502c0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f502bfff700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f502c15b4e0 0x7f502c0c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f502bfff700 1 -- 172.21.15.72:0/931892263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5024009b30 con 0x7f502c0cd770 2023-10-14T12:33:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f502bfff700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0cd770 0x7f502c1e2660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f501800e810 tx=0x7f501800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f50297fa700 1 -- 172.21.15.72:0/931892263 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018013610 con 0x7f502c0cd770 2023-10-14T12:33:29.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f50297fa700 1 -- 172.21.15.72:0/931892263 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018013770 con 0x7f502c0cd770 2023-10-14T12:33:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502c1e1b80 con 0x7f502c0cd770 2023-10-14T12:33:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f50297fa700 1 -- 172.21.15.72:0/931892263 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018013b20 con 0x7f502c0cd770 2023-10-14T12:33:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.050+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502c1e2ba0 con 0x7f502c0cd770 2023-10-14T12:33:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.051+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502c1e2380 con 0x7f502c0cd770 2023-10-14T12:33:29.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.052+0000 7f50297fa700 1 -- 172.21.15.72:0/931892263 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f5018013c80 con 0x7f502c0cd770 2023-10-14T12:33:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.052+0000 7f50297fa700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f501006ae70 0x7f501006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.052+0000 7f50297fa700 1 -- 172.21.15.72:0/931892263 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5018088cb0 con 0x7f502c0cd770 2023-10-14T12:33:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.052+0000 7f5030f27700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f501006ae70 0x7f501006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.052+0000 7f5030f27700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f501006ae70 0x7f501006d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5020006b20 tx=0x7f5020008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:29.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.056+0000 7f50297fa700 1 -- 172.21.15.72:0/931892263 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f502c1e2380 con 0x7f502c0cd770 2023-10-14T12:33:29.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.246+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f502c04ebb0 con 0x7f502c0cd770 2023-10-14T12:33:29.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.795+0000 7f50297fa700 1 -- 172.21.15.72:0/931892263 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5018054190 con 0x7f502c0cd770 2023-10-14T12:33:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f501006ae70 msgr2=0x7f501006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f501006ae70 0x7f501006d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5020006b20 tx=0x7f5020008040 comp rx=0 tx=0).stop 2023-10-14T12:33:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0cd770 msgr2=0x7f502c1e2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0cd770 0x7f502c1e2660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f501800e810 tx=0x7f501800eb20 comp rx=0 tx=0).stop 2023-10-14T12:33:29.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 shutdown_connections 2023-10-14T12:33:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f501006ae70 0x7f501006d330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f502c15b4e0 0x7f502c0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f502c0b3220 0x7f502c1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 --2- 172.21.15.72:0/931892263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f502c0cd770 0x7f502c1e2660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 >> 172.21.15.72:0/931892263 conn(0x7f502c0cdce0 msgr2=0x7f502c0c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 shutdown_connections 2023-10-14T12:33:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.798+0000 7f503318b700 1 -- 172.21.15.72:0/931892263 wait complete. 2023-10-14T12:33:29.802 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-10-14T12:33:29.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-14T12:33:29.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.949+0000 7ff4da92d700 1 Processor -- start 2023-10-14T12:33:29.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.949+0000 7ff4da92d700 1 -- start start 2023-10-14T12:33:29.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4da92d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4d40ce440 0x7ff4d415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4da92d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d4161360 con 0x7ff4d406b370 2023-10-14T12:33:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4da92d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d406b750 con 0x7ff4d406a820 2023-10-14T12:33:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4da92d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d406dcc0 con 0x7ff4d40ce440 2023-10-14T12:33:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d8eca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4d40ce440 0x7ff4d415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d8eca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4d40ce440 0x7ff4d415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46150/0 (socket says 172.21.15.72:46150) 2023-10-14T12:33:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d8eca700 1 -- 172.21.15.72:0/3196426390 learned_addr learned my addr 172.21.15.72:0/3196426390 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff4d406b370 0x7ff4d406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52448/0 (socket says 172.21.15.72:52448) 2023-10-14T12:33:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d8eca700 1 -- 172.21.15.72:0/3196426390 >> v1:172.21.15.123:6789/0 conn(0x7ff4d406a820 legacy=0x7ff4d40cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d8eca700 1 -- 172.21.15.72:0/3196426390 >> v1:172.21.15.72:6789/0 conn(0x7ff4d406b370 legacy=0x7ff4d406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d8eca700 1 -- 172.21.15.72:0/3196426390 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d415e300 con 0x7ff4d40ce440 2023-10-14T12:33:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d2ffd700 1 -- 172.21.15.72:0/3196426390 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652961333 0 0) 0x7ff4d4161360 con 0x7ff4d406b370 2023-10-14T12:33:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d8eca700 1 --2- 172.21.15.72:0/3196426390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 0x7ff4d415dcb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009e80 tx=0x7ff4cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9169009ec70005 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d2ffd700 1 -- 172.21.15.72:0/3196426390 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00e070 con 0x7ff4d40ce440 2023-10-14T12:33:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d2ffd700 1 -- 172.21.15.72:0/3196426390 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc00b980 con 0x7ff4d40ce440 2023-10-14T12:33:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.950+0000 7ff4d2ffd700 1 -- 172.21.15.72:0/3196426390 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00bd30 con 0x7ff4d40ce440 2023-10-14T12:33:29.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.951+0000 7ff4da92d700 1 -- 172.21.15.72:0/3196426390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 msgr2=0x7ff4d415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.951+0000 7ff4da92d700 1 --2- 172.21.15.72:0/3196426390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 0x7ff4d415dcb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009e80 tx=0x7ff4cc00b330 comp rx=0 tx=0).stop 2023-10-14T12:33:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.951+0000 7ff4da92d700 1 -- 172.21.15.72:0/3196426390 shutdown_connections 2023-10-14T12:33:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.951+0000 7ff4da92d700 1 --2- 172.21.15.72:0/3196426390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 0x7ff4d415dcb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.951+0000 7ff4da92d700 1 -- 172.21.15.72:0/3196426390 >> 172.21.15.72:0/3196426390 conn(0x7ff4d40ccbe0 msgr2=0x7ff4d40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:29.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.951+0000 7ff4da92d700 1 -- 172.21.15.72:0/3196426390 shutdown_connections 2023-10-14T12:33:29.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.951+0000 7ff4da92d700 1 -- 172.21.15.72:0/3196426390 wait complete. 2023-10-14T12:33:29.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.952+0000 7ff4da92d700 1 Processor -- start 2023-10-14T12:33:29.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.952+0000 7ff4da92d700 1 -- start start 2023-10-14T12:33:29.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4da92d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d406a820 0x7ff4d415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4da92d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4d406b370 0x7ff4d4158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4da92d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 0x7ff4d40c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4da92d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4155f00 con 0x7ff4d40ce440 2023-10-14T12:33:29.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4da92d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40b3a50 con 0x7ff4d406a820 2023-10-14T12:33:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4da92d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40b2e40 con 0x7ff4d406b370 2023-10-14T12:33:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4d8eca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 0x7ff4d40c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4d8eca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 0x7ff4d40c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46156/0 (socket says 172.21.15.72:46156) 2023-10-14T12:33:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4d8eca700 1 -- 172.21.15.72:0/3720738151 learned_addr learned my addr 172.21.15.72:0/3720738151 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:29.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4d3fff700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d406a820 0x7ff4d415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4d37fe700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4d406b370 0x7ff4d4158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4d8eca700 1 -- 172.21.15.72:0/3720738151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4d406b370 msgr2=0x7ff4d4158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4d8eca700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4d406b370 0x7ff4d4158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4d8eca700 1 -- 172.21.15.72:0/3720738151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d406a820 msgr2=0x7ff4d415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:29.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.953+0000 7ff4d8eca700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d406a820 0x7ff4d415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:29.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.954+0000 7ff4d8eca700 1 -- 172.21.15.72:0/3720738151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc009b30 con 0x7ff4d40ce440 2023-10-14T12:33:29.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.954+0000 7ff4d37fe700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4d406b370 0x7ff4d4158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:29.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.954+0000 7ff4d8eca700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 0x7ff4d40c5590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc012000 tx=0x7ff4cc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:29.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.954+0000 7ff4d0ff9700 1 -- 172.21.15.72:0/3720738151 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc01c640 con 0x7ff4d40ce440 2023-10-14T12:33:29.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.954+0000 7ff4d0ff9700 1 -- 172.21.15.72:0/3720738151 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc01c7a0 con 0x7ff4d40ce440 2023-10-14T12:33:29.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.954+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d40b3120 con 0x7ff4d40ce440 2023-10-14T12:33:29.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.954+0000 7ff4d0ff9700 1 -- 172.21.15.72:0/3720738151 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc01cb50 con 0x7ff4d40ce440 2023-10-14T12:33:29.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.954+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d40b36e0 con 0x7ff4d40ce440 2023-10-14T12:33:29.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.955+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d4072d10 con 0x7ff4d40ce440 2023-10-14T12:33:29.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.955+0000 7ff4d0ff9700 1 -- 172.21.15.72:0/3720738151 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff4cc01ccb0 con 0x7ff4d40ce440 2023-10-14T12:33:29.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.956+0000 7ff4d0ff9700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff4c006af00 0x7ff4c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:29.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.956+0000 7ff4d3fff700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff4c006af00 0x7ff4c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:29.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.956+0000 7ff4d0ff9700 1 -- 172.21.15.72:0/3720738151 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff4cc08ad20 con 0x7ff4d40ce440 2023-10-14T12:33:29.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.956+0000 7ff4d3fff700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff4c006af00 0x7ff4c006d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8000f60 tx=0x7ff4c8007d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:29.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:29.960+0000 7ff4d0ff9700 1 -- 172.21.15.72:0/3720738151 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4cc056040 con 0x7ff4d40ce440 2023-10-14T12:33:30.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.150+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7ff4d40b3bc0 con 0x7ff4d40ce440 2023-10-14T12:33:30.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.804+0000 7ff4d0ff9700 1 -- 172.21.15.72:0/3720738151 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7ff4cc059660 con 0x7ff4d40ce440 2023-10-14T12:33:30.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff4c006af00 msgr2=0x7ff4c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:30.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff4c006af00 0x7ff4c006d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8000f60 tx=0x7ff4c8007d90 comp rx=0 tx=0).stop 2023-10-14T12:33:30.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 msgr2=0x7ff4d40c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:30.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 0x7ff4d40c5590 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc012000 tx=0x7ff4cc004ad0 comp rx=0 tx=0).stop 2023-10-14T12:33:30.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 shutdown_connections 2023-10-14T12:33:30.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff4c006af00 0x7ff4c006d3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:30.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40ce440 0x7ff4d40c5590 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:30.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d406a820 0x7ff4d415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:30.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 --2- 172.21.15.72:0/3720738151 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4d406b370 0x7ff4d4158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:30.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 >> 172.21.15.72:0/3720738151 conn(0x7ff4d40ccbe0 msgr2=0x7ff4d415d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:30.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 shutdown_connections 2023-10-14T12:33:30.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.807+0000 7ff4da92d700 1 -- 172.21.15.72:0/3720738151 wait complete. 2023-10-14T12:33:30.811 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-10-14T12:33:30.836 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T12:33:30.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.961+0000 7fda25db1700 1 Processor -- start 2023-10-14T12:33:30.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.962+0000 7fda25db1700 1 -- start start 2023-10-14T12:33:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.962+0000 7fda25db1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda2006b370 0x7fda2015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.962+0000 7fda25db1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda20161360 con 0x7fda2006a820 2023-10-14T12:33:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.962+0000 7fda25db1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2006b750 con 0x7fda200cdd30 2023-10-14T12:33:30.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.962+0000 7fda25db1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2006dcc0 con 0x7fda2006b370 2023-10-14T12:33:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.962+0000 7fda1effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda2006a820 0x7fda2006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52460/0 (socket says 172.21.15.72:52460) 2023-10-14T12:33:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.962+0000 7fda1effd700 1 -- 172.21.15.72:0/2925060684 learned_addr learned my addr 172.21.15.72:0/2925060684 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1f7fe700 1 --2- 172.21.15.72:0/2925060684 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda2006b370 0x7fda2015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1e7fc700 1 -- 172.21.15.72:0/2925060684 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080704459 0 0) 0x7fda20161360 con 0x7fda2006a820 2023-10-14T12:33:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1e7fc700 1 -- 172.21.15.72:0/2925060684 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda080035b0 con 0x7fda2006a820 2023-10-14T12:33:30.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1e7fc700 1 -- 172.21.15.72:0/2925060684 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641254069 0 0) 0x7fda2006b750 con 0x7fda200cdd30 2023-10-14T12:33:30.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1e7fc700 1 -- 172.21.15.72:0/2925060684 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda20161360 con 0x7fda200cdd30 2023-10-14T12:33:30.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1e7fc700 1 -- 172.21.15.72:0/2925060684 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 406469196 0 0) 0x7fda080035b0 con 0x7fda2006a820 2023-10-14T12:33:30.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1f7fe700 1 -- 172.21.15.72:0/2925060684 >> v1:172.21.15.123:6789/0 conn(0x7fda200cdd30 legacy=0x7fda201617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:30.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1f7fe700 1 -- 172.21.15.72:0/2925060684 >> v1:172.21.15.72:6789/0 conn(0x7fda2006a820 legacy=0x7fda2006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:30.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1f7fe700 1 -- 172.21.15.72:0/2925060684 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2015e300 con 0x7fda2006b370 2023-10-14T12:33:30.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1f7fe700 1 --2- 172.21.15.72:0/2925060684 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda2006b370 0x7fda2015dcb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fda14009870 tx=0x7fda14009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca1428fc3ad02c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:30.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1e7fc700 1 -- 172.21.15.72:0/2925060684 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10001670 con 0x7fda2006b370 2023-10-14T12:33:30.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1e7fc700 1 -- 172.21.15.72:0/2925060684 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda14004030 con 0x7fda2006b370 2023-10-14T12:33:30.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.963+0000 7fda1e7fc700 1 -- 172.21.15.72:0/2925060684 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140043a0 con 0x7fda2006b370 2023-10-14T12:33:30.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.964+0000 7fda25db1700 1 -- 172.21.15.72:0/2925060684 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda2006b370 msgr2=0x7fda2015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:30.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.964+0000 7fda25db1700 1 --2- 172.21.15.72:0/2925060684 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda2006b370 0x7fda2015dcb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fda14009870 tx=0x7fda14009b80 comp rx=0 tx=0).stop 2023-10-14T12:33:30.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.964+0000 7fda25db1700 1 -- 172.21.15.72:0/2925060684 shutdown_connections 2023-10-14T12:33:30.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.964+0000 7fda25db1700 1 --2- 172.21.15.72:0/2925060684 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda2006b370 0x7fda2015dcb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:30.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.964+0000 7fda25db1700 1 -- 172.21.15.72:0/2925060684 >> 172.21.15.72:0/2925060684 conn(0x7fda200ccbe0 msgr2=0x7fda200ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:30.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.964+0000 7fda25db1700 1 -- 172.21.15.72:0/2925060684 shutdown_connections 2023-10-14T12:33:30.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.964+0000 7fda25db1700 1 -- 172.21.15.72:0/2925060684 wait complete. 2023-10-14T12:33:30.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.965+0000 7fda25db1700 1 Processor -- start 2023-10-14T12:33:30.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.966+0000 7fda25db1700 1 -- start start 2023-10-14T12:33:30.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.966+0000 7fda25db1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda2006a820 0x7fda20149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:30.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.966+0000 7fda25db1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2006b370 0x7fda201f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:30.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda25db1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda200cdd30 0x7fda20145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:30.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda25db1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda201498a0 con 0x7fda2006b370 2023-10-14T12:33:30.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda25db1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c92b0 con 0x7fda2006a820 2023-10-14T12:33:30.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda25db1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c9590 con 0x7fda200cdd30 2023-10-14T12:33:30.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2006b370 0x7fda201f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:30.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2006b370 0x7fda201f37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46166/0 (socket says 172.21.15.72:46166) 2023-10-14T12:33:30.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1effd700 1 -- 172.21.15.72:0/4285023937 learned_addr learned my addr 172.21.15.72:0/4285023937 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:30.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1f7fe700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda2006a820 0x7fda20149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:30.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1ffff700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda200cdd30 0x7fda20145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:30.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1effd700 1 -- 172.21.15.72:0/4285023937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda200cdd30 msgr2=0x7fda20145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:30.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1effd700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda200cdd30 0x7fda20145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:30.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1effd700 1 -- 172.21.15.72:0/4285023937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda2006a820 msgr2=0x7fda20149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:30.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1effd700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda2006a820 0x7fda20149360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:30.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1effd700 1 -- 172.21.15.72:0/4285023937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140094a0 con 0x7fda2006b370 2023-10-14T12:33:30.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda1effd700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2006b370 0x7fda201f37f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c4d0 tx=0x7fda1000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:30.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda07fff700 1 -- 172.21.15.72:0/4285023937 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10004c80 con 0x7fda2006b370 2023-10-14T12:33:30.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda07fff700 1 -- 172.21.15.72:0/4285023937 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10004e00 con 0x7fda2006b370 2023-10-14T12:33:30.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda200c9870 con 0x7fda2006b370 2023-10-14T12:33:30.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda07fff700 1 -- 172.21.15.72:0/4285023937 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10007310 con 0x7fda2006b370 2023-10-14T12:33:30.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.967+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda200c9e30 con 0x7fda2006b370 2023-10-14T12:33:30.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.968+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda20072d10 con 0x7fda2006b370 2023-10-14T12:33:30.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.969+0000 7fda07fff700 1 -- 172.21.15.72:0/4285023937 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda10007470 con 0x7fda2006b370 2023-10-14T12:33:30.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.969+0000 7fda07fff700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fda0c06af00 0x7fda0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:30.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.969+0000 7fda07fff700 1 -- 172.21.15.72:0/4285023937 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fda10089390 con 0x7fda2006b370 2023-10-14T12:33:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.969+0000 7fda1f7fe700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fda0c06af00 0x7fda0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.969+0000 7fda1f7fe700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fda0c06af00 0x7fda0c06d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fda14000c00 tx=0x7fda14008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:30.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:30.974+0000 7fda07fff700 1 -- 172.21.15.72:0/4285023937 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda100544a0 con 0x7fda2006b370 2023-10-14T12:33:31.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.208+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fda200ca050 con 0x7fda2006b370 2023-10-14T12:33:31.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.816+0000 7fda07fff700 1 -- 172.21.15.72:0/4285023937 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fda10057ac0 con 0x7fda2006b370 2023-10-14T12:33:31.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.822+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fda0c06af00 msgr2=0x7fda0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:31.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.822+0000 7fda25db1700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fda0c06af00 0x7fda0c06d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fda14000c00 tx=0x7fda14008030 comp rx=0 tx=0).stop 2023-10-14T12:33:31.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.822+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2006b370 msgr2=0x7fda201f37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:31.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.822+0000 7fda25db1700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2006b370 0x7fda201f37f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c4d0 tx=0x7fda1000c890 comp rx=0 tx=0).stop 2023-10-14T12:33:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.823+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 shutdown_connections 2023-10-14T12:33:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.823+0000 7fda25db1700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fda0c06af00 0x7fda0c06d3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.823+0000 7fda25db1700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fda200cdd30 0x7fda20145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.823+0000 7fda25db1700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fda2006a820 0x7fda20149360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.823+0000 7fda25db1700 1 --2- 172.21.15.72:0/4285023937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda2006b370 0x7fda201f37f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.823+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 >> 172.21.15.72:0/4285023937 conn(0x7fda200ccbe0 msgr2=0x7fda201573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.823+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 shutdown_connections 2023-10-14T12:33:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.823+0000 7fda25db1700 1 -- 172.21.15.72:0/4285023937 wait complete. 2023-10-14T12:33:31.826 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T12:33:31.842 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-14T12:33:31.842 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-14T12:33:31.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.969+0000 7f6298c49700 1 Processor -- start 2023-10-14T12:33:31.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.969+0000 7f6298c49700 1 -- start start 2023-10-14T12:33:31.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.969+0000 7f6298c49700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f629415efd0 0x7f62941447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:31.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.969+0000 7f6298c49700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629415b920 con 0x7f6294066890 2023-10-14T12:33:31.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.969+0000 7f6298c49700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629406bfe0 con 0x7f62940cd5c0 2023-10-14T12:33:31.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.969+0000 7f6298c49700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629415fac0 con 0x7f629415efd0 2023-10-14T12:33:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f6291d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6294066890 0x7f629415f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52474/0 (socket says 172.21.15.72:52474) 2023-10-14T12:33:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f6291d9b700 1 -- 172.21.15.72:0/2894771706 learned_addr learned my addr 172.21.15.72:0/2894771706 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488772482 0 0) 0x7f629415b920 con 0x7f6294066890 2023-10-14T12:33:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f627c0035b0 con 0x7f6294066890 2023-10-14T12:33:31.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629259c700 1 --2- 172.21.15.72:0/2894771706 >> v2:172.21.15.123:3300/0 conn(0x7f629415efd0 0x7f62941447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1356050348 0 0) 0x7f627c0035b0 con 0x7f6294066890 2023-10-14T12:33:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 >> v2:172.21.15.123:3300/0 conn(0x7f629415efd0 msgr2=0x7f62941447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 --2- 172.21.15.72:0/2894771706 >> v2:172.21.15.123:3300/0 conn(0x7f629415efd0 0x7f62941447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 >> v1:172.21.15.123:6789/0 conn(0x7f62940cd5c0 legacy=0x7f62940cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:31.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629415fca0 con 0x7f6294066890 2023-10-14T12:33:31.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f6284001670 con 0x7f6294066890 2023-10-14T12:33:31.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 >> v1:172.21.15.72:6789/0 conn(0x7f6294066890 legacy=0x7f629415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:31.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f627c003a00 0x7f627c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:31.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f627c004850 0x7f627c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:31.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f627c005210 0x7f627c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:31.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629415fac0 con 0x7f627c005210 2023-10-14T12:33:31.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c00c160 con 0x7f627c004850 2023-10-14T12:33:31.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c00c320 con 0x7f627c003a00 2023-10-14T12:33:31.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f6291d9b700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f627c004850 0x7f627c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:31.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f6292d9d700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f627c005210 0x7f627c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:31.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f629259c700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f627c003a00 0x7f627c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:31.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f6292d9d700 1 -- 172.21.15.72:0/2894771706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f627c003a00 msgr2=0x7f627c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:31.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f6292d9d700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f627c003a00 0x7f627c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f6292d9d700 1 -- 172.21.15.72:0/2894771706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f627c004850 msgr2=0x7f627c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:31.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.970+0000 7f6292d9d700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f627c004850 0x7f627c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6292d9d700 1 -- 172.21.15.72:0/2894771706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0035b0 con 0x7f627c005210 2023-10-14T12:33:31.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6292d9d700 1 -- 172.21.15.72:0/2894771706 reap_dead start 2023-10-14T12:33:31.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6292d9d700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f627c005210 0x7f627c00ba10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c190 tx=0x7f627c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56097a62b85f6878 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:31.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c001db0 con 0x7f627c005210 2023-10-14T12:33:31.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c00ccf0 con 0x7f627c005210 2023-10-14T12:33:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f629159a700 1 -- 172.21.15.72:0/2894771706 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628c003c40 con 0x7f627c005210 2023-10-14T12:33:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6298c49700 1 -- 172.21.15.72:0/2894771706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f627c005210 msgr2=0x7f627c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6298c49700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f627c005210 0x7f627c00ba10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c190 tx=0x7f627c005880 comp rx=0 tx=0).stop 2023-10-14T12:33:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6298c49700 1 -- 172.21.15.72:0/2894771706 shutdown_connections 2023-10-14T12:33:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6298c49700 1 --2- 172.21.15.72:0/2894771706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f627c005210 0x7f627c00ba10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6298c49700 1 -- 172.21.15.72:0/2894771706 >> 172.21.15.72:0/2894771706 conn(0x7f62940b13e0 msgr2=0x7f62940b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6298c49700 1 -- 172.21.15.72:0/2894771706 shutdown_connections 2023-10-14T12:33:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.971+0000 7f6298c49700 1 -- 172.21.15.72:0/2894771706 wait complete. 2023-10-14T12:33:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.973+0000 7f6298c49700 1 Processor -- start 2023-10-14T12:33:31.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.973+0000 7f6298c49700 1 -- start start 2023-10-14T12:33:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6298c49700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f627c005210 0x7f62940adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6298c49700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62941f0980 0x7f62940c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6298c49700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62941f3fa0 0x7f62941f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6298c49700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62941f4990 con 0x7f62941f0980 2023-10-14T12:33:31.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6298c49700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62940ae1c0 con 0x7f627c005210 2023-10-14T12:33:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6298c49700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62940b25b0 con 0x7f62941f3fa0 2023-10-14T12:33:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6291d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62941f0980 0x7f62940c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6291d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62941f0980 0x7f62940c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46188/0 (socket says 172.21.15.72:46188) 2023-10-14T12:33:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6291d9b700 1 -- 172.21.15.72:0/4061625623 learned_addr learned my addr 172.21.15.72:0/4061625623 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:31.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6292d9d700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62941f3fa0 0x7f62941f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f629259c700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f627c005210 0x7f62940adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6291d9b700 1 -- 172.21.15.72:0/4061625623 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62941f3fa0 msgr2=0x7f62941f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6291d9b700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62941f3fa0 0x7f62941f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6291d9b700 1 -- 172.21.15.72:0/4061625623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f627c005210 msgr2=0x7f62940adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:31.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6291d9b700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f627c005210 0x7f62940adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6291d9b700 1 -- 172.21.15.72:0/4061625623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62940b2890 con 0x7f62941f0980 2023-10-14T12:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6291d9b700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62941f0980 0x7f62940c8710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f62840072c0 tx=0x7f62840075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6282ffd700 1 -- 172.21.15.72:0/4061625623 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62840014c0 con 0x7f62941f0980 2023-10-14T12:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6282ffd700 1 -- 172.21.15.72:0/4061625623 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628400f660 con 0x7f62941f0980 2023-10-14T12:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62940b2b70 con 0x7f62941f0980 2023-10-14T12:33:31.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6282ffd700 1 -- 172.21.15.72:0/4061625623 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400fa10 con 0x7f62941f0980 2023-10-14T12:33:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62940b3130 con 0x7f62941f0980 2023-10-14T12:33:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.975+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629404ebb0 con 0x7f62941f0980 2023-10-14T12:33:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.977+0000 7f6282ffd700 1 -- 172.21.15.72:0/4061625623 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f628400fb70 con 0x7f62941f0980 2023-10-14T12:33:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.977+0000 7f6282ffd700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f627406af00 0x7f627406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:31.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.977+0000 7f6282ffd700 1 -- 172.21.15.72:0/4061625623 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6284089490 con 0x7f62941f0980 2023-10-14T12:33:31.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.977+0000 7f629259c700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f627406af00 0x7f627406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:31.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.977+0000 7f629259c700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f627406af00 0x7f627406d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62940c9ea0 tx=0x7f6288008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:31.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:31.981+0000 7f6282ffd700 1 -- 172.21.15.72:0/4061625623 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62840545d0 con 0x7f62941f0980 2023-10-14T12:33:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.180+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f6294066670 con 0x7f62941f0980 2023-10-14T12:33:32.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.820+0000 7f6282ffd700 1 -- 172.21.15.72:0/4061625623 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f6284057bf0 con 0x7f62941f0980 2023-10-14T12:33:32.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f627406af00 msgr2=0x7f627406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:32.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f627406af00 0x7f627406d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62940c9ea0 tx=0x7f6288008040 comp rx=0 tx=0).stop 2023-10-14T12:33:32.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62941f0980 msgr2=0x7f62940c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:32.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62941f0980 0x7f62940c8710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f62840072c0 tx=0x7f62840075d0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 shutdown_connections 2023-10-14T12:33:32.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f627406af00 0x7f627406d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f62941f3fa0 0x7f62941f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f627c005210 0x7f62940adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 --2- 172.21.15.72:0/4061625623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62941f0980 0x7f62940c8710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 >> 172.21.15.72:0/4061625623 conn(0x7f62940b13e0 msgr2=0x7f629406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:32.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 shutdown_connections 2023-10-14T12:33:32.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.823+0000 7f6298c49700 1 -- 172.21.15.72:0/4061625623 wait complete. 2023-10-14T12:33:32.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T12:33:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.966+0000 7f70940b3700 1 Processor -- start 2023-10-14T12:33:32.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.966+0000 7f70940b3700 1 -- start start 2023-10-14T12:33:32.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.967+0000 7f70940b3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f708c06f470 0x7f708c0b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:32.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.967+0000 7f70940b3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708c070310 con 0x7f708c15b960 2023-10-14T12:33:32.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.967+0000 7f70940b3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708c070560 con 0x7f708c0d0aa0 2023-10-14T12:33:32.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.967+0000 7f70940b3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0cbf20 con 0x7f708c06f470 2023-10-14T12:33:32.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.967+0000 7f7092650700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f708c15b960 0x7f708c0b60c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52498/0 (socket says 172.21.15.72:52498) 2023-10-14T12:33:32.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.967+0000 7f7092650700 1 -- 172.21.15.72:0/4178156706 learned_addr learned my addr 172.21.15.72:0/4178156706 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:32.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f709164e700 1 --2- 172.21.15.72:0/4178156706 >> v2:172.21.15.123:3300/0 conn(0x7f708c06f470 0x7f708c0b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:32.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590670301 0 0) 0x7f708c070310 con 0x7f708c15b960 2023-10-14T12:33:32.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70780035b0 con 0x7f708c15b960 2023-10-14T12:33:32.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 786541725 0 0) 0x7f70780035b0 con 0x7f708c15b960 2023-10-14T12:33:32.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 >> v2:172.21.15.123:3300/0 conn(0x7f708c06f470 msgr2=0x7f708c0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:32.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 --2- 172.21.15.72:0/4178156706 >> v2:172.21.15.123:3300/0 conn(0x7f708c06f470 0x7f708c0b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 >> v1:172.21.15.123:6789/0 conn(0x7f708c0d0aa0 legacy=0x7f708c0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:32.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c070840 con 0x7f708c15b960 2023-10-14T12:33:32.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f70840019f0 con 0x7f708c15b960 2023-10-14T12:33:32.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 >> v1:172.21.15.72:6789/0 conn(0x7f708c15b960 legacy=0x7f708c0b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:32.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7078003a00 0x7f7078003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:32.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078004850 0x7f7078004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:32.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7078005210 0x7f707800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:32.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707800c080 con 0x7f7078005210 2023-10-14T12:33:32.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707800c1f0 con 0x7f7078003a00 2023-10-14T12:33:32.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707800c3b0 con 0x7f7078004850 2023-10-14T12:33:32.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7092650700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7078005210 0x7f707800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:32.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7091e4f700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7078003a00 0x7f7078003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:32.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f709164e700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078004850 0x7f7078004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:32.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7092650700 1 -- 172.21.15.72:0/4178156706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078004850 msgr2=0x7f7078004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:32.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7092650700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078004850 0x7f7078004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7092650700 1 -- 172.21.15.72:0/4178156706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7078003a00 msgr2=0x7f7078003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:32.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7092650700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7078003a00 0x7f7078003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7092650700 1 -- 172.21.15.72:0/4178156706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70780035b0 con 0x7f7078005210 2023-10-14T12:33:32.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f709164e700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078004850 0x7f7078004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:32.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.968+0000 7f7092650700 1 -- 172.21.15.72:0/4178156706 reap_dead start 2023-10-14T12:33:32.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f7092650700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7078005210 0x7f707800ba10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f708400a800 tx=0x7f7078005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89d1e3343e1dff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:32.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708400a2f0 con 0x7f7078005210 2023-10-14T12:33:32.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084012600 con 0x7f7078005210 2023-10-14T12:33:32.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f7090e4d700 1 -- 172.21.15.72:0/4178156706 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840129b0 con 0x7f7078005210 2023-10-14T12:33:32.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f70940b3700 1 -- 172.21.15.72:0/4178156706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7078005210 msgr2=0x7f707800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:32.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f70940b3700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7078005210 0x7f707800ba10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f708400a800 tx=0x7f7078005880 comp rx=0 tx=0).stop 2023-10-14T12:33:32.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f70940b3700 1 -- 172.21.15.72:0/4178156706 shutdown_connections 2023-10-14T12:33:32.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f70940b3700 1 --2- 172.21.15.72:0/4178156706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7078005210 0x7f707800ba10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f70940b3700 1 -- 172.21.15.72:0/4178156706 >> 172.21.15.72:0/4178156706 conn(0x7f708c0d1250 msgr2=0x7f708c0d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:32.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f70940b3700 1 -- 172.21.15.72:0/4178156706 shutdown_connections 2023-10-14T12:33:32.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.969+0000 7f70940b3700 1 -- 172.21.15.72:0/4178156706 wait complete. 2023-10-14T12:33:32.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.970+0000 7f70940b3700 1 Processor -- start 2023-10-14T12:33:32.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f70940b3700 1 -- start start 2023-10-14T12:33:32.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f70940b3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078005210 0x7f708c151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:32.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f70940b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708c1f1630 0x7f708c1f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:32.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f70940b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c1f4530 0x7f708c0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:32.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f70940b3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c1f11a0 con 0x7f708c1f4530 2023-10-14T12:33:32.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f70940b3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0ca520 con 0x7f708c1f1630 2023-10-14T12:33:32.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f70940b3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c1f4b60 con 0x7f7078005210 2023-10-14T12:33:32.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f7092650700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c1f4530 0x7f708c0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:32.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f7092650700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c1f4530 0x7f708c0b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46210/0 (socket says 172.21.15.72:46210) 2023-10-14T12:33:32.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f7092650700 1 -- 172.21.15.72:0/3713496303 learned_addr learned my addr 172.21.15.72:0/3713496303 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:32.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f709164e700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708c1f1630 0x7f708c1f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:32.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.971+0000 7f7091e4f700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078005210 0x7f708c151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:32.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f7092650700 1 -- 172.21.15.72:0/3713496303 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078005210 msgr2=0x7f708c151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:32.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f7092650700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078005210 0x7f708c151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f7092650700 1 -- 172.21.15.72:0/3713496303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708c1f1630 msgr2=0x7f708c1f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:32.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f7092650700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708c1f1630 0x7f708c1f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:32.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f7092650700 1 -- 172.21.15.72:0/3713496303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c1f4e40 con 0x7f708c1f4530 2023-10-14T12:33:32.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f7092650700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c1f4530 0x7f708c0b27c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f708c0713a0 tx=0x7f7084001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:32.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f70827fc700 1 -- 172.21.15.72:0/3713496303 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840017f0 con 0x7f708c1f4530 2023-10-14T12:33:32.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f70827fc700 1 -- 172.21.15.72:0/3713496303 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084001970 con 0x7f708c1f4530 2023-10-14T12:33:32.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f70827fc700 1 -- 172.21.15.72:0/3713496303 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708401d660 con 0x7f708c1f4530 2023-10-14T12:33:32.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c1f0b50 con 0x7f708c1f4530 2023-10-14T12:33:32.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.972+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c0b2d00 con 0x7f708c1f4530 2023-10-14T12:33:32.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.973+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c1f1a10 con 0x7f708c1f4530 2023-10-14T12:33:32.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.973+0000 7f70827fc700 1 -- 172.21.15.72:0/3713496303 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f708401d7c0 con 0x7f708c1f4530 2023-10-14T12:33:32.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.974+0000 7f70827fc700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f707006af00 0x7f707006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:32.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.974+0000 7f70827fc700 1 -- 172.21.15.72:0/3713496303 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f708408b610 con 0x7f708c1f4530 2023-10-14T12:33:32.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.974+0000 7f7091e4f700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f707006af00 0x7f707006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:32.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.974+0000 7f7091e4f700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f707006af00 0x7f707006d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f707c000c00 tx=0x7f707c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:32.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:32.978+0000 7f70827fc700 1 -- 172.21.15.72:0/3713496303 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7084056790 con 0x7f708c1f4530 2023-10-14T12:33:33.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:33.167+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f708c04ebb0 con 0x7f708c1f4530 2023-10-14T12:33:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.831+0000 7f70827fc700 1 -- 172.21.15.72:0/3713496303 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f7084059db0 con 0x7f708c1f4530 2023-10-14T12:33:34.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f707006af00 msgr2=0x7f707006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:34.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f707006af00 0x7f707006d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f707c000c00 tx=0x7f707c009040 comp rx=0 tx=0).stop 2023-10-14T12:33:34.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c1f4530 msgr2=0x7f708c0b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c1f4530 0x7f708c0b27c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f708c0713a0 tx=0x7f7084001d80 comp rx=0 tx=0).stop 2023-10-14T12:33:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 shutdown_connections 2023-10-14T12:33:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f707006af00 0x7f707006d3c0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f707c000c00 tx=0x7f707c009040 comp rx=0 tx=0).stop 2023-10-14T12:33:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f708c1f4530 0x7f708c0b27c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7078005210 0x7f708c151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 --2- 172.21.15.72:0/3713496303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708c1f1630 0x7f708c1f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.834+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 >> 172.21.15.72:0/3713496303 conn(0x7f708c0d1250 msgr2=0x7f708c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.835+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 shutdown_connections 2023-10-14T12:33:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.835+0000 7f70940b3700 1 -- 172.21.15.72:0/3713496303 wait complete. 2023-10-14T12:33:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' created 2023-10-14T12:33:34.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-14T12:33:34.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.985+0000 7f8f37bf5700 1 Processor -- start 2023-10-14T12:33:34.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.985+0000 7f8f37bf5700 1 -- start start 2023-10-14T12:33:34.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f37bf5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f3015b4e0 0x7f8f3006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:34.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f37bf5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f300cd770 0x7f8f300b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:34.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f37bf5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 0x7f8f300cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:34.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f37bf5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f300b3670 con 0x7f8f300cd770 2023-10-14T12:33:34.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f37bf5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f30070620 con 0x7f8f3015b4e0 2023-10-14T12:33:34.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f37bf5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f30070900 con 0x7f8f300b3220 2023-10-14T12:33:34.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35190700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f300cd770 0x7f8f300b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:34.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35190700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f300cd770 0x7f8f300b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46214/0 (socket says 172.21.15.72:46214) 2023-10-14T12:33:34.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35190700 1 -- 172.21.15.72:0/3977066728 learned_addr learned my addr 172.21.15.72:0/3977066728 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:34.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f36192700 1 --2- 172.21.15.72:0/3977066728 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 0x7f8f300cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:34.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35991700 1 --2- 172.21.15.72:0/3977066728 >> v2:172.21.15.123:3300/0 conn(0x7f8f3015b4e0 0x7f8f3006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:34.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35190700 1 -- 172.21.15.72:0/3977066728 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 msgr2=0x7f8f300cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:34.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35190700 1 --2- 172.21.15.72:0/3977066728 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 0x7f8f300cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35190700 1 -- 172.21.15.72:0/3977066728 >> v2:172.21.15.123:3300/0 conn(0x7f8f3015b4e0 msgr2=0x7f8f3006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:34.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35190700 1 --2- 172.21.15.72:0/3977066728 >> v2:172.21.15.123:3300/0 conn(0x7f8f3015b4e0 0x7f8f3006f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35190700 1 -- 172.21.15.72:0/3977066728 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30070be0 con 0x7f8f300cd770 2023-10-14T12:33:34.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f35190700 1 --2- 172.21.15.72:0/3977066728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 0x7f8f300b2ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8f300c4d60 tx=0x7f8f20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e7845ed5a9f138 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:34.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f3498f700 1 -- 172.21.15.72:0/3977066728 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2000b870 con 0x7f8f300cd770 2023-10-14T12:33:34.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f3498f700 1 -- 172.21.15.72:0/3977066728 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2000b9d0 con 0x7f8f300cd770 2023-10-14T12:33:34.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.986+0000 7f8f3498f700 1 -- 172.21.15.72:0/3977066728 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2000bd60 con 0x7f8f300cd770 2023-10-14T12:33:34.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.987+0000 7f8f37bf5700 1 -- 172.21.15.72:0/3977066728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 msgr2=0x7f8f300b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:34.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.987+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/3977066728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 0x7f8f300b2ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8f300c4d60 tx=0x7f8f20009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.987+0000 7f8f37bf5700 1 -- 172.21.15.72:0/3977066728 shutdown_connections 2023-10-14T12:33:34.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.987+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/3977066728 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 0x7f8f300cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.987+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/3977066728 >> v2:172.21.15.123:3300/0 conn(0x7f8f3015b4e0 0x7f8f3006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.987+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/3977066728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 0x7f8f300b2ce0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.987+0000 7f8f37bf5700 1 -- 172.21.15.72:0/3977066728 >> 172.21.15.72:0/3977066728 conn(0x7f8f300cdce0 msgr2=0x7f8f300ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:34.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.987+0000 7f8f37bf5700 1 -- 172.21.15.72:0/3977066728 shutdown_connections 2023-10-14T12:33:34.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.987+0000 7f8f37bf5700 1 -- 172.21.15.72:0/3977066728 wait complete. 2023-10-14T12:33:34.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.988+0000 7f8f37bf5700 1 Processor -- start 2023-10-14T12:33:34.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.988+0000 7f8f37bf5700 1 -- start start 2023-10-14T12:33:34.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f37bf5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 0x7f8f300a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:34.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f37bf5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 0x7f8f301f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:34.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f37bf5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f3015b4e0 0x7f8f300c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:34.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f37bf5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300ca180 con 0x7f8f300cd770 2023-10-14T12:33:34.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f37bf5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3014ae10 con 0x7f8f3015b4e0 2023-10-14T12:33:34.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f37bf5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300c9550 con 0x7f8f300b3220 2023-10-14T12:33:34.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35190700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 0x7f8f301f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:34.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35190700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 0x7f8f301f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46222/0 (socket says 172.21.15.72:46222) 2023-10-14T12:33:34.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35190700 1 -- 172.21.15.72:0/241268328 learned_addr learned my addr 172.21.15.72:0/241268328 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:34.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35991700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 0x7f8f300a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:34.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f36192700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f3015b4e0 0x7f8f300c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:34.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35190700 1 -- 172.21.15.72:0/241268328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 msgr2=0x7f8f300a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:34.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35190700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 0x7f8f300a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:34.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35190700 1 -- 172.21.15.72:0/241268328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f3015b4e0 msgr2=0x7f8f300c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:35.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35190700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f3015b4e0 0x7f8f300c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:35.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35190700 1 -- 172.21.15.72:0/241268328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20009550 con 0x7f8f300cd770 2023-10-14T12:33:35.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f36192700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f3015b4e0 0x7f8f300c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:35.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.989+0000 7f8f35190700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 0x7f8f301f0c00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009c10 tx=0x7f8f20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:35.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.990+0000 7f8f267fc700 1 -- 172.21.15.72:0/241268328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f20004250 con 0x7f8f300cd770 2023-10-14T12:33:35.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.990+0000 7f8f267fc700 1 -- 172.21.15.72:0/241268328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2001f070 con 0x7f8f300cd770 2023-10-14T12:33:35.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.990+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f300c9890 con 0x7f8f300cd770 2023-10-14T12:33:35.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.990+0000 7f8f267fc700 1 -- 172.21.15.72:0/241268328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f200045d0 con 0x7f8f300cd770 2023-10-14T12:33:35.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.990+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f300c9280 con 0x7f8f300cd770 2023-10-14T12:33:35.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.991+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f300ca330 con 0x7f8f300cd770 2023-10-14T12:33:35.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.991+0000 7f8f267fc700 1 -- 172.21.15.72:0/241268328 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f20021030 con 0x7f8f300cd770 2023-10-14T12:33:35.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.992+0000 7f8f267fc700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8f1406af00 0x7f8f1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:35.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.992+0000 7f8f267fc700 1 -- 172.21.15.72:0/241268328 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f8f2008ad60 con 0x7f8f300cd770 2023-10-14T12:33:35.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.992+0000 7f8f35991700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8f1406af00 0x7f8f1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:35.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.992+0000 7f8f35991700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8f1406af00 0x7f8f1406d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c006b20 tx=0x7f8f2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:35.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:34.996+0000 7f8f267fc700 1 -- 172.21.15.72:0/241268328 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f20055cb0 con 0x7f8f300cd770 2023-10-14T12:33:35.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.183+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f8f3004ebb0 con 0x7f8f300cd770 2023-10-14T12:33:35.783 INFO:tasks.ceph.mds.d.smithi123.stderr:2023-10-14T12:33:35.782+0000 7f2261737700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T12:33:35.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.835+0000 7f8f267fc700 1 -- 172.21.15.72:0/241268328 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8f200150c0 con 0x7f8f300cd770 2023-10-14T12:33:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.837+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8f1406af00 msgr2=0x7f8f1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.837+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8f1406af00 0x7f8f1406d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c006b20 tx=0x7f8f2c008040 comp rx=0 tx=0).stop 2023-10-14T12:33:35.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.838+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 msgr2=0x7f8f301f0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.838+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 0x7f8f301f0c00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009c10 tx=0x7f8f20004750 comp rx=0 tx=0).stop 2023-10-14T12:33:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.838+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 shutdown_connections 2023-10-14T12:33:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.838+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8f1406af00 0x7f8f1406d3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.838+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f3015b4e0 0x7f8f300c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:35.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.838+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8f300b3220 0x7f8f300a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:35.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.838+0000 7f8f37bf5700 1 --2- 172.21.15.72:0/241268328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f300cd770 0x7f8f301f0c00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:35.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.838+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 >> 172.21.15.72:0/241268328 conn(0x7f8f300cdce0 msgr2=0x7f8f30157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:35.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.838+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 shutdown_connections 2023-10-14T12:33:35.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.839+0000 7f8f37bf5700 1 -- 172.21.15.72:0/241268328 wait complete. 2023-10-14T12:33:35.841 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 4 allow_ec_overwrites to true 2023-10-14T12:33:35.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-14T12:33:35.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.995+0000 7f66b759e700 1 Processor -- start 2023-10-14T12:33:35.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.995+0000 7f66b759e700 1 -- start start 2023-10-14T12:33:36.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.996+0000 7f66b759e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66b815b330 0x7f66b815c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.996+0000 7f66b759e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b815b710 0x7f66b80cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.996+0000 7f66b759e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b80cb5f0 con 0x7f66b80cb090 2023-10-14T12:33:36.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.996+0000 7f66b759e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b815bc70 con 0x7f66b815b330 2023-10-14T12:33:36.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.996+0000 7f66b759e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b815bf50 con 0x7f66b815b710 2023-10-14T12:33:36.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.996+0000 7f66b6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f66b80cb090 0x7f66b806b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52530/0 (socket says 172.21.15.72:52530) 2023-10-14T12:33:36.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.996+0000 7f66b6d9d700 1 -- 172.21.15.72:0/2745529366 learned_addr learned my addr 172.21.15.72:0/2745529366 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:36.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b5d9b700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b815b710 0x7f66b80cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b659c700 1 --2- 172.21.15.72:0/2745529366 >> v2:172.21.15.123:3300/0 conn(0x7f66b815b330 0x7f66b815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545515575 0 0) 0x7f66b80cb5f0 con 0x7f66b80cb090 2023-10-14T12:33:36.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a00035b0 con 0x7f66b80cb090 2023-10-14T12:33:36.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595813789 0 0) 0x7f66a00035b0 con 0x7f66b80cb090 2023-10-14T12:33:36.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b815b710 msgr2=0x7f66b80cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:36.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b815b710 0x7f66b80cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 >> v2:172.21.15.123:3300/0 conn(0x7f66b815b330 msgr2=0x7f66b815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:36.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 --2- 172.21.15.72:0/2745529366 >> v2:172.21.15.123:3300/0 conn(0x7f66b815b330 0x7f66b815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b815c230 con 0x7f66b80cb090 2023-10-14T12:33:36.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f66b00019f0 con 0x7f66b80cb090 2023-10-14T12:33:36.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 >> v1:172.21.15.72:6789/0 conn(0x7f66b80cb090 legacy=0x7f66b806b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a0003a00 0x7f66a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b815b710 0x7f66a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a0004d90 0x7f66a0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b815bc70 con 0x7f66a0003a00 2023-10-14T12:33:36.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b815bf50 con 0x7f66a0004d90 2023-10-14T12:33:36.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a000ba40 con 0x7f66b815b710 2023-10-14T12:33:36.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b659c700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a0003a00 0x7f66a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b5d9b700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b815b710 0x7f66a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b6d9d700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a0004d90 0x7f66a0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b659c700 1 -- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b815b710 msgr2=0x7f66a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b659c700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b815b710 0x7f66a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b659c700 1 -- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a0004d90 msgr2=0x7f66a0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b659c700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66a0004d90 0x7f66a0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.997+0000 7f66b659c700 1 -- 172.21.15.72:0/2745529366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a00035b0 con 0x7f66a0003a00 2023-10-14T12:33:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b659c700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a0003a00 0x7f66a0003e20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009b60 tx=0x7f66a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f67160df44e670 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac00e6c0 con 0x7f66a0003a00 2023-10-14T12:33:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac00e820 con 0x7f66a0003a00 2023-10-14T12:33:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b559a700 1 -- 172.21.15.72:0/2745529366 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac00eb90 con 0x7f66a0003a00 2023-10-14T12:33:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b759e700 1 -- 172.21.15.72:0/2745529366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a0003a00 msgr2=0x7f66a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b759e700 1 --2- 172.21.15.72:0/2745529366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66a0003a00 0x7f66a0003e20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009b60 tx=0x7f66a0005880 comp rx=0 tx=0).stop 2023-10-14T12:33:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b6d9d700 1 -- 172.21.15.72:0/2745529366 reap_dead start 2023-10-14T12:33:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b759e700 1 -- 172.21.15.72:0/2745529366 shutdown_connections 2023-10-14T12:33:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b759e700 1 -- 172.21.15.72:0/2745529366 >> 172.21.15.72:0/2745529366 conn(0x7f66b8070f30 msgr2=0x7f66b8071340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b759e700 1 -- 172.21.15.72:0/2745529366 shutdown_connections 2023-10-14T12:33:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:35.998+0000 7f66b759e700 1 -- 172.21.15.72:0/2745529366 wait complete. 2023-10-14T12:33:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b759e700 1 Processor -- start 2023-10-14T12:33:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b759e700 1 -- start start 2023-10-14T12:33:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b759e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0003a00 0x7f66b8146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b759e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b814bdf0 0x7f66b80b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b80c6a00 0x7f66b80c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b759e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b80b5190 con 0x7f66b80c6a00 2023-10-14T12:33:36.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b759e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b814c270 con 0x7f66b814bdf0 2023-10-14T12:33:36.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b759e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b80c73c0 con 0x7f66a0003a00 2023-10-14T12:33:36.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b80c6a00 0x7f66b80c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b80c6a00 0x7f66b80c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46242/0 (socket says 172.21.15.72:46242) 2023-10-14T12:33:36.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b6d9d700 1 -- 172.21.15.72:0/1891281901 learned_addr learned my addr 172.21.15.72:0/1891281901 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:36.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b5d9b700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b814bdf0 0x7f66b80b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.000+0000 7f66b659c700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0003a00 0x7f66b8146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66b6d9d700 1 -- 172.21.15.72:0/1891281901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0003a00 msgr2=0x7f66b8146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66b6d9d700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0003a00 0x7f66b8146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66b6d9d700 1 -- 172.21.15.72:0/1891281901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b814bdf0 msgr2=0x7f66b80b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66b6d9d700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b814bdf0 0x7f66b80b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66b6d9d700 1 -- 172.21.15.72:0/1891281901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b8147150 con 0x7f66b80c6a00 2023-10-14T12:33:36.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66b6d9d700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b80c6a00 0x7f66b80c6e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f66b806ef40 tx=0x7f66b000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66a6ffd700 1 -- 172.21.15.72:0/1891281901 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b00019e0 con 0x7f66b80c6a00 2023-10-14T12:33:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66a6ffd700 1 -- 172.21.15.72:0/1891281901 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b000adb0 con 0x7f66b80c6a00 2023-10-14T12:33:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b8147430 con 0x7f66b80c6a00 2023-10-14T12:33:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66a6ffd700 1 -- 172.21.15.72:0/1891281901 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0013650 con 0x7f66b80c6a00 2023-10-14T12:33:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.001+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b81479f0 con 0x7f66b80c6a00 2023-10-14T12:33:36.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.002+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b80743d0 con 0x7f66b80c6a00 2023-10-14T12:33:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.002+0000 7f66a6ffd700 1 -- 172.21.15.72:0/1891281901 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f66b00137b0 con 0x7f66b80c6a00 2023-10-14T12:33:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.003+0000 7f66a6ffd700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 0x7f669806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.003+0000 7f66b659c700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 0x7f669806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.003+0000 7f66a6ffd700 1 -- 172.21.15.72:0/1891281901 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f66b008a0c0 con 0x7f66b80c6a00 2023-10-14T12:33:36.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.003+0000 7f66b659c700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 0x7f669806d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0090b0 tx=0x7f66ac01f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:36.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.007+0000 7f66a6ffd700 1 -- 172.21.15.72:0/1891281901 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66b0054e00 con 0x7f66b80c6a00 2023-10-14T12:33:36.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.243+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f66b804ebb0 con 0x7f66b80c6a00 2023-10-14T12:33:36.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.836+0000 7f66a6ffd700 1 -- 172.21.15.72:0/1891281901 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f66b0001f00 con 0x7f66b80c6a00 2023-10-14T12:33:36.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 msgr2=0x7f669806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 0x7f669806d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0090b0 tx=0x7f66ac01f040 comp rx=0 tx=0).stop 2023-10-14T12:33:36.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b80c6a00 msgr2=0x7f66b80c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b80c6a00 0x7f66b80c6e80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f66b806ef40 tx=0x7f66b000a640 comp rx=0 tx=0).stop 2023-10-14T12:33:36.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 shutdown_connections 2023-10-14T12:33:36.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 0x7f669806d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b80c6a00 0x7f66b80c6e80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66a0003a00 0x7f66b8146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 --2- 172.21.15.72:0/1891281901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b814bdf0 0x7f66b80b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 >> 172.21.15.72:0/1891281901 conn(0x7f66b8070f30 msgr2=0x7f66b80afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:36.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 shutdown_connections 2023-10-14T12:33:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.840+0000 7f66b759e700 1 -- 172.21.15.72:0/1891281901 wait complete. 2023-10-14T12:33:36.843 INFO:teuthology.orchestra.run.smithi072.stderr:added data pool 4 to fsmap 2023-10-14T12:33:36.854 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:33:36.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:33:36.918 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:33:36.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.978+0000 7f085d5bb700 1 Processor -- start 2023-10-14T12:33:36.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.978+0000 7f085d5bb700 1 -- start start 2023-10-14T12:33:36.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f085d5bb700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0858157d30 0x7f08580d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f085d5bb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 0x7f08580cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f085d5bb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085806c350 con 0x7f085815e870 2023-10-14T12:33:36.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f085d5bb700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085815edd0 con 0x7f0858157d30 2023-10-14T12:33:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f085d5bb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0858158110 con 0x7f08580cf580 2023-10-14T12:33:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f0856ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0858157d30 0x7f08580d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f08577fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 0x7f08580cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f08567fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f085815e870 0x7f08580cee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:50746/0 (socket says 172.21.15.72:50746) 2023-10-14T12:33:36.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f08567fc700 1 -- 172.21.15.72:0/2591821544 learned_addr learned my addr 172.21.15.72:0/2591821544 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:36.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f08577fe700 1 -- 172.21.15.72:0/2591821544 >> v2:172.21.15.123:3300/0 conn(0x7f0858157d30 msgr2=0x7f08580d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:36.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f08577fe700 1 --2- 172.21.15.72:0/2591821544 >> v2:172.21.15.123:3300/0 conn(0x7f0858157d30 0x7f08580d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f08577fe700 1 -- 172.21.15.72:0/2591821544 >> v1:172.21.15.123:6789/0 conn(0x7f085815e870 legacy=0x7f08580cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f08577fe700 1 -- 172.21.15.72:0/2591821544 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580d20c0 con 0x7f08580cf580 2023-10-14T12:33:36.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.979+0000 7f0856ffd700 1 --2- 172.21.15.72:0/2591821544 >> v2:172.21.15.123:3300/0 conn(0x7f0858157d30 0x7f08580d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:36.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f08577fe700 1 --2- 172.21.15.72:0/2591821544 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 0x7f08580cd910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0850009d90 tx=0x7f085000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1218872cc8436e39 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:36.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f0855ffb700 1 -- 172.21.15.72:0/2591821544 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085000e070 con 0x7f08580cf580 2023-10-14T12:33:36.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f0855ffb700 1 -- 172.21.15.72:0/2591821544 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085000bb20 con 0x7f08580cf580 2023-10-14T12:33:36.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f0855ffb700 1 -- 172.21.15.72:0/2591821544 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850012430 con 0x7f08580cf580 2023-10-14T12:33:36.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f085d5bb700 1 -- 172.21.15.72:0/2591821544 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 msgr2=0x7f08580cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f085d5bb700 1 --2- 172.21.15.72:0/2591821544 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 0x7f08580cd910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0850009d90 tx=0x7f085000b330 comp rx=0 tx=0).stop 2023-10-14T12:33:36.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f085d5bb700 1 -- 172.21.15.72:0/2591821544 shutdown_connections 2023-10-14T12:33:36.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f085d5bb700 1 --2- 172.21.15.72:0/2591821544 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 0x7f08580cd910 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f085d5bb700 1 --2- 172.21.15.72:0/2591821544 >> v2:172.21.15.123:3300/0 conn(0x7f0858157d30 0x7f08580d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f085d5bb700 1 -- 172.21.15.72:0/2591821544 >> 172.21.15.72:0/2591821544 conn(0x7f085806a820 msgr2=0x7f085806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:36.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f085d5bb700 1 -- 172.21.15.72:0/2591821544 shutdown_connections 2023-10-14T12:33:36.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.980+0000 7f085d5bb700 1 -- 172.21.15.72:0/2591821544 wait complete. 2023-10-14T12:33:36.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.982+0000 7f085d5bb700 1 Processor -- start 2023-10-14T12:33:36.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.982+0000 7f085d5bb700 1 -- start start 2023-10-14T12:33:36.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.982+0000 7f085d5bb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 0x7f08580cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.982+0000 7f085d5bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0858157d30 0x7f08581f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.982+0000 7f085d5bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085815e870 0x7f08581f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.982+0000 7f085d5bb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08581f7340 con 0x7f085815e870 2023-10-14T12:33:36.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.982+0000 7f085d5bb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08581576f0 con 0x7f0858157d30 2023-10-14T12:33:36.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.982+0000 7f085d5bb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580c9bf0 con 0x7f08580cf580 2023-10-14T12:33:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085815e870 0x7f08581f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085815e870 0x7f08581f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46256/0 (socket says 172.21.15.72:46256) 2023-10-14T12:33:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08577fe700 1 -- 172.21.15.72:0/1153008099 learned_addr learned my addr 172.21.15.72:0/1153008099 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f0856ffd700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 0x7f08580cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08567fc700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0858157d30 0x7f08581f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08577fe700 1 -- 172.21.15.72:0/1153008099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 msgr2=0x7f08580cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08577fe700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 0x7f08580cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08577fe700 1 -- 172.21.15.72:0/1153008099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0858157d30 msgr2=0x7f08581f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08577fe700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0858157d30 0x7f08581f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08577fe700 1 -- 172.21.15.72:0/1153008099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480094a0 con 0x7f085815e870 2023-10-14T12:33:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f08577fe700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085815e870 0x7f08581f5c30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0850013000 tx=0x7f0850004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f084f7fe700 1 -- 172.21.15.72:0/1153008099 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850012430 con 0x7f085815e870 2023-10-14T12:33:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f084f7fe700 1 -- 172.21.15.72:0/1153008099 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850020070 con 0x7f085815e870 2023-10-14T12:33:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f084f7fe700 1 -- 172.21.15.72:0/1153008099 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850004280 con 0x7f085815e870 2023-10-14T12:33:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0850009a70 con 0x7f085815e870 2023-10-14T12:33:36.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.983+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08580ce200 con 0x7f085815e870 2023-10-14T12:33:36.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.984+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085804ebb0 con 0x7f085815e870 2023-10-14T12:33:36.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.985+0000 7f084f7fe700 1 -- 172.21.15.72:0/1153008099 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f08500043e0 con 0x7f085815e870 2023-10-14T12:33:36.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.985+0000 7f084f7fe700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f083806af00 0x7f083806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:36.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.985+0000 7f0856ffd700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f083806af00 0x7f083806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.985+0000 7f084f7fe700 1 -- 172.21.15.72:0/1153008099 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0850022070 con 0x7f085815e870 2023-10-14T12:33:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.985+0000 7f0856ffd700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f083806af00 0x7f083806d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0848009cd0 tx=0x7f0848009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:36.989+0000 7f084f7fe700 1 -- 172.21.15.72:0/1153008099 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0850056270 con 0x7f085815e870 2023-10-14T12:33:37.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.219+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08580b36e0 con 0x7f085815e870 2023-10-14T12:33:37.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.220+0000 7f084f7fe700 1 -- 172.21.15.72:0/1153008099 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f0850059890 con 0x7f085815e870 2023-10-14T12:33:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:37.221 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:36.244416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-14T12:33:37.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f083806af00 msgr2=0x7f083806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f083806af00 0x7f083806d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0848009cd0 tx=0x7f0848009210 comp rx=0 tx=0).stop 2023-10-14T12:33:37.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085815e870 msgr2=0x7f08581f5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085815e870 0x7f08581f5c30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0850013000 tx=0x7f0850004ad0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 shutdown_connections 2023-10-14T12:33:37.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f083806af00 0x7f083806d3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f085815e870 0x7f08581f5c30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f08580cf580 0x7f08580cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 --2- 172.21.15.72:0/1153008099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0858157d30 0x7f08581f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 >> 172.21.15.72:0/1153008099 conn(0x7f085806a820 msgr2=0x7f0858160920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:37.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 shutdown_connections 2023-10-14T12:33:37.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.222+0000 7f085d5bb700 1 -- 172.21.15.72:0/1153008099 wait complete. 2023-10-14T12:33:37.225 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-10-14T12:33:37.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:37.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.394+0000 7f0d8f5a3700 1 Processor -- start 2023-10-14T12:33:37.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.394+0000 7f0d8f5a3700 1 -- start start 2023-10-14T12:33:37.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.395+0000 7f0d8f5a3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0d880b3810 0x7f0d880b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.395+0000 7f0d8f5a3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d880af160 0x7f0d880cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.395+0000 7f0d8f5a3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8806c190 con 0x7f0d880cef90 2023-10-14T12:33:37.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.395+0000 7f0d8f5a3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d880b5a10 con 0x7f0d880af160 2023-10-14T12:33:37.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.395+0000 7f0d8f5a3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8806bbd0 con 0x7f0d880b3810 2023-10-14T12:33:37.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.395+0000 7f0d8cb3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d880af160 0x7f0d880cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:37.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.395+0000 7f0d8cb3e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d880af160 0x7f0d880cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46264/0 (socket says 172.21.15.72:46264) 2023-10-14T12:33:37.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.395+0000 7f0d8cb3e700 1 -- 172.21.15.72:0/87894767 learned_addr learned my addr 172.21.15.72:0/87894767 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:37.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d8d33f700 1 --2- 172.21.15.72:0/87894767 >> v2:172.21.15.123:3300/0 conn(0x7f0d880b3810 0x7f0d880b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:37.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d8cb3e700 1 -- 172.21.15.72:0/87894767 >> v2:172.21.15.123:3300/0 conn(0x7f0d880b3810 msgr2=0x7f0d880b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:37.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d8cb3e700 1 --2- 172.21.15.72:0/87894767 >> v2:172.21.15.123:3300/0 conn(0x7f0d880b3810 0x7f0d880b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d8cb3e700 1 -- 172.21.15.72:0/87894767 >> v1:172.21.15.123:6789/0 conn(0x7f0d880cef90 legacy=0x7f0d8806d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:37.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d8cb3e700 1 -- 172.21.15.72:0/87894767 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8806beb0 con 0x7f0d880af160 2023-10-14T12:33:37.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d8d33f700 1 --2- 172.21.15.72:0/87894767 >> v2:172.21.15.123:3300/0 conn(0x7f0d880b3810 0x7f0d880b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:37.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d8cb3e700 1 --2- 172.21.15.72:0/87894767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880af160 0x7f0d880cea50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d880722c0 tx=0x7f0d84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba5227a9e63642a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:37.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d7ffff700 1 -- 172.21.15.72:0/87894767 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84004230 con 0x7f0d880af160 2023-10-14T12:33:37.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d7ffff700 1 -- 172.21.15.72:0/87894767 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d84004390 con 0x7f0d880af160 2023-10-14T12:33:37.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d7ffff700 1 -- 172.21.15.72:0/87894767 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d840036a0 con 0x7f0d880af160 2023-10-14T12:33:37.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/87894767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880af160 msgr2=0x7f0d880cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.396+0000 7f0d8f5a3700 1 --2- 172.21.15.72:0/87894767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880af160 0x7f0d880cea50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d880722c0 tx=0x7f0d84009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.397+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/87894767 shutdown_connections 2023-10-14T12:33:37.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.397+0000 7f0d8f5a3700 1 --2- 172.21.15.72:0/87894767 >> v2:172.21.15.123:3300/0 conn(0x7f0d880b3810 0x7f0d880b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.397+0000 7f0d8f5a3700 1 --2- 172.21.15.72:0/87894767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880af160 0x7f0d880cea50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.397+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/87894767 >> 172.21.15.72:0/87894767 conn(0x7f0d880b1620 msgr2=0x7f0d880b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:37.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.397+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/87894767 shutdown_connections 2023-10-14T12:33:37.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.397+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/87894767 wait complete. 2023-10-14T12:33:37.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.398+0000 7f0d8f5a3700 1 Processor -- start 2023-10-14T12:33:37.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.398+0000 7f0d8f5a3700 1 -- start start 2023-10-14T12:33:37.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8f5a3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d880af160 0x7f0d88147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8f5a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880b3810 0x7f0d881f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8f5a3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d88145320 0x7f0d881f0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8f5a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d881f4140 con 0x7f0d880b3810 2023-10-14T12:33:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8f5a3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88148bc0 con 0x7f0d880af160 2023-10-14T12:33:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8f5a3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88148320 con 0x7f0d88145320 2023-10-14T12:33:37.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8cb3e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880b3810 0x7f0d881f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:37.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8cb3e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880b3810 0x7f0d881f3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46268/0 (socket says 172.21.15.72:46268) 2023-10-14T12:33:37.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8cb3e700 1 -- 172.21.15.72:0/2586988603 learned_addr learned my addr 172.21.15.72:0/2586988603 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:37.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8d33f700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d880af160 0x7f0d88147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:37.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8db40700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d88145320 0x7f0d881f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:37.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8cb3e700 1 -- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d88145320 msgr2=0x7f0d881f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8cb3e700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d88145320 0x7f0d881f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8cb3e700 1 -- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d880af160 msgr2=0x7f0d88147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8cb3e700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d880af160 0x7f0d88147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8cb3e700 1 -- 172.21.15.72:0/2586988603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84009550 con 0x7f0d880b3810 2023-10-14T12:33:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8d33f700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d880af160 0x7f0d88147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:37.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8db40700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d88145320 0x7f0d881f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:37.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8cb3e700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880b3810 0x7f0d881f3c00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009130 tx=0x7f0d84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:37.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d7dffb700 1 -- 172.21.15.72:0/2586988603 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8401f070 con 0x7f0d880b3810 2023-10-14T12:33:37.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d7dffb700 1 -- 172.21.15.72:0/2586988603 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d84003d10 con 0x7f0d880b3810 2023-10-14T12:33:37.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d88148600 con 0x7f0d880b3810 2023-10-14T12:33:37.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d7dffb700 1 -- 172.21.15.72:0/2586988603 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84011850 con 0x7f0d880b3810 2023-10-14T12:33:37.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.399+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d881efd10 con 0x7f0d880b3810 2023-10-14T12:33:37.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.400+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d881eff30 con 0x7f0d880b3810 2023-10-14T12:33:37.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.401+0000 7f0d7dffb700 1 -- 172.21.15.72:0/2586988603 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d840119b0 con 0x7f0d880b3810 2023-10-14T12:33:37.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.401+0000 7f0d7dffb700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0d6c06af00 0x7f0d6c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.401+0000 7f0d7dffb700 1 -- 172.21.15.72:0/2586988603 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d8408c7c0 con 0x7f0d880b3810 2023-10-14T12:33:37.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.401+0000 7f0d8d33f700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0d6c06af00 0x7f0d6c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:37.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.401+0000 7f0d8d33f700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0d6c06af00 0x7f0d6c06d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d78006fd0 tx=0x7f0d78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:37.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.406+0000 7f0d7dffb700 1 -- 172.21.15.72:0/2586988603 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d84057610 con 0x7f0d880b3810 2023-10-14T12:33:37.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.595+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d880b1440 con 0x7f0d880b3810 2023-10-14T12:33:37.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.596+0000 7f0d7dffb700 1 -- 172.21.15.72:0/2586988603 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f0d8405ac30 con 0x7f0d880b3810 2023-10-14T12:33:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:37.598 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:37.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0d6c06af00 msgr2=0x7f0d6c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0d6c06af00 0x7f0d6c06d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d78006fd0 tx=0x7f0d78008040 comp rx=0 tx=0).stop 2023-10-14T12:33:37.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880b3810 msgr2=0x7f0d881f3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880b3810 0x7f0d881f3c00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009130 tx=0x7f0d84004750 comp rx=0 tx=0).stop 2023-10-14T12:33:37.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 shutdown_connections 2023-10-14T12:33:37.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0d6c06af00 0x7f0d6c06d3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0d88145320 0x7f0d881f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d880af160 0x7f0d88147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 --2- 172.21.15.72:0/2586988603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d880b3810 0x7f0d881f3c00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 >> 172.21.15.72:0/2586988603 conn(0x7f0d880b1620 msgr2=0x7f0d880b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:37.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 shutdown_connections 2023-10-14T12:33:37.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.599+0000 7f0d8f5a3700 1 -- 172.21.15.72:0/2586988603 wait complete. 2023-10-14T12:33:37.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:37.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.734+0000 7f7bd6991700 1 Processor -- start 2023-10-14T12:33:37.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.734+0000 7f7bd6991700 1 -- start start 2023-10-14T12:33:37.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bd6991700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bd015daa0 0x7f7bd00af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bd6991700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bd00af560 0x7f7bd0071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bd6991700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd015ed10 con 0x7f7bd0071d90 2023-10-14T12:33:37.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bd6991700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd0072200 con 0x7f7bd00af560 2023-10-14T12:33:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bd6991700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd015de80 con 0x7f7bd015daa0 2023-10-14T12:33:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bcf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bd00af560 0x7f7bd0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bcf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7bd00af560 0x7f7bd0071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46276/0 (socket says 172.21.15.72:46276) 2023-10-14T12:33:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bcf7fe700 1 -- 172.21.15.72:0/2989636785 learned_addr learned my addr 172.21.15.72:0/2989636785 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:37.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bcf7fe700 1 -- 172.21.15.72:0/2989636785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bd015daa0 msgr2=0x7f7bd00af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:37.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bcf7fe700 1 --2- 172.21.15.72:0/2989636785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bd015daa0 0x7f7bd00af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bcf7fe700 1 -- 172.21.15.72:0/2989636785 >> v1:172.21.15.123:6789/0 conn(0x7f7bd0071d90 legacy=0x7f7bd00ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:37.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.735+0000 7f7bcf7fe700 1 -- 172.21.15.72:0/2989636785 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd015e100 con 0x7f7bd00af560 2023-10-14T12:33:37.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bcf7fe700 1 --2- 172.21.15.72:0/2989636785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd00af560 0x7f7bd0071850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000bb90 tx=0x7f7bc000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a24d38846e92a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:37.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bceffd700 1 -- 172.21.15.72:0/2989636785 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000dd10 con 0x7f7bd00af560 2023-10-14T12:33:37.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bceffd700 1 -- 172.21.15.72:0/2989636785 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc000de70 con 0x7f7bd00af560 2023-10-14T12:33:37.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bceffd700 1 -- 172.21.15.72:0/2989636785 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0004230 con 0x7f7bd00af560 2023-10-14T12:33:37.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bd6991700 1 -- 172.21.15.72:0/2989636785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd00af560 msgr2=0x7f7bd0071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bd6991700 1 --2- 172.21.15.72:0/2989636785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd00af560 0x7f7bd0071850 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000bb90 tx=0x7f7bc000bea0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bd6991700 1 -- 172.21.15.72:0/2989636785 shutdown_connections 2023-10-14T12:33:37.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bd6991700 1 --2- 172.21.15.72:0/2989636785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bd015daa0 0x7f7bd00af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bd6991700 1 --2- 172.21.15.72:0/2989636785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd00af560 0x7f7bd0071850 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bd6991700 1 -- 172.21.15.72:0/2989636785 >> 172.21.15.72:0/2989636785 conn(0x7f7bd00d0180 msgr2=0x7f7bd00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:37.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bd6991700 1 -- 172.21.15.72:0/2989636785 shutdown_connections 2023-10-14T12:33:37.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.736+0000 7f7bd6991700 1 -- 172.21.15.72:0/2989636785 wait complete. 2023-10-14T12:33:37.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.738+0000 7f7bd6991700 1 Processor -- start 2023-10-14T12:33:37.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.738+0000 7f7bd6991700 1 -- start start 2023-10-14T12:33:37.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bd6991700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd0071d90 0x7f7bd01ee670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bd6991700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bd00af560 0x7f7bd00c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bd6991700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bd015daa0 0x7f7bd00c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bd6991700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd00c4ae0 con 0x7f7bd0071d90 2023-10-14T12:33:37.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bd6991700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd01eebb0 con 0x7f7bd00af560 2023-10-14T12:33:37.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bd6991700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd00c4800 con 0x7f7bd015daa0 2023-10-14T12:33:37.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bcffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd0071d90 0x7f7bd01ee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:37.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bcffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd0071d90 0x7f7bd01ee670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46280/0 (socket says 172.21.15.72:46280) 2023-10-14T12:33:37.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bcffff700 1 -- 172.21.15.72:0/2332947057 learned_addr learned my addr 172.21.15.72:0/2332947057 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:37.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bcffff700 1 -- 172.21.15.72:0/2332947057 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bd015daa0 msgr2=0x7f7bd00c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bcffff700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bd015daa0 0x7f7bd00c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bcffff700 1 -- 172.21.15.72:0/2332947057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bd00af560 msgr2=0x7f7bd00c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bcffff700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bd00af560 0x7f7bd00c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bcffff700 1 -- 172.21.15.72:0/2332947057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc000b7f0 con 0x7f7bd0071d90 2023-10-14T12:33:37.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.739+0000 7f7bcffff700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd0071d90 0x7f7bd01ee670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400b4a0 tx=0x7f7bc400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:37.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.740+0000 7f7bccff9700 1 -- 172.21.15.72:0/2332947057 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4011830 con 0x7f7bd0071d90 2023-10-14T12:33:37.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.740+0000 7f7bccff9700 1 -- 172.21.15.72:0/2332947057 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4011990 con 0x7f7bd0071d90 2023-10-14T12:33:37.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.740+0000 7f7bccff9700 1 -- 172.21.15.72:0/2332947057 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4011d40 con 0x7f7bd0071d90 2023-10-14T12:33:37.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.740+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd0146f90 con 0x7f7bd0071d90 2023-10-14T12:33:37.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.740+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd0147550 con 0x7f7bd0071d90 2023-10-14T12:33:37.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.741+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd0147740 con 0x7f7bd0071d90 2023-10-14T12:33:37.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.741+0000 7f7bccff9700 1 -- 172.21.15.72:0/2332947057 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7bc401a400 con 0x7f7bd0071d90 2023-10-14T12:33:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.741+0000 7f7bccff9700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7bbc06af00 0x7f7bbc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.741+0000 7f7bccff9700 1 -- 172.21.15.72:0/2332947057 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7bc40898c0 con 0x7f7bd0071d90 2023-10-14T12:33:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.741+0000 7f7bcf7fe700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7bbc06af00 0x7f7bbc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:37.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.742+0000 7f7bcf7fe700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7bbc06af00 0x7f7bbc06d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00cafb0 tx=0x7f7bc0012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:37.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.746+0000 7f7bccff9700 1 -- 172.21.15.72:0/2332947057 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7bc4054690 con 0x7f7bd0071d90 2023-10-14T12:33:37.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.936+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bd004ebb0 con 0x7f7bd0071d90 2023-10-14T12:33:37.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.937+0000 7f7bccff9700 1 -- 172.21.15.72:0/2332947057 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f7bc4057cb0 con 0x7f7bd0071d90 2023-10-14T12:33:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:37.938 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:37.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7bbc06af00 msgr2=0x7f7bbc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7bbc06af00 0x7f7bbc06d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00cafb0 tx=0x7f7bc0012000 comp rx=0 tx=0).stop 2023-10-14T12:33:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd0071d90 msgr2=0x7f7bd01ee670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd0071d90 0x7f7bd01ee670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400b4a0 tx=0x7f7bc400b860 comp rx=0 tx=0).stop 2023-10-14T12:33:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 shutdown_connections 2023-10-14T12:33:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7bbc06af00 0x7f7bbc06d3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7bd015daa0 0x7f7bd00c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bd0071d90 0x7f7bd01ee670 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 --2- 172.21.15.72:0/2332947057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bd00af560 0x7f7bd00c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.939+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 >> 172.21.15.72:0/2332947057 conn(0x7f7bd00d0180 msgr2=0x7f7bd00cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.940+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 shutdown_connections 2023-10-14T12:33:37.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:37.940+0000 7f7bd6991700 1 -- 172.21.15.72:0/2332947057 wait complete. 2023-10-14T12:33:37.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:33:38.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.092+0000 7ff262ff8700 1 Processor -- start 2023-10-14T12:33:38.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.092+0000 7ff262ff8700 1 -- start start 2023-10-14T12:33:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff262ff8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff25c152470 0x7ff25c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff262ff8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 0x7ff25c0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff262ff8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff25c070d70 con 0x7ff25c0b3240 2023-10-14T12:33:38.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff262ff8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25c0b36d0 con 0x7ff25c152470 2023-10-14T12:33:38.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff262ff8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c071200 con 0x7ff25c0cb8d0 2023-10-14T12:33:38.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff260d94700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff25c152470 0x7ff25c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff261595700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff25c0b3240 0x7ff25c0b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52592/0 (socket says 172.21.15.72:52592) 2023-10-14T12:33:38.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff261595700 1 -- 172.21.15.72:0/702970466 learned_addr learned my addr 172.21.15.72:0/702970466 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:38.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff25bfff700 1 --2- 172.21.15.72:0/702970466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 0x7ff25c0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff260d94700 1 -- 172.21.15.72:0/702970466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 msgr2=0x7ff25c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff260d94700 1 --2- 172.21.15.72:0/702970466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 0x7ff25c0b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff260d94700 1 -- 172.21.15.72:0/702970466 >> v1:172.21.15.72:6789/0 conn(0x7ff25c0b3240 legacy=0x7ff25c0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff25b7fe700 1 -- 172.21.15.72:0/702970466 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688537837 0 0) 0x7ff25c070d70 con 0x7ff25c0b3240 2023-10-14T12:33:38.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.093+0000 7ff260d94700 1 -- 172.21.15.72:0/702970466 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c070440 con 0x7ff25c152470 2023-10-14T12:33:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff260d94700 1 --2- 172.21.15.72:0/702970466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c152470 0x7ff25c0cd570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff250009840 tx=0x7ff250009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef4b3cdcac01d9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff25b7fe700 1 -- 172.21.15.72:0/702970466 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250011830 con 0x7ff25c152470 2023-10-14T12:33:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff25b7fe700 1 -- 172.21.15.72:0/702970466 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff250011990 con 0x7ff25c152470 2023-10-14T12:33:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff25b7fe700 1 -- 172.21.15.72:0/702970466 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250011d20 con 0x7ff25c152470 2023-10-14T12:33:38.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff262ff8700 1 -- 172.21.15.72:0/702970466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c152470 msgr2=0x7ff25c0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff262ff8700 1 --2- 172.21.15.72:0/702970466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c152470 0x7ff25c0cd570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff250009840 tx=0x7ff250009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff262ff8700 1 -- 172.21.15.72:0/702970466 shutdown_connections 2023-10-14T12:33:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff262ff8700 1 --2- 172.21.15.72:0/702970466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c152470 0x7ff25c0cd570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff262ff8700 1 --2- 172.21.15.72:0/702970466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 0x7ff25c0b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff262ff8700 1 -- 172.21.15.72:0/702970466 >> 172.21.15.72:0/702970466 conn(0x7ff25c0cdd00 msgr2=0x7ff25c0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:38.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff262ff8700 1 -- 172.21.15.72:0/702970466 shutdown_connections 2023-10-14T12:33:38.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.094+0000 7ff262ff8700 1 -- 172.21.15.72:0/702970466 wait complete. 2023-10-14T12:33:38.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.095+0000 7ff262ff8700 1 Processor -- start 2023-10-14T12:33:38.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.095+0000 7ff262ff8700 1 -- start start 2023-10-14T12:33:38.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.096+0000 7ff262ff8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c0b3240 0x7ff25c145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.096+0000 7ff262ff8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 0x7ff25c0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.096+0000 7ff262ff8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff25c152470 0x7ff25c0c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.096+0000 7ff262ff8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c155e30 con 0x7ff25c0b3240 2023-10-14T12:33:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.096+0000 7ff262ff8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c0c3fc0 con 0x7ff25c152470 2023-10-14T12:33:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.096+0000 7ff262ff8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c154d90 con 0x7ff25c0cb8d0 2023-10-14T12:33:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.096+0000 7ff260d94700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c0b3240 0x7ff25c145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.096+0000 7ff260d94700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c0b3240 0x7ff25c145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46298/0 (socket says 172.21.15.72:46298) 2023-10-14T12:33:38.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.096+0000 7ff260d94700 1 -- 172.21.15.72:0/1503061031 learned_addr learned my addr 172.21.15.72:0/1503061031 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff25bfff700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 0x7ff25c0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff261595700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff25c152470 0x7ff25c0c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff260d94700 1 -- 172.21.15.72:0/1503061031 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 msgr2=0x7ff25c0c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff260d94700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 0x7ff25c0c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff260d94700 1 -- 172.21.15.72:0/1503061031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff25c152470 msgr2=0x7ff25c0c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff260d94700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff25c152470 0x7ff25c0c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff260d94700 1 -- 172.21.15.72:0/1503061031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2500094a0 con 0x7ff25c0b3240 2023-10-14T12:33:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff260d94700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c0b3240 0x7ff25c145aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2500090b0 tx=0x7ff250004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff2597fa700 1 -- 172.21.15.72:0/1503061031 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2500036a0 con 0x7ff25c0b3240 2023-10-14T12:33:38.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff2597fa700 1 -- 172.21.15.72:0/1503061031 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25001e070 con 0x7ff25c0b3240 2023-10-14T12:33:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c155070 con 0x7ff25c0b3240 2023-10-14T12:33:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff2597fa700 1 -- 172.21.15.72:0/1503061031 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250003a60 con 0x7ff25c0b3240 2023-10-14T12:33:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.097+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25c155630 con 0x7ff25c0b3240 2023-10-14T12:33:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.098+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25c04ebb0 con 0x7ff25c0b3240 2023-10-14T12:33:38.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.098+0000 7ff2597fa700 1 -- 172.21.15.72:0/1503061031 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff250003bc0 con 0x7ff25c0b3240 2023-10-14T12:33:38.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.099+0000 7ff2597fa700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff24006af00 0x7ff24006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.099+0000 7ff2597fa700 1 -- 172.21.15.72:0/1503061031 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff25008a8d0 con 0x7ff25c0b3240 2023-10-14T12:33:38.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.099+0000 7ff25bfff700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff24006af00 0x7ff24006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.099+0000 7ff25bfff700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff24006af00 0x7ff24006d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff248009b70 tx=0x7ff248008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:38.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.103+0000 7ff2597fa700 1 -- 172.21.15.72:0/1503061031 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff250055720 con 0x7ff25c0b3240 2023-10-14T12:33:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.334+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff25c0709d0 con 0x7ff25c0b3240 2023-10-14T12:33:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.334+0000 7ff2597fa700 1 -- 172.21.15.72:0/1503061031 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7ff250020090 con 0x7ff25c0b3240 2023-10-14T12:33:38.336 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:38.336 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:36.244416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-14T12:33:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff24006af00 msgr2=0x7ff24006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff24006af00 0x7ff24006d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff248009b70 tx=0x7ff248008040 comp rx=0 tx=0).stop 2023-10-14T12:33:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c0b3240 msgr2=0x7ff25c145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c0b3240 0x7ff25c145aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2500090b0 tx=0x7ff250004750 comp rx=0 tx=0).stop 2023-10-14T12:33:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 shutdown_connections 2023-10-14T12:33:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff24006af00 0x7ff24006d3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff25c152470 0x7ff25c0c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff25c0b3240 0x7ff25c145aa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 --2- 172.21.15.72:0/1503061031 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff25c0cb8d0 0x7ff25c0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 >> 172.21.15.72:0/1503061031 conn(0x7ff25c0cdd00 msgr2=0x7ff25c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:38.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 shutdown_connections 2023-10-14T12:33:38.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.336+0000 7ff262ff8700 1 -- 172.21.15.72:0/1503061031 wait complete. 2023-10-14T12:33:38.342 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 7 2023-10-14T12:33:38.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:38.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.468+0000 7f7af3275700 1 Processor -- start 2023-10-14T12:33:38.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.468+0000 7f7af3275700 1 -- start start 2023-10-14T12:33:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.469+0000 7f7af3275700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7aec06dfc0 0x7f7aec0717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.469+0000 7f7af3275700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec06f270 con 0x7f7aec071d20 2023-10-14T12:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.469+0000 7f7af3275700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec15aa30 con 0x7f7aec15a650 2023-10-14T12:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.469+0000 7f7af3275700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec06e470 con 0x7f7aec06dfc0 2023-10-14T12:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.469+0000 7f7af1812700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7aec071d20 0x7f7aec0ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52606/0 (socket says 172.21.15.72:52606) 2023-10-14T12:33:38.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.469+0000 7f7af1812700 1 -- 172.21.15.72:0/1616336086 learned_addr learned my addr 172.21.15.72:0/1616336086 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:38.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.469+0000 7f7af0810700 1 --2- 172.21.15.72:0/1616336086 >> v2:172.21.15.123:3300/0 conn(0x7f7aec06dfc0 0x7f7aec0717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.469+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651951897 0 0) 0x7f7aec06f270 con 0x7f7aec071d20 2023-10-14T12:33:38.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.469+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad80035b0 con 0x7f7aec071d20 2023-10-14T12:33:38.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 736918597 0 0) 0x7f7ad80035b0 con 0x7f7aec071d20 2023-10-14T12:33:38.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 >> v2:172.21.15.123:3300/0 conn(0x7f7aec06dfc0 msgr2=0x7f7aec0717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:38.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 --2- 172.21.15.72:0/1616336086 >> v2:172.21.15.123:3300/0 conn(0x7f7aec06dfc0 0x7f7aec0717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 >> v1:172.21.15.123:6789/0 conn(0x7f7aec15a650 legacy=0x7f7aec15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec06e660 con 0x7f7aec071d20 2023-10-14T12:33:38.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f7ae40019f0 con 0x7f7aec071d20 2023-10-14T12:33:38.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 >> v1:172.21.15.72:6789/0 conn(0x7f7aec071d20 legacy=0x7f7aec0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad8003a00 0x7f7ad8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad8004850 0x7f7ad8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad8005210 0x7f7ad800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad800c080 con 0x7f7ad8003a00 2023-10-14T12:33:38.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad800c1f0 con 0x7f7ad8004850 2023-10-14T12:33:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad800c3b0 con 0x7f7ad8005210 2023-10-14T12:33:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af1011700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad8003a00 0x7f7ad8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af0810700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad8004850 0x7f7ad8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af1812700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad8005210 0x7f7ad800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af1011700 1 -- 172.21.15.72:0/1616336086 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad8005210 msgr2=0x7f7ad800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:38.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af1011700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad8005210 0x7f7ad800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af1011700 1 -- 172.21.15.72:0/1616336086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad8004850 msgr2=0x7f7ad8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:38.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af1011700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad8004850 0x7f7ad8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af1011700 1 -- 172.21.15.72:0/1616336086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad80035b0 con 0x7f7ad8003a00 2023-10-14T12:33:38.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af1812700 1 -- 172.21.15.72:0/1616336086 reap_dead start 2023-10-14T12:33:38.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7af1011700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad8003a00 0x7f7ad8003e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0017c0 tx=0x7f7ad8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb415c61138414 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:38.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0052d0 con 0x7f7ad8003a00 2023-10-14T12:33:38.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc005430 con 0x7f7ad8003a00 2023-10-14T12:33:38.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.470+0000 7f7ae3fff700 1 -- 172.21.15.72:0/1616336086 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc0038c0 con 0x7f7ad8003a00 2023-10-14T12:33:38.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.471+0000 7f7af3275700 1 -- 172.21.15.72:0/1616336086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad8003a00 msgr2=0x7f7ad8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.471+0000 7f7af3275700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad8003a00 0x7f7ad8003e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0017c0 tx=0x7f7ad8005880 comp rx=0 tx=0).stop 2023-10-14T12:33:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.471+0000 7f7af3275700 1 -- 172.21.15.72:0/1616336086 shutdown_connections 2023-10-14T12:33:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.471+0000 7f7af3275700 1 --2- 172.21.15.72:0/1616336086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ad8003a00 0x7f7ad8003e20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.471+0000 7f7af3275700 1 -- 172.21.15.72:0/1616336086 >> 172.21.15.72:0/1616336086 conn(0x7f7aec0d0180 msgr2=0x7f7aec0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.471+0000 7f7af3275700 1 -- 172.21.15.72:0/1616336086 shutdown_connections 2023-10-14T12:33:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.471+0000 7f7af3275700 1 -- 172.21.15.72:0/1616336086 wait complete. 2023-10-14T12:33:38.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.472+0000 7f7af3275700 1 Processor -- start 2023-10-14T12:33:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.472+0000 7f7af3275700 1 -- start start 2023-10-14T12:33:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af3275700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad8003a00 0x7f7aec0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af3275700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aec0b05f0 0x7f7aec151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af3275700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0b4d60 0x7f7aec0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af3275700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0b5720 con 0x7f7aec0b4d60 2023-10-14T12:33:38.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af3275700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0b0d60 con 0x7f7aec0b05f0 2023-10-14T12:33:38.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af3275700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0b1040 con 0x7f7ad8003a00 2023-10-14T12:33:38.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1812700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0b4d60 0x7f7aec0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1812700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0b4d60 0x7f7aec0b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46318/0 (socket says 172.21.15.72:46318) 2023-10-14T12:33:38.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1812700 1 -- 172.21.15.72:0/985725973 learned_addr learned my addr 172.21.15.72:0/985725973 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:38.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af0810700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aec0b05f0 0x7f7aec151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1011700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad8003a00 0x7f7aec0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1812700 1 -- 172.21.15.72:0/985725973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad8003a00 msgr2=0x7f7aec0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1812700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad8003a00 0x7f7aec0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1812700 1 -- 172.21.15.72:0/985725973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aec0b05f0 msgr2=0x7f7aec151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1812700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aec0b05f0 0x7f7aec151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1812700 1 -- 172.21.15.72:0/985725973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec0b1320 con 0x7f7aec0b4d60 2023-10-14T12:33:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af1812700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0b4d60 0x7f7aec0b51e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7aec067640 tx=0x7f7ae400e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7ae1ffb700 1 -- 172.21.15.72:0/985725973 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400ebb0 con 0x7f7aec0b4d60 2023-10-14T12:33:38.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7ae1ffb700 1 -- 172.21.15.72:0/985725973 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae400ed10 con 0x7f7aec0b4d60 2023-10-14T12:33:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7ae1ffb700 1 -- 172.21.15.72:0/985725973 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4013640 con 0x7f7aec0b4d60 2023-10-14T12:33:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.473+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec0b1600 con 0x7f7aec0b4d60 2023-10-14T12:33:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.474+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec0b0a70 con 0x7f7aec0b4d60 2023-10-14T12:33:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.475+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec04ebb0 con 0x7f7aec0b4d60 2023-10-14T12:33:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.475+0000 7f7ae1ffb700 1 -- 172.21.15.72:0/985725973 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7ae40137a0 con 0x7f7aec0b4d60 2023-10-14T12:33:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.475+0000 7f7ae1ffb700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ad006af00 0x7f7ad006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:38.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.475+0000 7f7af1011700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ad006af00 0x7f7ad006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:38.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.475+0000 7f7ae1ffb700 1 -- 172.21.15.72:0/985725973 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ae4089d10 con 0x7f7aec0b4d60 2023-10-14T12:33:38.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.475+0000 7f7af1011700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ad006af00 0x7f7ad006d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005040 tx=0x7f7adc009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:38.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.480+0000 7f7ae1ffb700 1 -- 172.21.15.72:0/985725973 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ae4054ad0 con 0x7f7aec0b4d60 2023-10-14T12:33:38.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.673+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aec06eed0 con 0x7f7aec0b4d60 2023-10-14T12:33:38.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.674+0000 7f7ae1ffb700 1 -- 172.21.15.72:0/985725973 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f7ae40580f0 con 0x7f7aec0b4d60 2023-10-14T12:33:38.676 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:38.676 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:38.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.676+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ad006af00 msgr2=0x7f7ad006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.676+0000 7f7af3275700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ad006af00 0x7f7ad006d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005040 tx=0x7f7adc009030 comp rx=0 tx=0).stop 2023-10-14T12:33:38.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.676+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0b4d60 msgr2=0x7f7aec0b51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:38.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.676+0000 7f7af3275700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0b4d60 0x7f7aec0b51e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7aec067640 tx=0x7f7ae400e440 comp rx=0 tx=0).stop 2023-10-14T12:33:38.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.677+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 shutdown_connections 2023-10-14T12:33:38.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.677+0000 7f7af3275700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ad006af00 0x7f7ad006d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.677+0000 7f7af3275700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aec0b4d60 0x7f7aec0b51e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.677+0000 7f7af3275700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7ad8003a00 0x7f7aec0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.677+0000 7f7af3275700 1 --2- 172.21.15.72:0/985725973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7aec0b05f0 0x7f7aec151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:38.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.677+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 >> 172.21.15.72:0/985725973 conn(0x7f7aec0d0180 msgr2=0x7f7aec15bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:38.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.677+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 shutdown_connections 2023-10-14T12:33:38.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:38.677+0000 7f7af3275700 1 -- 172.21.15.72:0/985725973 wait complete. 2023-10-14T12:33:39.094 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T12:33:31.210218+0000', 'modified': '2023-10-14T12:33:36.244416+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/3216890106', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6833', 'nonce': 3216890106}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3216890106}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-14T12:33:39.094 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T12:33:39.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-14T12:33:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.215+0000 7f70cbcc8700 1 Processor -- start 2023-10-14T12:33:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.215+0000 7f70cbcc8700 1 -- start start 2023-10-14T12:33:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70cbcc8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 0x7f70c406e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70cbcc8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70c406bf80 0x7f70c40cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70cbcc8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c415ec80 con 0x7f70c406d070 2023-10-14T12:33:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70cbcc8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c4161260 con 0x7f70c406bf80 2023-10-14T12:33:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70cbcc8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c4161b00 con 0x7f70c40cd4b0 2023-10-14T12:33:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70ca265700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f70c406d070 0x7f70c406d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52624/0 (socket says 172.21.15.72:52624) 2023-10-14T12:33:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70ca265700 1 -- 172.21.15.72:0/2837638288 learned_addr learned my addr 172.21.15.72:0/2837638288 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c9263700 1 --2- 172.21.15.72:0/2837638288 >> v2:172.21.15.123:3300/0 conn(0x7f70c406bf80 0x7f70c40cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c9a64700 1 --2- 172.21.15.72:0/2837638288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 0x7f70c406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c8a62700 1 -- 172.21.15.72:0/2837638288 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669617649 0 0) 0x7f70c415ec80 con 0x7f70c406d070 2023-10-14T12:33:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c8a62700 1 -- 172.21.15.72:0/2837638288 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b00035b0 con 0x7f70c406d070 2023-10-14T12:33:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c9263700 1 -- 172.21.15.72:0/2837638288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 msgr2=0x7f70c406e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c9263700 1 --2- 172.21.15.72:0/2837638288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 0x7f70c406e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c9263700 1 -- 172.21.15.72:0/2837638288 >> v1:172.21.15.72:6789/0 conn(0x7f70c406d070 legacy=0x7f70c406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c8a62700 1 -- 172.21.15.72:0/2837638288 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1702922098 0 0) 0x7f70b00035b0 con 0x7f70c406d070 2023-10-14T12:33:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c9263700 1 -- 172.21.15.72:0/2837638288 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c406e7d0 con 0x7f70c406bf80 2023-10-14T12:33:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.216+0000 7f70c9a64700 1 --2- 172.21.15.72:0/2837638288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 0x7f70c406e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70c9263700 1 --2- 172.21.15.72:0/2837638288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70c406bf80 0x7f70c40cd890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009840 tx=0x7f70b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65edc9c524fdd2be server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70c8a62700 1 -- 172.21.15.72:0/2837638288 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc0019f0 con 0x7f70c406bf80 2023-10-14T12:33:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70c8a62700 1 -- 172.21.15.72:0/2837638288 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b4004030 con 0x7f70c406bf80 2023-10-14T12:33:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70c8a62700 1 -- 172.21.15.72:0/2837638288 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40043c0 con 0x7f70c406bf80 2023-10-14T12:33:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2837638288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70c406bf80 msgr2=0x7f70c40cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70cbcc8700 1 --2- 172.21.15.72:0/2837638288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70c406bf80 0x7f70c40cd890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009840 tx=0x7f70b4009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2837638288 shutdown_connections 2023-10-14T12:33:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70cbcc8700 1 --2- 172.21.15.72:0/2837638288 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 0x7f70c406e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70cbcc8700 1 --2- 172.21.15.72:0/2837638288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70c406bf80 0x7f70c40cd890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2837638288 >> 172.21.15.72:0/2837638288 conn(0x7f70c40cfcd0 msgr2=0x7f70c40d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2837638288 shutdown_connections 2023-10-14T12:33:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.217+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2837638288 wait complete. 2023-10-14T12:33:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70cbcc8700 1 Processor -- start 2023-10-14T12:33:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70cbcc8700 1 -- start start 2023-10-14T12:33:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70cbcc8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70c406bf80 0x7f70c415f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70cbcc8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70c406d070 0x7f70c40c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70cbcc8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 0x7f70c4157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70cbcc8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c4158540 con 0x7f70c406d070 2023-10-14T12:33:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70cbcc8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c40c8c90 con 0x7f70c406bf80 2023-10-14T12:33:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70cbcc8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c415fff0 con 0x7f70c40cd4b0 2023-10-14T12:33:39.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70c9263700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70c406d070 0x7f70c40c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70c9263700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70c406d070 0x7f70c40c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46328/0 (socket says 172.21.15.72:46328) 2023-10-14T12:33:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.219+0000 7f70c9263700 1 -- 172.21.15.72:0/2881254054 learned_addr learned my addr 172.21.15.72:0/2881254054 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70c9a64700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70c406bf80 0x7f70c415f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70ca265700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 0x7f70c4157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70c9263700 1 -- 172.21.15.72:0/2881254054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 msgr2=0x7f70c4157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70c9263700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 0x7f70c4157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70c9263700 1 -- 172.21.15.72:0/2881254054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70c406bf80 msgr2=0x7f70c415f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70c9263700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70c406bf80 0x7f70c415f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70c9263700 1 -- 172.21.15.72:0/2881254054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c00094a0 con 0x7f70c406d070 2023-10-14T12:33:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70c9263700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70c406d070 0x7f70c40c8750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f70b400a010 tx=0x7f70b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70ba7fc700 1 -- 172.21.15.72:0/2881254054 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4003c40 con 0x7f70c406d070 2023-10-14T12:33:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70ba7fc700 1 -- 172.21.15.72:0/2881254054 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b401f070 con 0x7f70c406d070 2023-10-14T12:33:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2881254054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b40094a0 con 0x7f70c406d070 2023-10-14T12:33:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70ba7fc700 1 -- 172.21.15.72:0/2881254054 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4011630 con 0x7f70c406d070 2023-10-14T12:33:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.220+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2881254054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c41605b0 con 0x7f70c406d070 2023-10-14T12:33:39.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.222+0000 7f70ba7fc700 1 -- 172.21.15.72:0/2881254054 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f70b4021030 con 0x7f70c406d070 2023-10-14T12:33:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.222+0000 7f70ba7fc700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f70a806af30 0x7f70a806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.222+0000 7f70ba7fc700 1 -- 172.21.15.72:0/2881254054 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70b408ab70 con 0x7f70c406d070 2023-10-14T12:33:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.222+0000 7f70c9a64700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f70a806af30 0x7f70a806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.223+0000 7f70c9a64700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f70a806af30 0x7f70a806d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009d00 tx=0x7f70c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.224+0000 7f70d7eb2b80 1 Processor -- start 2023-10-14T12:33:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.224+0000 7f70d7eb2b80 1 -- start start 2023-10-14T12:33:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6506f220 0x561f65076a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65076fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6504a010 0x561f6504a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f64fc0c20 con 0x561f6506f220 2023-10-14T12:33:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f64fa5c10 con 0x561f6504a010 2023-10-14T12:33:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f64fa3530 con 0x561f65074630 2023-10-14T12:33:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70c9a64700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6506f220 0x561f65076a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70c9a64700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6506f220 0x561f65076a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46334/0 (socket says 172.21.15.72:46334) 2023-10-14T12:33:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70c9a64700 1 -- 172.21.15.72:0/3059951793 learned_addr learned my addr 172.21.15.72:0/3059951793 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:39.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70c9263700 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65076fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70ca265700 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6504a010 0x561f6504a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70c9a64700 1 -- 172.21.15.72:0/3059951793 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 msgr2=0x561f65076fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70c9a64700 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65076fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70c9a64700 1 -- 172.21.15.72:0/3059951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6504a010 msgr2=0x561f6504a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70c9a64700 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6504a010 0x561f6504a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70c9a64700 1 -- 172.21.15.72:0/3059951793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f64f5c3a0 con 0x561f6506f220 2023-10-14T12:33:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.225+0000 7f70ca265700 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6504a010 0x561f6504a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70c9a64700 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6506f220 0x561f65076a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009470 tx=0x7f70c0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159d7580d2a5521d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70a77fe700 1 -- 172.21.15.72:0/3059951793 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0011e00 con 0x561f6506f220 2023-10-14T12:33:39.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70a77fe700 1 -- 172.21.15.72:0/3059951793 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0015bb0 con 0x561f6506f220 2023-10-14T12:33:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70a77fe700 1 -- 172.21.15.72:0/3059951793 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0021440 con 0x561f6506f220 2023-10-14T12:33:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/3059951793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6506f220 msgr2=0x561f65076a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6506f220 0x561f65076a70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009470 tx=0x7f70c0014000 comp rx=0 tx=0).stop 2023-10-14T12:33:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/3059951793 shutdown_connections 2023-10-14T12:33:39.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6504a010 0x561f6504a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6506f220 0x561f65076a70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/3059951793 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/3059951793 >> 172.21.15.72:0/3059951793 conn(0x561f64f79d80 msgr2=0x561f65094ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.226+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/3059951793 shutdown_connections 2023-10-14T12:33:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.227+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/3059951793 wait complete. 2023-10-14T12:33:39.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.227+0000 7f70d7eb2b80 1 -- start start 2023-10-14T12:33:39.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.227+0000 7f70d7eb2b80 1 Processor -- start 2023-10-14T12:33:39.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f65073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f65078d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f64f9ee20 con 0x561f6504a010 2023-10-14T12:33:39.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f64f3b6c0 con 0x561f6506f220 2023-10-14T12:33:39.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f64f3b360 con 0x561f65074630 2023-10-14T12:33:39.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70d7eb2b80 10 client.0 _ll_register_callbacks cb 0x561f64d987b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:33:39.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70c9a64700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f65073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70c9a64700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f65073210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46340/0 (socket says 172.21.15.72:46340) 2023-10-14T12:33:39.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70c9a64700 1 -- 172.21.15.72:0/775992068 learned_addr learned my addr 172.21.15.72:0/775992068 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:39.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70c9263700 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f65078d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70ca265700 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70c9a64700 1 -- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 msgr2=0x561f65070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70c9a64700 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70c9a64700 1 -- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 msgr2=0x561f65078d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70c9a64700 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f65078d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.228+0000 7f70c9a64700 1 -- 172.21.15.72:0/775992068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c0011ae0 con 0x561f6504a010 2023-10-14T12:33:39.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70c9a64700 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f65073210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x561f6504dfa0 tx=0x7f70c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e01c4d3547553d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-10-14T12:33:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70a4ff9700 1 -- 172.21.15.72:0/775992068 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0015d20 con 0x561f6504a010 2023-10-14T12:33:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70a4ff9700 1 -- 172.21.15.72:0/775992068 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70c0031070 con 0x561f6504a010 2023-10-14T12:33:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/775992068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f6503f5b0 con 0x561f6504a010 2023-10-14T12:33:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70a4ff9700 1 -- 172.21.15.72:0/775992068 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70c0015e80 con 0x561f6504a010 2023-10-14T12:33:39.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70d7eb2b80 10 client.4395 fetch_fsmap learned FSMap version 7 2023-10-14T12:33:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/775992068 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x561f64dc9d90 con 0x561f6504a010 2023-10-14T12:33:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70a4ff9700 1 -- 172.21.15.72:0/775992068 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561f6503f5b0 con 0x561f6504a010 2023-10-14T12:33:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70a4ff9700 1 -- 172.21.15.72:0/775992068 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f70c0021af0 con 0x561f6504a010 2023-10-14T12:33:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70d7eb2b80 10 client.4395 fetch_fsmap finished waiting for FSMap version 7 2023-10-14T12:33:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70d7eb2b80 10 client.4395 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:33:39.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70d7eb2b80 20 client.4395 populate_metadata read hostname 'smithi072' 2023-10-14T12:33:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x561f6504a980 0x561f65077730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70d7eb2b80 4 client.4395 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T12:33:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/775992068 --> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f64f97e00 con 0x561f6504a980 2023-10-14T12:33:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.229+0000 7f70c9263700 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x561f6504a980 0x561f65077730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.230+0000 7f70a4ff9700 10 client.4395 ms_handle_connect on v2:172.21.15.123:6833/3216890106 2023-10-14T12:33:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.230+0000 7f70c9263700 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x561f6504a980 0x561f65077730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d24baa1784a2c8 server_cookie=5fe4044c661dcc92 in_seq=0 out_seq=0 2023-10-14T12:33:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.230+0000 7f70a4ff9700 1 -- 172.21.15.72:0/775992068 <== mds.0 v2:172.21.15.123:6833/3216890106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561f64f97e00 con 0x561f6504a980 2023-10-14T12:33:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.230+0000 7f70a4ff9700 10 client.4395 handle_command_reply: tid=0 2023-10-14T12:33:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.230+0000 7f70d7eb2b80 1 client.4395 shutdown 2023-10-14T12:33:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/775992068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 msgr2=0x561f65073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f65073210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x561f6504dfa0 tx=0x7f70c0004750 comp rx=0 tx=0).stop 2023-10-14T12:33:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/775992068 shutdown_connections 2023-10-14T12:33:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x561f6504a980 0x561f65077730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70a4ff9700 0 client.4395 ms_handle_reset on v2:172.21.15.123:6833/3216890106 2023-10-14T12:33:39.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f65073210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/775992068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f65078d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/775992068 >> 172.21.15.72:0/775992068 conn(0x561f64f79d80 msgr2=0x561f65076a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/775992068 shutdown_connections 2023-10-14T12:33:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/775992068 wait complete. 2023-10-14T12:33:39.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.231+0000 7f70d7eb2b80 20 client.4395 trim_cache size 0 max 16384 2023-10-14T12:33:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.248+0000 7f70d7eb2b80 1 Processor -- start 2023-10-14T12:33:39.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.248+0000 7f70d7eb2b80 1 -- start start 2023-10-14T12:33:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f6506d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f650739f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65073f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f64e1f8d0 con 0x561f6504a010 2023-10-14T12:33:39.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6504cdc0 con 0x561f6506f220 2023-10-14T12:33:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f6508ba00 con 0x561f65074630 2023-10-14T12:33:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70c9a64700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f6506d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70c9a64700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f6506d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46348/0 (socket says 172.21.15.72:46348) 2023-10-14T12:33:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70c9a64700 1 -- 172.21.15.72:0/633752852 learned_addr learned my addr 172.21.15.72:0/633752852 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:39.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70c9a64700 1 -- 172.21.15.72:0/633752852 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 msgr2=0x561f65073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70c9a64700 1 --2- 172.21.15.72:0/633752852 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65073f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70c9a64700 1 -- 172.21.15.72:0/633752852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 msgr2=0x561f650739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70c9a64700 1 --2- 172.21.15.72:0/633752852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f650739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.249+0000 7f70c9a64700 1 -- 172.21.15.72:0/633752852 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f64db2c10 con 0x561f6504a010 2023-10-14T12:33:39.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70c9a64700 1 --2- 172.21.15.72:0/633752852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f6506d5f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f70c00092a0 tx=0x7f70c002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e8d27af1022cfd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70a7fff700 1 -- 172.21.15.72:0/633752852 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c002b400 con 0x561f6504a010 2023-10-14T12:33:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70a7fff700 1 -- 172.21.15.72:0/633752852 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c002f070 con 0x561f6504a010 2023-10-14T12:33:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70a7fff700 1 -- 172.21.15.72:0/633752852 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0021970 con 0x561f6504a010 2023-10-14T12:33:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/633752852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 msgr2=0x561f6506d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/633752852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f6506d5f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f70c00092a0 tx=0x7f70c002d070 comp rx=0 tx=0).stop 2023-10-14T12:33:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/633752852 shutdown_connections 2023-10-14T12:33:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/633752852 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f65074630 0x561f65073f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/633752852 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f6504a010 0x561f6506d5f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/633752852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f650739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/633752852 >> 172.21.15.72:0/633752852 conn(0x561f64f79d80 msgr2=0x561f65078b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/633752852 shutdown_connections 2023-10-14T12:33:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.250+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/633752852 wait complete. 2023-10-14T12:33:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.251+0000 7f70d7eb2b80 1 -- start start 2023-10-14T12:33:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.251+0000 7f70d7eb2b80 1 Processor -- start 2023-10-14T12:33:39.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f6504a010 0x561f6506d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f65046e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70d7eb2b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f65074630 0x561f650473b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f650f8720 con 0x561f65074630 2023-10-14T12:33:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6504cda0 con 0x561f6506f220 2023-10-14T12:33:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70d7eb2b80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f650a3470 con 0x561f6504a010 2023-10-14T12:33:39.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70d7eb2b80 10 client.0 _ll_register_callbacks cb 0x7f70b40559c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:33:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70ca265700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f65074630 0x561f650473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70ca265700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f65074630 0x561f650473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46358/0 (socket says 172.21.15.72:46358) 2023-10-14T12:33:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70ca265700 1 -- 172.21.15.72:0/992036408 learned_addr learned my addr 172.21.15.72:0/992036408 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70c9263700 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f65046e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70c9a64700 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f6504a010 0x561f6506d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70ca265700 1 -- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f6504a010 msgr2=0x561f6506d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70ca265700 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f6504a010 0x561f6506d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70ca265700 1 -- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 msgr2=0x561f65046e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70ca265700 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f65046e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70ca265700 1 -- 172.21.15.72:0/992036408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f64dc9d90 con 0x561f65074630 2023-10-14T12:33:39.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70ca265700 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f65074630 0x561f650473b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0074a0 tx=0x7f70bc0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcbb027a4088373 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-10-14T12:33:39.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70a4ff9700 1 -- 172.21.15.72:0/992036408 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70bc012710 con 0x561f65074630 2023-10-14T12:33:39.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70a4ff9700 1 -- 172.21.15.72:0/992036408 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70bc012870 con 0x561f65074630 2023-10-14T12:33:39.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/992036408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70c0015bb0 con 0x561f65074630 2023-10-14T12:33:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.252+0000 7f70a4ff9700 1 -- 172.21.15.72:0/992036408 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70bc012a30 con 0x561f65074630 2023-10-14T12:33:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70d7eb2b80 10 client.4401 fetch_fsmap learned FSMap version 7 2023-10-14T12:33:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/992036408 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x561f64df0200 con 0x561f65074630 2023-10-14T12:33:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70a4ff9700 1 -- 172.21.15.72:0/992036408 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0015bb0 con 0x561f65074630 2023-10-14T12:33:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70a4ff9700 1 -- 172.21.15.72:0/992036408 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f70bc012b90 con 0x561f65074630 2023-10-14T12:33:39.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70d7eb2b80 10 client.4401 fetch_fsmap finished waiting for FSMap version 7 2023-10-14T12:33:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70d7eb2b80 10 client.4401 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:33:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70d7eb2b80 20 client.4401 populate_metadata read hostname 'smithi072' 2023-10-14T12:33:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x561f650f7f40 0x561f65072700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70d7eb2b80 4 client.4401 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T12:33:39.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/992036408 --> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561f64f97b20 con 0x561f650f7f40 2023-10-14T12:33:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70c9a64700 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x561f650f7f40 0x561f65072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70a4ff9700 10 client.4401 ms_handle_connect on v2:172.21.15.123:6833/3216890106 2023-10-14T12:33:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70c9a64700 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x561f650f7f40 0x561f65072700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bad2b2efd29e367 server_cookie=d0fb2e63715bba1d in_seq=0 out_seq=0 2023-10-14T12:33:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70a4ff9700 1 -- 172.21.15.72:0/992036408 <== mds.0 v2:172.21.15.123:6833/3216890106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561f64f97b20 con 0x561f650f7f40 2023-10-14T12:33:39.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70a4ff9700 10 client.4401 handle_command_reply: tid=0 2023-10-14T12:33:39.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.253+0000 7f70d7eb2b80 1 client.4401 shutdown 2023-10-14T12:33:39.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/992036408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f65074630 msgr2=0x561f650473b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f65074630 0x561f650473b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f70bc0074a0 tx=0x7f70bc0077b0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/992036408 shutdown_connections 2023-10-14T12:33:39.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x561f650f7f40 0x561f65072700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x561f65074630 0x561f650473b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x561f6504a010 0x561f6506d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 --2- 172.21.15.72:0/992036408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561f6506f220 0x561f65046e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70a4ff9700 0 client.4401 ms_handle_reset on v2:172.21.15.123:6833/3216890106 2023-10-14T12:33:39.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/992036408 >> 172.21.15.72:0/992036408 conn(0x561f64f79d80 msgr2=0x561f650417d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/992036408 shutdown_connections 2023-10-14T12:33:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 1 -- 172.21.15.72:0/992036408 wait complete. 2023-10-14T12:33:39.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70d7eb2b80 20 client.4401 trim_cache size 0 max 16384 2023-10-14T12:33:39.277 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:33:39.278 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8", 2023-10-14T12:33:39.278 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-10-14T12:33:39.278 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4273, 2023-10-14T12:33:39.278 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-10-14T12:33:39.278 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-10-14T12:33:39.279 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-10-14T12:33:39.279 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 7.4365637250000001, 2023-10-14T12:33:39.279 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 7, 2023-10-14T12:33:39.279 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 24, 2023-10-14T12:33:39.279 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 23, 2023-10-14T12:33:39.280 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 14.475476984 2023-10-14T12:33:39.281 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:33:39.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f70a806af30 msgr2=0x7f70a806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f70a806af30 0x7f70a806d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009d00 tx=0x7f70c0008040 comp rx=0 tx=0).stop 2023-10-14T12:33:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70c406d070 msgr2=0x7f70c40c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70c406d070 0x7f70c40c8750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f70b400a010 tx=0x7f70b4004750 comp rx=0 tx=0).stop 2023-10-14T12:33:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2881254054 shutdown_connections 2023-10-14T12:33:39.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f70a806af30 0x7f70a806d3f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f70c40cd4b0 0x7f70c4157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70c406bf80 0x7f70c415f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 --2- 172.21.15.72:0/2881254054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70c406d070 0x7f70c40c8750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2881254054 >> 172.21.15.72:0/2881254054 conn(0x7f70c40cfcd0 msgr2=0x7f70c40c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:39.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2881254054 shutdown_connections 2023-10-14T12:33:39.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.254+0000 7f70cbcc8700 1 -- 172.21.15.72:0/2881254054 wait complete. 2023-10-14T12:33:39.285 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:33:39.286 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:33:39.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:33:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.405+0000 7f372c575700 1 Processor -- start 2023-10-14T12:33:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.405+0000 7f372c575700 1 -- start start 2023-10-14T12:33:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.406+0000 7f372c575700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f372406a820 0x7f37240cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.406+0000 7f372c575700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f372415e7f0 0x7f372406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.406+0000 7f372c575700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37240ca7d0 0x7f3724071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.406+0000 7f372c575700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37240ce410 con 0x7f37240ca7d0 2023-10-14T12:33:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.406+0000 7f372c575700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37240cfeb0 con 0x7f372406a820 2023-10-14T12:33:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.406+0000 7f372c575700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372415ec50 con 0x7f372415e7f0 2023-10-14T12:33:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.406+0000 7f372ab12700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37240ca7d0 0x7f3724071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372ab12700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37240ca7d0 0x7f3724071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46366/0 (socket says 172.21.15.72:46366) 2023-10-14T12:33:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372ab12700 1 -- 172.21.15.72:0/1456392717 learned_addr learned my addr 172.21.15.72:0/1456392717 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f3729b10700 1 --2- 172.21.15.72:0/1456392717 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f372415e7f0 0x7f372406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372a311700 1 --2- 172.21.15.72:0/1456392717 >> v2:172.21.15.123:3300/0 conn(0x7f372406a820 0x7f37240cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372ab12700 1 -- 172.21.15.72:0/1456392717 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f372415e7f0 msgr2=0x7f372406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372ab12700 1 --2- 172.21.15.72:0/1456392717 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f372415e7f0 0x7f372406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372ab12700 1 -- 172.21.15.72:0/1456392717 >> v2:172.21.15.123:3300/0 conn(0x7f372406a820 msgr2=0x7f37240cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:39.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372ab12700 1 --2- 172.21.15.72:0/1456392717 >> v2:172.21.15.123:3300/0 conn(0x7f372406a820 0x7f37240cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372ab12700 1 -- 172.21.15.72:0/1456392717 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240af9d0 con 0x7f37240ca7d0 2023-10-14T12:33:39.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372a311700 1 --2- 172.21.15.72:0/1456392717 >> v2:172.21.15.123:3300/0 conn(0x7f372406a820 0x7f37240cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:39.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372ab12700 1 --2- 172.21.15.72:0/1456392717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37240ca7d0 0x7f3724071ea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3724067df0 tx=0x7f371c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3eb20a753afeca9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372930f700 1 -- 172.21.15.72:0/1456392717 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00e070 con 0x7f37240ca7d0 2023-10-14T12:33:39.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372930f700 1 -- 172.21.15.72:0/1456392717 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c00b9c0 con 0x7f37240ca7d0 2023-10-14T12:33:39.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.407+0000 7f372930f700 1 -- 172.21.15.72:0/1456392717 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00bd70 con 0x7f37240ca7d0 2023-10-14T12:33:39.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.408+0000 7f372c575700 1 -- 172.21.15.72:0/1456392717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37240ca7d0 msgr2=0x7f3724071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.408+0000 7f372c575700 1 --2- 172.21.15.72:0/1456392717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37240ca7d0 0x7f3724071ea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3724067df0 tx=0x7f371c00b330 comp rx=0 tx=0).stop 2023-10-14T12:33:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.408+0000 7f372c575700 1 -- 172.21.15.72:0/1456392717 shutdown_connections 2023-10-14T12:33:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.408+0000 7f372c575700 1 --2- 172.21.15.72:0/1456392717 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37240ca7d0 0x7f3724071ea0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.408+0000 7f372c575700 1 --2- 172.21.15.72:0/1456392717 >> v2:172.21.15.123:3300/0 conn(0x7f372406a820 0x7f37240cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.408+0000 7f372c575700 1 --2- 172.21.15.72:0/1456392717 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f372415e7f0 0x7f372406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.408+0000 7f372c575700 1 -- 172.21.15.72:0/1456392717 >> 172.21.15.72:0/1456392717 conn(0x7f37240d0180 msgr2=0x7f37240d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.408+0000 7f372c575700 1 -- 172.21.15.72:0/1456392717 shutdown_connections 2023-10-14T12:33:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.408+0000 7f372c575700 1 -- 172.21.15.72:0/1456392717 wait complete. 2023-10-14T12:33:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.409+0000 7f372c575700 1 Processor -- start 2023-10-14T12:33:39.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.409+0000 7f372c575700 1 -- start start 2023-10-14T12:33:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372c575700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f372406a820 0x7f3724146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372c575700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37240ca7d0 0x7f37241492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372c575700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372415e7f0 0x7f372406e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372c575700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3724146670 con 0x7f372406a820 2023-10-14T12:33:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372c575700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372406d1a0 con 0x7f372415e7f0 2023-10-14T12:33:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372c575700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372406d480 con 0x7f37240ca7d0 2023-10-14T12:33:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372a311700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f372406a820 0x7f3724146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372a311700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f372406a820 0x7f3724146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46368/0 (socket says 172.21.15.72:46368) 2023-10-14T12:33:39.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372a311700 1 -- 172.21.15.72:0/3945367732 learned_addr learned my addr 172.21.15.72:0/3945367732 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f3729b10700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37240ca7d0 0x7f37241492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372a311700 1 -- 172.21.15.72:0/3945367732 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37240ca7d0 msgr2=0x7f37241492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372ab12700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372415e7f0 0x7f372406e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.410+0000 7f372a311700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37240ca7d0 0x7f37241492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f372a311700 1 -- 172.21.15.72:0/3945367732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372415e7f0 msgr2=0x7f372406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f372a311700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372415e7f0 0x7f372406e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f372a311700 1 -- 172.21.15.72:0/3945367732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c009b30 con 0x7f372406a820 2023-10-14T12:33:39.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f372ab12700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372415e7f0 0x7f372406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:39.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f372a311700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f372406a820 0x7f3724146130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f371400e810 tx=0x7f371400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f371affd700 1 -- 172.21.15.72:0/3945367732 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714013610 con 0x7f372406a820 2023-10-14T12:33:39.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f371affd700 1 -- 172.21.15.72:0/3945367732 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3714013770 con 0x7f372406a820 2023-10-14T12:33:39.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f371affd700 1 -- 172.21.15.72:0/3945367732 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714013b20 con 0x7f372406a820 2023-10-14T12:33:39.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372406d760 con 0x7f372406a820 2023-10-14T12:33:39.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.411+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372406dd20 con 0x7f372406a820 2023-10-14T12:33:39.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.412+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372404ebb0 con 0x7f372406a820 2023-10-14T12:33:39.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.412+0000 7f371affd700 1 -- 172.21.15.72:0/3945367732 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3714013c80 con 0x7f372406a820 2023-10-14T12:33:39.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.412+0000 7f371affd700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f370806af00 0x7f370806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:39.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.413+0000 7f3729b10700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f370806af00 0x7f370806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:39.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.413+0000 7f371affd700 1 -- 172.21.15.72:0/3945367732 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37140895f0 con 0x7f372406a820 2023-10-14T12:33:39.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.413+0000 7f3729b10700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f370806af00 0x7f370806d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f37240cfcd0 tx=0x7f3720008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:39.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.417+0000 7f371affd700 1 -- 172.21.15.72:0/3945367732 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37140543b0 con 0x7f372406a820 2023-10-14T12:33:39.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.653+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f372406e090 con 0x7f372406a820 2023-10-14T12:33:39.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.654+0000 7f371affd700 1 -- 172.21.15.72:0/3945367732 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f37140579d0 con 0x7f372406a820 2023-10-14T12:33:39.655 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:33:39.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.655+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f370806af00 msgr2=0x7f370806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.655+0000 7f372c575700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f370806af00 0x7f370806d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f37240cfcd0 tx=0x7f3720008040 comp rx=0 tx=0).stop 2023-10-14T12:33:39.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.655+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f372406a820 msgr2=0x7f3724146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.655+0000 7f372c575700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f372406a820 0x7f3724146130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f371400e810 tx=0x7f371400ebd0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.655+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 shutdown_connections 2023-10-14T12:33:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.656+0000 7f372c575700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f370806af00 0x7f370806d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.656+0000 7f372c575700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372415e7f0 0x7f372406e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.656+0000 7f372c575700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f372406a820 0x7f3724146130 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.656+0000 7f372c575700 1 --2- 172.21.15.72:0/3945367732 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f37240ca7d0 0x7f37241492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:39.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.656+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 >> 172.21.15.72:0/3945367732 conn(0x7f37240d0180 msgr2=0x7f37240cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:39.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.656+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 shutdown_connections 2023-10-14T12:33:39.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:39.656+0000 7f372c575700 1 -- 172.21.15.72:0/3945367732 wait complete. 2023-10-14T12:33:39.669 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T12:33:39.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:33:39.670 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-10-14T12:33:39.670 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-14T12:33:39.670 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:33:39.670 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T12:33:39.671 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:33:39.671 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:33:39.671 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-14T12:33:39.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:39.672 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-10-14T12:33:39.689 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:33:39.689 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:33:39.689 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:33:39.690 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:33:39.690 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T12:33:39.690 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:33:39.690 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:33:39.690 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:33:39.691 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:33:39.691 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:33:39.691 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:33:39.691 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:33:39.691 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:33:39.693 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:33:39.693 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:33:39.693 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42410sec preferred_lft 42410sec 2023-10-14T12:33:39.693 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e497:c464:2199:335/64 scope link noprefixroute 2023-10-14T12:33:39.694 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:33:39.694 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T12:33:39.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:39.695 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:33:39.695 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:33:39.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-10-14T12:33:39.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-10-14T12:33:39.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-10-14T12:33:39.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T12:33:39.698 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:33:39.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:39.851 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:33:39.879 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-14T12:33:39.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:39.881 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-10-14T12:33:39.949 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-10-14T12:33:39.950 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:33:39.950 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:33:39.950 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:33:39.950 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:33:39.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:39.951 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:33:39.952 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:33:39.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:33:39.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:33:39.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:33:39.953 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:33:40.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:40.227 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T12:33:40.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:40.245 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-10-14T12:33:40.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:40.301 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:33:40.301 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:33:40.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:33:40.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-14T12:33:40.302 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:33:40.394 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-14T12:33:40.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:40.395 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:33:40.396 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:33:40.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-14T12:33:40.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T12:33:40.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-14T12:33:40.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-14T12:33:40.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-14T12:33:40.398 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:33:40.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:40.607 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:33:40.608 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:33:40.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-10-14T12:33:40.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T12:33:40.609 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:33:40.731 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-14T12:33:40.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:33:40.732 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:33:40.749 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-14T12:33:40.749 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:33:40.750 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:33:40.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-10-14T12:33:40.873 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:33:40.930 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-10-14T12:33:40.931 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-10-14T12:33:40.931 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-10-14T12:33:40.931 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-10-14T12:33:40.931 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-10-14T12:33:40.931 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-10-14T12:33:40.932 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-10-14T12:33:40.932 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-10-14T12:33:40.932 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/systemd 2023-10-14T12:33:40.932 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-10-14T12:33:40.932 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-10-14T12:33:40.933 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/blkio 2023-10-14T12:33:40.933 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/cpuset 2023-10-14T12:33:40.933 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/pids 2023-10-14T12:33:40.933 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/devices 2023-10-14T12:33:40.933 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-14T12:33:40.934 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/hugetlb 2023-10-14T12:33:40.934 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-14T12:33:40.934 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/freezer 2023-10-14T12:33:40.934 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/perf_event 2023-10-14T12:33:40.934 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/memory 2023-10-14T12:33:40.935 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/rdma 2023-10-14T12:33:40.935 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-10-14T12:33:40.935 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-10-14T12:33:40.935 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-10-14T12:33:40.935 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-10-14T12:33:40.936 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-10-14T12:33:40.936 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-10-14T12:33:40.936 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:33:40.936 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-10-14T12:33:40.936 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-10-14T12:33:40.936 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:33:40.937 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-10-14T12:33:40.937 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-10-14T12:33:40.937 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:33:40.937 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:33:40.937 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:33:40.938 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:33:40.938 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-10-14T12:33:40.938 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:33:40.938 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:33:40.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:40.939 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-10-14T12:33:40.987 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T12:33:40.988 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-14T12:33:41.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-10-14T12:33:41.057 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:33:41.114 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2023-10-14T12:33:41.114 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2023-10-14T12:33:41.114 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2023-10-14T12:33:41.114 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2023-10-14T12:33:41.115 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2023-10-14T12:33:41.115 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2023-10-14T12:33:41.115 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2023-10-14T12:33:41.115 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2023-10-14T12:33:41.116 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/systemd 2023-10-14T12:33:41.116 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2023-10-14T12:33:41.116 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2023-10-14T12:33:41.116 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/blkio 2023-10-14T12:33:41.116 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/cpuset 2023-10-14T12:33:41.116 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/pids 2023-10-14T12:33:41.117 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/devices 2023-10-14T12:33:41.117 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-14T12:33:41.117 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/hugetlb 2023-10-14T12:33:41.117 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-14T12:33:41.117 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/freezer 2023-10-14T12:33:41.118 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/perf_event 2023-10-14T12:33:41.118 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/memory 2023-10-14T12:33:41.118 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup/rdma 2023-10-14T12:33:41.118 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2023-10-14T12:33:41.118 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2023-10-14T12:33:41.119 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2023-10-14T12:33:41.119 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2023-10-14T12:33:41.119 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2023-10-14T12:33:41.119 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2023-10-14T12:33:41.120 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:33:41.120 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2023-10-14T12:33:41.120 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2023-10-14T12:33:41.120 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:33:41.120 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2023-10-14T12:33:41.121 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2023-10-14T12:33:41.121 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:33:41.121 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:33:41.121 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:33:41.121 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:33:41.122 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2023-10-14T12:33:41.122 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:33:41.122 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:33:41.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:41.123 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-10-14T12:33:41.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:2023-10-14T12:33:41.129+0000 7f79abec85c0 -1 init, newargv = 0x56490122b450 newargc=15 2023-10-14T12:33:41.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[111522]: starting ceph client 2023-10-14T12:33:41.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[111522]: starting fuse 2023-10-14T12:33:41.147 INFO:teuthology.orchestra.run.smithi072.stdout:46 2023-10-14T12:33:41.147 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-14T12:33:41.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2023-10-14T12:33:41.148 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-10-14T12:33:41.148 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-10-14T12:33:41.149 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-10-14T12:33:41.149 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-10-14T12:33:41.150 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-14T12:33:41.151 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-10-14T12:33:41.151 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-14T12:33:41.151 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-10-14T12:33:41.152 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-14T12:33:41.152 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-14T12:33:41.152 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-10-14T12:33:41.153 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-10-14T12:33:41.153 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-10-14T12:33:41.153 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-10-14T12:33:41.154 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-14T12:33:41.154 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-10-14T12:33:41.155 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T12:33:41.155 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T12:33:41.155 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T12:33:41.156 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-10-14T12:33:41.156 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-10-14T12:33:41.156 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-10-14T12:33:41.157 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T12:33:41.157 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-14T12:33:41.157 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.admin")) 2023-10-14T12:33:41.158 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-10-14T12:33:41.270 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.admin.111522.asok 2023-10-14T12:33:41.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T12:33:41.279 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.111522.asok 2023-10-14T12:33:41.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:41.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.111522.asok status 2023-10-14T12:33:41.434 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:33:41.435 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-10-14T12:33:41.435 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T12:33:41.435 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T12:33:41.435 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "admin", 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "111522", 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-10-14T12:33:41.437 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-10-14T12:33:41.437 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4416, 2023-10-14T12:33:41.437 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-10-14T12:33:41.437 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-10-14T12:33:41.438 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-10-14T12:33:41.438 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4416 2023-10-14T12:33:41.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:33:41.438 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1688655183 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1688655183 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4416 192.168.0.1:0/1688655183", 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/1688655183", 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 7, 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 24, 2023-10-14T12:33:41.442 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-10-14T12:33:41.442 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-10-14T12:33:41.442 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-10-14T12:33:41.442 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:33:41.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:41.445 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-10-14T12:33:41.445 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:33:41.462 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-10-14T12:33:41.463 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:33:41.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:41.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:33:41.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:41.531 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-14T12:33:41.638 INFO:teuthology.orchestra.run.smithi072.stdout:# file: . 2023-10-14T12:33:41.638 INFO:teuthology.orchestra.run.smithi072.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-14T12:33:41.638 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:41.639 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:41.639 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:33:41.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.815+0000 7f0dd0184700 1 Processor -- start 2023-10-14T12:33:41.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.816+0000 7f0dd0184700 1 -- start start 2023-10-14T12:33:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.816+0000 7f0dd0184700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0dc8152470 0x7f0dc80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.816+0000 7f0dd0184700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc8070d70 con 0x7f0dc80b3410 2023-10-14T12:33:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.816+0000 7f0dd0184700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc815c990 con 0x7f0dc80cb8d0 2023-10-14T12:33:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.816+0000 7f0dd0184700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc8071200 con 0x7f0dc8152470 2023-10-14T12:33:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dce721700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0dc80b3410 0x7f0dc80b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52694/0 (socket says 172.21.15.72:52694) 2023-10-14T12:33:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dce721700 1 -- 172.21.15.72:0/3625062339 learned_addr learned my addr 172.21.15.72:0/3625062339 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dcdf20700 1 --2- 172.21.15.72:0/3625062339 >> v2:172.21.15.123:3300/0 conn(0x7f0dc8152470 0x7f0dc80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dccf1e700 1 -- 172.21.15.72:0/3625062339 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538797669 0 0) 0x7f0dc8070d70 con 0x7f0dc80b3410 2023-10-14T12:33:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dccf1e700 1 -- 172.21.15.72:0/3625062339 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db40035b0 con 0x7f0dc80b3410 2023-10-14T12:33:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dcdf20700 1 -- 172.21.15.72:0/3625062339 >> v1:172.21.15.123:6789/0 conn(0x7f0dc80cb8d0 legacy=0x7f0dc80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dcdf20700 1 -- 172.21.15.72:0/3625062339 >> v1:172.21.15.72:6789/0 conn(0x7f0dc80b3410 legacy=0x7f0dc80b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dcdf20700 1 -- 172.21.15.72:0/3625062339 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80cbd80 con 0x7f0dc8152470 2023-10-14T12:33:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dcdf20700 1 --2- 172.21.15.72:0/3625062339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc8152470 0x7f0dc80cd570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009840 tx=0x7f0db8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49845a95fa9e435e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dccf1e700 1 -- 172.21.15.72:0/3625062339 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8011830 con 0x7f0dc8152470 2023-10-14T12:33:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dccf1e700 1 -- 172.21.15.72:0/3625062339 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db8011990 con 0x7f0dc8152470 2023-10-14T12:33:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.817+0000 7f0dccf1e700 1 -- 172.21.15.72:0/3625062339 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8011d20 con 0x7f0dc8152470 2023-10-14T12:33:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.818+0000 7f0dd0184700 1 -- 172.21.15.72:0/3625062339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc8152470 msgr2=0x7f0dc80cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.818+0000 7f0dd0184700 1 --2- 172.21.15.72:0/3625062339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc8152470 0x7f0dc80cd570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009840 tx=0x7f0db8009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.818+0000 7f0dd0184700 1 -- 172.21.15.72:0/3625062339 shutdown_connections 2023-10-14T12:33:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.818+0000 7f0dd0184700 1 --2- 172.21.15.72:0/3625062339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc8152470 0x7f0dc80cd570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.818+0000 7f0dd0184700 1 -- 172.21.15.72:0/3625062339 >> 172.21.15.72:0/3625062339 conn(0x7f0dc80cdd00 msgr2=0x7f0dc80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.818+0000 7f0dd0184700 1 -- 172.21.15.72:0/3625062339 shutdown_connections 2023-10-14T12:33:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.818+0000 7f0dd0184700 1 -- 172.21.15.72:0/3625062339 wait complete. 2023-10-14T12:33:41.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.819+0000 7f0dd0184700 1 Processor -- start 2023-10-14T12:33:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.819+0000 7f0dd0184700 1 -- start start 2023-10-14T12:33:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dd0184700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc80b3410 0x7f0dc80c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dd0184700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc80cb8d0 0x7f0dc80c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dd0184700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0dc8152470 0x7f0dc8154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:41.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dd0184700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8146b70 con 0x7f0dc80b3410 2023-10-14T12:33:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dd0184700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80c7c10 con 0x7f0dc80cb8d0 2023-10-14T12:33:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dd0184700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc80c6a40 con 0x7f0dc8152470 2023-10-14T12:33:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcdf20700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc80b3410 0x7f0dc80c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcdf20700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc80b3410 0x7f0dc80c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46396/0 (socket says 172.21.15.72:46396) 2023-10-14T12:33:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcdf20700 1 -- 172.21.15.72:0/650893563 learned_addr learned my addr 172.21.15.72:0/650893563 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:41.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dce721700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0dc8152470 0x7f0dc8154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:41.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcd71f700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc80cb8d0 0x7f0dc80c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:41.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcdf20700 1 -- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0dc8152470 msgr2=0x7f0dc8154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:41.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcdf20700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0dc8152470 0x7f0dc8154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:41.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcdf20700 1 -- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc80cb8d0 msgr2=0x7f0dc80c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:41.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcdf20700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc80cb8d0 0x7f0dc80c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:41.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcdf20700 1 -- 172.21.15.72:0/650893563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db80094a0 con 0x7f0dc80b3410 2023-10-14T12:33:41.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dce721700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0dc8152470 0x7f0dc8154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:41.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.820+0000 7f0dcd71f700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc80cb8d0 0x7f0dc80c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:41.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.821+0000 7f0dcdf20700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc80b3410 0x7f0dc80c57c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0db80090b0 tx=0x7f0db8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.821+0000 7f0dbe7fc700 1 -- 172.21.15.72:0/650893563 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db80038a0 con 0x7f0dc80b3410 2023-10-14T12:33:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.821+0000 7f0dbe7fc700 1 -- 172.21.15.72:0/650893563 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db801f070 con 0x7f0dc80b3410 2023-10-14T12:33:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.821+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc80c5ec0 con 0x7f0dc80b3410 2023-10-14T12:33:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.821+0000 7f0dbe7fc700 1 -- 172.21.15.72:0/650893563 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8003c40 con 0x7f0dc80b3410 2023-10-14T12:33:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.821+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc80c6480 con 0x7f0dc80b3410 2023-10-14T12:33:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.822+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc80c93a0 con 0x7f0dc80b3410 2023-10-14T12:33:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.822+0000 7f0dbe7fc700 1 -- 172.21.15.72:0/650893563 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0db8026480 con 0x7f0dc80b3410 2023-10-14T12:33:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.822+0000 7f0dbe7fc700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0dac06af00 0x7f0dac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.823+0000 7f0dbe7fc700 1 -- 172.21.15.72:0/650893563 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0db8021070 con 0x7f0dc80b3410 2023-10-14T12:33:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.823+0000 7f0dcd71f700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0dac06af00 0x7f0dac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.823+0000 7f0dcd71f700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0dac06af00 0x7f0dac06d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0dc81593e0 tx=0x7f0dc4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:41.827+0000 7f0dbe7fc700 1 -- 172.21.15.72:0/650893563 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0db8055fe0 con 0x7f0dc80b3410 2023-10-14T12:33:42.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.017+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dc804ebb0 con 0x7f0dc80b3410 2023-10-14T12:33:42.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.019+0000 7f0dbe7fc700 1 -- 172.21.15.72:0/650893563 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f0db8059600 con 0x7f0dc80b3410 2023-10-14T12:33:42.020 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:42.021 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:42.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0dac06af00 msgr2=0x7f0dac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0dac06af00 0x7f0dac06d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0dc81593e0 tx=0x7f0dc4009040 comp rx=0 tx=0).stop 2023-10-14T12:33:42.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc80b3410 msgr2=0x7f0dc80c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc80b3410 0x7f0dc80c57c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0db80090b0 tx=0x7f0db8004750 comp rx=0 tx=0).stop 2023-10-14T12:33:42.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 shutdown_connections 2023-10-14T12:33:42.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0dac06af00 0x7f0dac06d3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0dc8152470 0x7f0dc8154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dc80b3410 0x7f0dc80c57c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 --2- 172.21.15.72:0/650893563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0dc80cb8d0 0x7f0dc80c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 >> 172.21.15.72:0/650893563 conn(0x7f0dc80cdd00 msgr2=0x7f0dc815acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:42.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 shutdown_connections 2023-10-14T12:33:42.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.021+0000 7f0dd0184700 1 -- 172.21.15.72:0/650893563 wait complete. 2023-10-14T12:33:42.034 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:33:42.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:33:42.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.157+0000 7ff26ea09700 1 Processor -- start 2023-10-14T12:33:42.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.157+0000 7ff26ea09700 1 -- start start 2023-10-14T12:33:42.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff26ea09700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2680ce440 0x7ff26815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff26ea09700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff268161360 con 0x7ff26806a820 2023-10-14T12:33:42.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff26ea09700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26806b750 con 0x7ff26806b370 2023-10-14T12:33:42.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff26ea09700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26806dcc0 con 0x7ff2680ce440 2023-10-14T12:33:42.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff2677fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff26806a820 0x7ff2680cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52704/0 (socket says 172.21.15.72:52704) 2023-10-14T12:33:42.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff2677fe700 1 -- 172.21.15.72:0/3469571148 learned_addr learned my addr 172.21.15.72:0/3469571148 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:42.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254589327 0 0) 0x7ff268161360 con 0x7ff26806a820 2023-10-14T12:33:42.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff26cfa6700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2680ce440 0x7ff26815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2500035b0 con 0x7ff26806a820 2023-10-14T12:33:42.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2688449175 0 0) 0x7ff2500035b0 con 0x7ff26806a820 2023-10-14T12:33:42.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2680ce440 msgr2=0x7ff26815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:42.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2680ce440 0x7ff26815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 >> v1:172.21.15.123:6789/0 conn(0x7ff26806b370 legacy=0x7ff26806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26815e300 con 0x7ff26806a820 2023-10-14T12:33:42.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7ff25c001670 con 0x7ff26806a820 2023-10-14T12:33:42.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 >> v1:172.21.15.72:6789/0 conn(0x7ff26806a820 legacy=0x7ff2680cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff250003a30 0x7ff250003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2500043e0 0x7ff2500048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2680ce440 0x7ff250005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26806dcc0 con 0x7ff2500043e0 2023-10-14T12:33:42.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25000ba40 con 0x7ff250003a30 2023-10-14T12:33:42.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25000bc00 con 0x7ff2680ce440 2023-10-14T12:33:42.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.158+0000 7ff2677fe700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2500043e0 0x7ff2500048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff267fff700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff250003a30 0x7ff250003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff26cfa6700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2680ce440 0x7ff250005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff2677fe700 1 -- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2680ce440 msgr2=0x7ff250005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:42.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff2677fe700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2680ce440 0x7ff250005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff2677fe700 1 -- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff250003a30 msgr2=0x7ff250003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:42.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff2677fe700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff250003a30 0x7ff250003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff2677fe700 1 -- 172.21.15.72:0/3469571148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2500035b0 con 0x7ff2500043e0 2023-10-14T12:33:42.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff267fff700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff250003a30 0x7ff250003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:42.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff26cfa6700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2680ce440 0x7ff250005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:42.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff2677fe700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2500043e0 0x7ff2500048b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c210 tx=0x7ff250005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51583341a5ef417 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:42.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00cdb0 con 0x7ff2500043e0 2023-10-14T12:33:42.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c007ba0 con 0x7ff2500043e0 2023-10-14T12:33:42.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff266ffd700 1 -- 172.21.15.72:0/3469571148 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c005ba0 con 0x7ff2500043e0 2023-10-14T12:33:42.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff26ea09700 1 -- 172.21.15.72:0/3469571148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2500043e0 msgr2=0x7ff2500048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff26ea09700 1 --2- 172.21.15.72:0/3469571148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2500043e0 0x7ff2500048b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c210 tx=0x7ff250005880 comp rx=0 tx=0).stop 2023-10-14T12:33:42.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff26cfa6700 1 -- 172.21.15.72:0/3469571148 reap_dead start 2023-10-14T12:33:42.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff26ea09700 1 -- 172.21.15.72:0/3469571148 shutdown_connections 2023-10-14T12:33:42.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.159+0000 7ff26ea09700 1 -- 172.21.15.72:0/3469571148 >> 172.21.15.72:0/3469571148 conn(0x7ff2680ccbe0 msgr2=0x7ff2680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:42.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.160+0000 7ff26ea09700 1 -- 172.21.15.72:0/3469571148 shutdown_connections 2023-10-14T12:33:42.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.160+0000 7ff26ea09700 1 -- 172.21.15.72:0/3469571148 wait complete. 2023-10-14T12:33:42.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.161+0000 7ff26ea09700 1 Processor -- start 2023-10-14T12:33:42.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.161+0000 7ff26ea09700 1 -- start start 2023-10-14T12:33:42.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26ea09700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2500043e0 0x7ff2680b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26ea09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2681561a0 0x7ff2680aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26ea09700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff268156620 0x7ff2680af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26ea09700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680b47b0 con 0x7ff2681561a0 2023-10-14T12:33:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26ea09700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680b4a50 con 0x7ff268156620 2023-10-14T12:33:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26ea09700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2680b4d30 con 0x7ff2500043e0 2023-10-14T12:33:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff2677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2681561a0 0x7ff2680aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff2677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2681561a0 0x7ff2680aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46418/0 (socket says 172.21.15.72:46418) 2023-10-14T12:33:42.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff2677fe700 1 -- 172.21.15.72:0/4024156851 learned_addr learned my addr 172.21.15.72:0/4024156851 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:42.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff267fff700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2500043e0 0x7ff2680b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26cfa6700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff268156620 0x7ff2680af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff2677fe700 1 -- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2500043e0 msgr2=0x7ff2680b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff2677fe700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2500043e0 0x7ff2680b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff2677fe700 1 -- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff268156620 msgr2=0x7ff2680af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff2677fe700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff268156620 0x7ff2680af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff2677fe700 1 -- 172.21.15.72:0/4024156851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2680b5010 con 0x7ff2681561a0 2023-10-14T12:33:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26cfa6700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff268156620 0x7ff2680af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff267fff700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2500043e0 0x7ff2680b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:42.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff2677fe700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2681561a0 0x7ff2680aec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c800 tx=0x7ff26815e1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:42.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff264ff9700 1 -- 172.21.15.72:0/4024156851 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c004c80 con 0x7ff2681561a0 2023-10-14T12:33:42.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff264ff9700 1 -- 172.21.15.72:0/4024156851 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c004de0 con 0x7ff2681561a0 2023-10-14T12:33:42.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff264ff9700 1 -- 172.21.15.72:0/4024156851 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0072f0 con 0x7ff2681561a0 2023-10-14T12:33:42.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2680b52f0 con 0x7ff2681561a0 2023-10-14T12:33:42.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.162+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2680b3250 con 0x7ff2681561a0 2023-10-14T12:33:42.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.163+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2680b5660 con 0x7ff2681561a0 2023-10-14T12:33:42.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.164+0000 7ff264ff9700 1 -- 172.21.15.72:0/4024156851 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff25c019070 con 0x7ff2681561a0 2023-10-14T12:33:42.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.164+0000 7ff264ff9700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff25406af00 0x7ff25406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.164+0000 7ff264ff9700 1 -- 172.21.15.72:0/4024156851 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff25c089d30 con 0x7ff2681561a0 2023-10-14T12:33:42.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.164+0000 7ff267fff700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff25406af00 0x7ff25406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.165+0000 7ff267fff700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff25406af00 0x7ff25406d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2580011a0 tx=0x7ff258009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:42.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.169+0000 7ff264ff9700 1 -- 172.21.15.72:0/4024156851 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff25c054b80 con 0x7ff2681561a0 2023-10-14T12:33:42.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.358+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff268072d10 con 0x7ff2681561a0 2023-10-14T12:33:42.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.359+0000 7ff264ff9700 1 -- 172.21.15.72:0/4024156851 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff25c0581a0 con 0x7ff2681561a0 2023-10-14T12:33:42.360 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:33:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.360+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff25406af00 msgr2=0x7ff25406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.360+0000 7ff26ea09700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff25406af00 0x7ff25406d3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2580011a0 tx=0x7ff258009040 comp rx=0 tx=0).stop 2023-10-14T12:33:42.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.360+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2681561a0 msgr2=0x7ff2680aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.360+0000 7ff26ea09700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2681561a0 0x7ff2680aec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c800 tx=0x7ff26815e1f0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.361+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 shutdown_connections 2023-10-14T12:33:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.361+0000 7ff26ea09700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff25406af00 0x7ff25406d3c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.361+0000 7ff26ea09700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff268156620 0x7ff2680af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.361+0000 7ff26ea09700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff2500043e0 0x7ff2680b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.361+0000 7ff26ea09700 1 --2- 172.21.15.72:0/4024156851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2681561a0 0x7ff2680aec40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.361+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 >> 172.21.15.72:0/4024156851 conn(0x7ff2680ccbe0 msgr2=0x7ff268157320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.361+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 shutdown_connections 2023-10-14T12:33:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.361+0000 7ff26ea09700 1 -- 172.21.15.72:0/4024156851 wait complete. 2023-10-14T12:33:42.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:33:42.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.496+0000 7feae864e700 1 Processor -- start 2023-10-14T12:33:42.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.496+0000 7feae864e700 1 -- start start 2023-10-14T12:33:42.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.497+0000 7feae864e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015a250 0x7feae00717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.497+0000 7feae864e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feae015dec0 0x7feae006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.497+0000 7feae864e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae00cba90 con 0x7feae015e320 2023-10-14T12:33:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.497+0000 7feae864e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae00cb510 con 0x7feae015dec0 2023-10-14T12:33:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.497+0000 7feae864e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae015ee40 con 0x7feae015a250 2023-10-14T12:33:42.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae5be9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feae015dec0 0x7feae006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae5be9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feae015dec0 0x7feae006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46426/0 (socket says 172.21.15.72:46426) 2023-10-14T12:33:42.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae5be9700 1 -- 172.21.15.72:0/758294556 learned_addr learned my addr 172.21.15.72:0/758294556 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:42.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae63ea700 1 --2- 172.21.15.72:0/758294556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015a250 0x7feae00717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae5be9700 1 -- 172.21.15.72:0/758294556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015a250 msgr2=0x7feae00717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:42.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae5be9700 1 --2- 172.21.15.72:0/758294556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015a250 0x7feae00717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae5be9700 1 -- 172.21.15.72:0/758294556 >> v1:172.21.15.123:6789/0 conn(0x7feae015e320 legacy=0x7feae00cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae5be9700 1 -- 172.21.15.72:0/758294556 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae015e880 con 0x7feae015dec0 2023-10-14T12:33:42.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae63ea700 1 --2- 172.21.15.72:0/758294556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015a250 0x7feae00717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:42.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae5be9700 1 --2- 172.21.15.72:0/758294556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 0x7feae006d5b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feadc0098f0 tx=0x7feadc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14649af660614553 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:42.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae53e8700 1 -- 172.21.15.72:0/758294556 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00b8a0 con 0x7feae015dec0 2023-10-14T12:33:42.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae53e8700 1 -- 172.21.15.72:0/758294556 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc00ba00 con 0x7feae015dec0 2023-10-14T12:33:42.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.498+0000 7feae53e8700 1 -- 172.21.15.72:0/758294556 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00bd90 con 0x7feae015dec0 2023-10-14T12:33:42.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.499+0000 7feae864e700 1 -- 172.21.15.72:0/758294556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 msgr2=0x7feae006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.499+0000 7feae864e700 1 --2- 172.21.15.72:0/758294556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 0x7feae006d5b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feadc0098f0 tx=0x7feadc009c00 comp rx=0 tx=0).stop 2023-10-14T12:33:42.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.499+0000 7feae864e700 1 -- 172.21.15.72:0/758294556 shutdown_connections 2023-10-14T12:33:42.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.499+0000 7feae864e700 1 --2- 172.21.15.72:0/758294556 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015a250 0x7feae00717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.499+0000 7feae864e700 1 --2- 172.21.15.72:0/758294556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 0x7feae006d5b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.499+0000 7feae864e700 1 -- 172.21.15.72:0/758294556 >> 172.21.15.72:0/758294556 conn(0x7feae00ccbe0 msgr2=0x7feae00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:42.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.499+0000 7feae864e700 1 -- 172.21.15.72:0/758294556 shutdown_connections 2023-10-14T12:33:42.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.499+0000 7feae864e700 1 -- 172.21.15.72:0/758294556 wait complete. 2023-10-14T12:33:42.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.500+0000 7feae864e700 1 Processor -- start 2023-10-14T12:33:42.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.500+0000 7feae864e700 1 -- start start 2023-10-14T12:33:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae864e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae015a250 0x7feae01501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae864e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 0x7feae00c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae864e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015e320 0x7feae00c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae864e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae01f41f0 con 0x7feae015dec0 2023-10-14T12:33:42.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae864e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae01f3810 con 0x7feae015a250 2023-10-14T12:33:42.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae864e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae01f3af0 con 0x7feae015e320 2023-10-14T12:33:42.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae5be9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 0x7feae00c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae5be9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 0x7feae00c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46432/0 (socket says 172.21.15.72:46432) 2023-10-14T12:33:42.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae5be9700 1 -- 172.21.15.72:0/2085292169 learned_addr learned my addr 172.21.15.72:0/2085292169 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:42.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae63ea700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae015a250 0x7feae01501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae6beb700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015e320 0x7feae00c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae5be9700 1 -- 172.21.15.72:0/2085292169 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015e320 msgr2=0x7feae00c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae5be9700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015e320 0x7feae00c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae5be9700 1 -- 172.21.15.72:0/2085292169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae015a250 msgr2=0x7feae01501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae5be9700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae015a250 0x7feae01501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae5be9700 1 -- 172.21.15.72:0/2085292169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc009550 con 0x7feae015dec0 2023-10-14T12:33:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae6beb700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015e320 0x7feae00c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae5be9700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 0x7feae00c4860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feadc014040 tx=0x7feadc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:42.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7fead6ffd700 1 -- 172.21.15.72:0/2085292169 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc004590 con 0x7feae015dec0 2023-10-14T12:33:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7fead6ffd700 1 -- 172.21.15.72:0/2085292169 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc01e070 con 0x7feae015dec0 2023-10-14T12:33:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae01506f0 con 0x7feae015dec0 2023-10-14T12:33:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7fead6ffd700 1 -- 172.21.15.72:0/2085292169 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0038e0 con 0x7feae015dec0 2023-10-14T12:33:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.501+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae00b15a0 con 0x7feae015dec0 2023-10-14T12:33:42.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.502+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae01f44e0 con 0x7feae015dec0 2023-10-14T12:33:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.503+0000 7fead6ffd700 1 -- 172.21.15.72:0/2085292169 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feadc003a40 con 0x7feae015dec0 2023-10-14T12:33:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.503+0000 7fead6ffd700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feac406af00 0x7feac406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.503+0000 7fead6ffd700 1 -- 172.21.15.72:0/2085292169 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feadc020070 con 0x7feae015dec0 2023-10-14T12:33:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.503+0000 7feae63ea700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feac406af00 0x7feac406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.503+0000 7feae63ea700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feac406af00 0x7feac406d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fead0006f10 tx=0x7fead0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:42.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.508+0000 7fead6ffd700 1 -- 172.21.15.72:0/2085292169 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feadc055aa0 con 0x7feae015dec0 2023-10-14T12:33:42.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.698+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feae00b1730 con 0x7feae015dec0 2023-10-14T12:33:42.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.698+0000 7fead6ffd700 1 -- 172.21.15.72:0/2085292169 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7feadc0590c0 con 0x7feae015dec0 2023-10-14T12:33:42.700 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:33:42.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feac406af00 msgr2=0x7feac406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feac406af00 0x7feac406d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fead0006f10 tx=0x7fead0008040 comp rx=0 tx=0).stop 2023-10-14T12:33:42.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 msgr2=0x7feae00c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 0x7feae00c4860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feadc014040 tx=0x7feadc004750 comp rx=0 tx=0).stop 2023-10-14T12:33:42.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 shutdown_connections 2023-10-14T12:33:42.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feac406af00 0x7feac406d3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feae015e320 0x7feae00c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae015a250 0x7feae01501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 --2- 172.21.15.72:0/2085292169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feae015dec0 0x7feae00c4860 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 >> 172.21.15.72:0/2085292169 conn(0x7feae00ccbe0 msgr2=0x7feae006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 shutdown_connections 2023-10-14T12:33:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.700+0000 7feae864e700 1 -- 172.21.15.72:0/2085292169 wait complete. 2023-10-14T12:33:42.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:33:42.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.834+0000 7fbb233a3700 1 Processor -- start 2023-10-14T12:33:42.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.835+0000 7fbb233a3700 1 -- start start 2023-10-14T12:33:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.835+0000 7fbb233a3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb1c15a250 0x7fbb1c0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.835+0000 7fbb233a3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c0cba90 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.835+0000 7fbb233a3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c15ee40 con 0x7fbb1c15dec0 2023-10-14T12:33:42.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.835+0000 7fbb233a3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c0cb510 con 0x7fbb1c15a250 2023-10-14T12:33:42.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb21940700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbb1c06dcc0 0x7fbb1c0cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52738/0 (socket says 172.21.15.72:52738) 2023-10-14T12:33:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb21940700 1 -- 172.21.15.72:0/2717560391 learned_addr learned my addr 172.21.15.72:0/2717560391 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb2113f700 1 --2- 172.21.15.72:0/2717560391 >> v2:172.21.15.123:3300/0 conn(0x7fbb1c15a250 0x7fbb1c0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb13fff700 1 -- 172.21.15.72:0/2717560391 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351135293 0 0) 0x7fbb1c0cba90 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb13fff700 1 -- 172.21.15.72:0/2717560391 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb080035b0 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb2113f700 1 -- 172.21.15.72:0/2717560391 >> v1:172.21.15.123:6789/0 conn(0x7fbb1c15dec0 legacy=0x7fbb1c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb2113f700 1 -- 172.21.15.72:0/2717560391 >> v1:172.21.15.72:6789/0 conn(0x7fbb1c06dcc0 legacy=0x7fbb1c0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb2113f700 1 -- 172.21.15.72:0/2717560391 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c15e880 con 0x7fbb1c15a250 2023-10-14T12:33:42.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb2113f700 1 --2- 172.21.15.72:0/2717560391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb1c15a250 0x7fbb1c0717b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009840 tx=0x7fbb0c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b43878a3fe119175 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:42.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb13fff700 1 -- 172.21.15.72:0/2717560391 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c011830 con 0x7fbb1c15a250 2023-10-14T12:33:42.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb13fff700 1 -- 172.21.15.72:0/2717560391 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c011990 con 0x7fbb1c15a250 2023-10-14T12:33:42.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.836+0000 7fbb13fff700 1 -- 172.21.15.72:0/2717560391 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c011d20 con 0x7fbb1c15a250 2023-10-14T12:33:42.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.837+0000 7fbb233a3700 1 -- 172.21.15.72:0/2717560391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb1c15a250 msgr2=0x7fbb1c0717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.837+0000 7fbb233a3700 1 --2- 172.21.15.72:0/2717560391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb1c15a250 0x7fbb1c0717b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009840 tx=0x7fbb0c009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:42.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.837+0000 7fbb233a3700 1 -- 172.21.15.72:0/2717560391 shutdown_connections 2023-10-14T12:33:42.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.837+0000 7fbb233a3700 1 --2- 172.21.15.72:0/2717560391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb1c15a250 0x7fbb1c0717b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.837+0000 7fbb233a3700 1 -- 172.21.15.72:0/2717560391 >> 172.21.15.72:0/2717560391 conn(0x7fbb1c0ccbe0 msgr2=0x7fbb1c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.837+0000 7fbb233a3700 1 -- 172.21.15.72:0/2717560391 shutdown_connections 2023-10-14T12:33:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.837+0000 7fbb233a3700 1 -- 172.21.15.72:0/2717560391 wait complete. 2023-10-14T12:33:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.838+0000 7fbb233a3700 1 Processor -- start 2023-10-14T12:33:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.838+0000 7fbb233a3700 1 -- start start 2023-10-14T12:33:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb233a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb1c06dcc0 0x7fbb1c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb233a3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb1c15a250 0x7fbb1c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb233a3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb1c15dec0 0x7fbb1c1f0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb233a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c15ca20 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb233a3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c1546e0 con 0x7fbb1c15dec0 2023-10-14T12:33:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb233a3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c154340 con 0x7fbb1c15a250 2023-10-14T12:33:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2113f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb1c06dcc0 0x7fbb1c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2113f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb1c06dcc0 0x7fbb1c15b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46444/0 (socket says 172.21.15.72:46444) 2023-10-14T12:33:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2113f700 1 -- 172.21.15.72:0/531590182 learned_addr learned my addr 172.21.15.72:0/531590182 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb21940700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb1c15dec0 0x7fbb1c1f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2093e700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb1c15a250 0x7fbb1c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2113f700 1 -- 172.21.15.72:0/531590182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb1c15a250 msgr2=0x7fbb1c0b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2113f700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb1c15a250 0x7fbb1c0b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2113f700 1 -- 172.21.15.72:0/531590182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb1c15dec0 msgr2=0x7fbb1c1f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:42.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2113f700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb1c15dec0 0x7fbb1c1f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:42.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2113f700 1 -- 172.21.15.72:0/531590182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0094a0 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.839+0000 7fbb2093e700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb1c15a250 0x7fbb1c0b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:42.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.840+0000 7fbb2113f700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb1c06dcc0 0x7fbb1c15b950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009fd0 tx=0x7fbb0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:42.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.840+0000 7fbb11ffb700 1 -- 172.21.15.72:0/531590182 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0038a0 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.840+0000 7fbb11ffb700 1 -- 172.21.15.72:0/531590182 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c01f070 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.840+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c15c180 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.840+0000 7fbb11ffb700 1 -- 172.21.15.72:0/531590182 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c003c40 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.840+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c15c740 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.841+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c04ebb0 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.841+0000 7fbb11ffb700 1 -- 172.21.15.72:0/531590182 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbb0c026480 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.842+0000 7fbb11ffb700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbb0006af00 0x7fbb0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:42.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.842+0000 7fbb11ffb700 1 -- 172.21.15.72:0/531590182 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb0c021070 con 0x7fbb1c06dcc0 2023-10-14T12:33:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.842+0000 7fbb2093e700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbb0006af00 0x7fbb0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.842+0000 7fbb2093e700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbb0006af00 0x7fbb0006d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c06b3a0 tx=0x7fbb18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:42.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:42.846+0000 7fbb11ffb700 1 -- 172.21.15.72:0/531590182 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbb0c0bdca0 con 0x7fbb1c06dcc0 2023-10-14T12:33:43.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.036+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb1c0b60e0 con 0x7fbb1c06dcc0 2023-10-14T12:33:43.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.036+0000 7fbb11ffb700 1 -- 172.21.15.72:0/531590182 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb0c055fe0 con 0x7fbb1c06dcc0 2023-10-14T12:33:43.038 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:33:43.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbb0006af00 msgr2=0x7fbb0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbb0006af00 0x7fbb0006d3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c06b3a0 tx=0x7fbb18009040 comp rx=0 tx=0).stop 2023-10-14T12:33:43.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb1c06dcc0 msgr2=0x7fbb1c15b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb1c06dcc0 0x7fbb1c15b950 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009fd0 tx=0x7fbb0c004750 comp rx=0 tx=0).stop 2023-10-14T12:33:43.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 shutdown_connections 2023-10-14T12:33:43.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbb0006af00 0x7fbb0006d3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb1c15dec0 0x7fbb1c1f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb1c06dcc0 0x7fbb1c15b950 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 --2- 172.21.15.72:0/531590182 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb1c15a250 0x7fbb1c0b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 >> 172.21.15.72:0/531590182 conn(0x7fbb1c0ccbe0 msgr2=0x7fbb1c0cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:43.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 shutdown_connections 2023-10-14T12:33:43.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.038+0000 7fbb233a3700 1 -- 172.21.15.72:0/531590182 wait complete. 2023-10-14T12:33:43.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:33:43.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.175+0000 7fcbd6626700 1 Processor -- start 2023-10-14T12:33:43.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.175+0000 7fcbd6626700 1 -- start start 2023-10-14T12:33:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.175+0000 7fcbd6626700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcbd015f8c0 0x7fcbd0167250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.175+0000 7fcbd6626700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd00cad30 con 0x7fcbd015ed30 2023-10-14T12:33:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.175+0000 7fcbd6626700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd00cb1c0 con 0x7fcbd006a820 2023-10-14T12:33:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.175+0000 7fcbd6626700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd00ca7b0 con 0x7fcbd015f8c0 2023-10-14T12:33:43.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbd4bc3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcbd015f8c0 0x7fcbd0167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbcf7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcbd015ed30 0x7fcbd015f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52754/0 (socket says 172.21.15.72:52754) 2023-10-14T12:33:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbcf7fe700 1 -- 172.21.15.72:0/124218171 learned_addr learned my addr 172.21.15.72:0/124218171 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbd4bc3700 1 -- 172.21.15.72:0/124218171 >> v1:172.21.15.123:6789/0 conn(0x7fcbd006a820 legacy=0x7fcbd006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbd4bc3700 1 -- 172.21.15.72:0/124218171 >> v1:172.21.15.72:6789/0 conn(0x7fcbd015ed30 legacy=0x7fcbd015f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbd4bc3700 1 -- 172.21.15.72:0/124218171 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd006df70 con 0x7fcbd015f8c0 2023-10-14T12:33:43.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbceffd700 1 -- 172.21.15.72:0/124218171 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245057871 0 0) 0x7fcbd00cad30 con 0x7fcbd015ed30 2023-10-14T12:33:43.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbd4bc3700 1 --2- 172.21.15.72:0/124218171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015f8c0 0x7fcbd0167250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009d90 tx=0x7fcbc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c806827526ba6fd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:43.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbceffd700 1 -- 172.21.15.72:0/124218171 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc800e070 con 0x7fcbd015f8c0 2023-10-14T12:33:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbceffd700 1 -- 172.21.15.72:0/124218171 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc800bbd0 con 0x7fcbd015f8c0 2023-10-14T12:33:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.176+0000 7fcbceffd700 1 -- 172.21.15.72:0/124218171 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8012430 con 0x7fcbd015f8c0 2023-10-14T12:33:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.177+0000 7fcbd6626700 1 -- 172.21.15.72:0/124218171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015f8c0 msgr2=0x7fcbd0167250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.177+0000 7fcbd6626700 1 --2- 172.21.15.72:0/124218171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015f8c0 0x7fcbd0167250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009d90 tx=0x7fcbc800b330 comp rx=0 tx=0).stop 2023-10-14T12:33:43.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.177+0000 7fcbd6626700 1 -- 172.21.15.72:0/124218171 shutdown_connections 2023-10-14T12:33:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.177+0000 7fcbd6626700 1 --2- 172.21.15.72:0/124218171 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015f8c0 0x7fcbd0167250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.177+0000 7fcbd6626700 1 -- 172.21.15.72:0/124218171 >> 172.21.15.72:0/124218171 conn(0x7fcbd00ccbe0 msgr2=0x7fcbd00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.177+0000 7fcbd6626700 1 -- 172.21.15.72:0/124218171 shutdown_connections 2023-10-14T12:33:43.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.177+0000 7fcbd6626700 1 -- 172.21.15.72:0/124218171 wait complete. 2023-10-14T12:33:43.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.178+0000 7fcbd6626700 1 Processor -- start 2023-10-14T12:33:43.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.178+0000 7fcbd6626700 1 -- start start 2023-10-14T12:33:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbd6626700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbd006a820 0x7fcbd00c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbd6626700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015ed30 0x7fcbd00b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbd6626700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcbd015f8c0 0x7fcbd0157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbd6626700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015c690 con 0x7fcbd015ed30 2023-10-14T12:33:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbd6626700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015d1d0 con 0x7fcbd006a820 2023-10-14T12:33:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbd6626700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015c8a0 con 0x7fcbd015f8c0 2023-10-14T12:33:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015ed30 0x7fcbd00b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015ed30 0x7fcbd00b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46460/0 (socket says 172.21.15.72:46460) 2023-10-14T12:33:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcf7fe700 1 -- 172.21.15.72:0/3456851872 learned_addr learned my addr 172.21.15.72:0/3456851872 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcffff700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbd006a820 0x7fcbd00c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbd4bc3700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcbd015f8c0 0x7fcbd0157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcf7fe700 1 -- 172.21.15.72:0/3456851872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcbd015f8c0 msgr2=0x7fcbd0157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcf7fe700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcbd015f8c0 0x7fcbd0157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcf7fe700 1 -- 172.21.15.72:0/3456851872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbd006a820 msgr2=0x7fcbd00c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcf7fe700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbd006a820 0x7fcbd00c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcf7fe700 1 -- 172.21.15.72:0/3456851872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8009a70 con 0x7fcbd015ed30 2023-10-14T12:33:43.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.179+0000 7fcbcf7fe700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015ed30 0x7fcbd00b50a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400c520 tx=0x7fcbc400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.180+0000 7fcbccff9700 1 -- 172.21.15.72:0/3456851872 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4004c80 con 0x7fcbd015ed30 2023-10-14T12:33:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.180+0000 7fcbccff9700 1 -- 172.21.15.72:0/3456851872 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4004e00 con 0x7fcbd015ed30 2023-10-14T12:33:43.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.180+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd015cb80 con 0x7fcbd015ed30 2023-10-14T12:33:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.180+0000 7fcbccff9700 1 -- 172.21.15.72:0/3456851872 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4007310 con 0x7fcbd015ed30 2023-10-14T12:33:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.180+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd00c5500 con 0x7fcbd015ed30 2023-10-14T12:33:43.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.180+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd015d340 con 0x7fcbd015ed30 2023-10-14T12:33:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.181+0000 7fcbccff9700 1 -- 172.21.15.72:0/3456851872 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcbc4007470 con 0x7fcbd015ed30 2023-10-14T12:33:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.181+0000 7fcbccff9700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.181+0000 7fcbccff9700 1 -- 172.21.15.72:0/3456851872 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbc40894b0 con 0x7fcbd015ed30 2023-10-14T12:33:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.181+0000 7fcbcffff700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.182+0000 7fcbcffff700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0007fd0 tx=0x7fcbc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:43.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.186+0000 7fcbccff9700 1 -- 172.21.15.72:0/3456851872 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbc4054270 con 0x7fcbd015ed30 2023-10-14T12:33:43.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.375+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcbd004ebb0 con 0x7fcbd015ed30 2023-10-14T12:33:43.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.375+0000 7fcbccff9700 1 -- 172.21.15.72:0/3456851872 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcbc4057890 con 0x7fcbd015ed30 2023-10-14T12:33:43.377 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:33:43.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcbbc06af00 msgr2=0x7fcbbc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0007fd0 tx=0x7fcbc0009040 comp rx=0 tx=0).stop 2023-10-14T12:33:43.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015ed30 msgr2=0x7fcbd00b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015ed30 0x7fcbd00b50a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400c520 tx=0x7fcbc400c830 comp rx=0 tx=0).stop 2023-10-14T12:33:43.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 shutdown_connections 2023-10-14T12:33:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcbbc06af00 0x7fcbbc06d3c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcbd015f8c0 0x7fcbd0157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcbd006a820 0x7fcbd00c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 --2- 172.21.15.72:0/3456851872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcbd015ed30 0x7fcbd00b50a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 >> 172.21.15.72:0/3456851872 conn(0x7fcbd00ccbe0 msgr2=0x7fcbd006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:43.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 shutdown_connections 2023-10-14T12:33:43.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.378+0000 7fcbd6626700 1 -- 172.21.15.72:0/3456851872 wait complete. 2023-10-14T12:33:43.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:33:43.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.513+0000 7f42f1370700 1 Processor -- start 2023-10-14T12:33:43.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.513+0000 7f42f1370700 1 -- start start 2023-10-14T12:33:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42f1370700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42ec15c350 0x7f42ec06a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42f1370700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec06f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42f1370700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec06b150 con 0x7f42ec0ca860 2023-10-14T12:33:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42f1370700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec15efe0 con 0x7f42ec15c350 2023-10-14T12:33:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42f1370700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec15f2c0 con 0x7f42ec06ec20 2023-10-14T12:33:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42ea7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42ec15c350 0x7f42ec06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42ea7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f42ec15c350 0x7f42ec06a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46468/0 (socket says 172.21.15.72:46468) 2023-10-14T12:33:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42ea7fc700 1 -- 172.21.15.72:0/1946692939 learned_addr learned my addr 172.21.15.72:0/1946692939 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42eb7fe700 1 --2- 172.21.15.72:0/1946692939 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec06f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42ea7fc700 1 -- 172.21.15.72:0/1946692939 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 msgr2=0x7f42ec06f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42ea7fc700 1 --2- 172.21.15.72:0/1946692939 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec06f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42ea7fc700 1 -- 172.21.15.72:0/1946692939 >> v1:172.21.15.123:6789/0 conn(0x7f42ec0ca860 legacy=0x7f42ec0cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42ea7fc700 1 -- 172.21.15.72:0/1946692939 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec15f5a0 con 0x7f42ec15c350 2023-10-14T12:33:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42eb7fe700 1 --2- 172.21.15.72:0/1946692939 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec06f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42ea7fc700 1 --2- 172.21.15.72:0/1946692939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 0x7f42ec06a820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0098f0 tx=0x7f42dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42339c538bec7d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.514+0000 7f42e9ffb700 1 -- 172.21.15.72:0/1946692939 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc004230 con 0x7f42ec15c350 2023-10-14T12:33:43.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42e9ffb700 1 -- 172.21.15.72:0/1946692939 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc004390 con 0x7f42ec15c350 2023-10-14T12:33:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42e9ffb700 1 -- 172.21.15.72:0/1946692939 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0036a0 con 0x7f42ec15c350 2023-10-14T12:33:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42f1370700 1 -- 172.21.15.72:0/1946692939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 msgr2=0x7f42ec06a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42f1370700 1 --2- 172.21.15.72:0/1946692939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 0x7f42ec06a820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0098f0 tx=0x7f42dc009c00 comp rx=0 tx=0).stop 2023-10-14T12:33:43.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42f1370700 1 -- 172.21.15.72:0/1946692939 shutdown_connections 2023-10-14T12:33:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42f1370700 1 --2- 172.21.15.72:0/1946692939 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec06f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42f1370700 1 --2- 172.21.15.72:0/1946692939 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 0x7f42ec06a820 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42f1370700 1 -- 172.21.15.72:0/1946692939 >> 172.21.15.72:0/1946692939 conn(0x7f42ec0d0210 msgr2=0x7f42ec0d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42f1370700 1 -- 172.21.15.72:0/1946692939 shutdown_connections 2023-10-14T12:33:43.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.515+0000 7f42f1370700 1 -- 172.21.15.72:0/1946692939 wait complete. 2023-10-14T12:33:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.516+0000 7f42f1370700 1 Processor -- start 2023-10-14T12:33:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.516+0000 7f42f1370700 1 -- start start 2023-10-14T12:33:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42f1370700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42f1370700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42ec0ca860 0x7f42ec0c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42f1370700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 0x7f42ec0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42f1370700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c7820 con 0x7f42ec15c350 2023-10-14T12:33:43.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42f1370700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c7f40 con 0x7f42ec0ca860 2023-10-14T12:33:43.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42f1370700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0c3ee0 con 0x7f42ec06ec20 2023-10-14T12:33:43.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 0x7f42ec0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42eb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 0x7f42ec0c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46476/0 (socket says 172.21.15.72:46476) 2023-10-14T12:33:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42eb7fe700 1 -- 172.21.15.72:0/2380734347 learned_addr learned my addr 172.21.15.72:0/2380734347 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42ea7fc700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42ec0ca860 0x7f42ec0c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.517+0000 7f42eaffd700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42eb7fe700 1 -- 172.21.15.72:0/2380734347 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 msgr2=0x7f42ec0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42eb7fe700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec0c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42eb7fe700 1 -- 172.21.15.72:0/2380734347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42ec0ca860 msgr2=0x7f42ec0c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42eb7fe700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42ec0ca860 0x7f42ec0c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42eb7fe700 1 -- 172.21.15.72:0/2380734347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc009550 con 0x7f42ec15c350 2023-10-14T12:33:43.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42eaffd700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:43.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42eb7fe700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 0x7f42ec0c96a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42e400cd50 tx=0x7f42e400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:43.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42d37fe700 1 -- 172.21.15.72:0/2380734347 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400f480 con 0x7f42ec15c350 2023-10-14T12:33:43.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42d37fe700 1 -- 172.21.15.72:0/2380734347 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e400f600 con 0x7f42ec15c350 2023-10-14T12:33:43.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42d37fe700 1 -- 172.21.15.72:0/2380734347 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400f9b0 con 0x7f42ec15c350 2023-10-14T12:33:43.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec0c41c0 con 0x7f42ec15c350 2023-10-14T12:33:43.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.518+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec1590e0 con 0x7f42ec15c350 2023-10-14T12:33:43.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.519+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec0c3d40 con 0x7f42ec15c350 2023-10-14T12:33:43.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.519+0000 7f42d37fe700 1 -- 172.21.15.72:0/2380734347 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f42e400b040 con 0x7f42ec15c350 2023-10-14T12:33:43.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.520+0000 7f42d37fe700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f42d806af00 0x7f42d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.520+0000 7f42d37fe700 1 -- 172.21.15.72:0/2380734347 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42e408a0a0 con 0x7f42ec15c350 2023-10-14T12:33:43.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.520+0000 7f42eaffd700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f42d806af00 0x7f42d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.520+0000 7f42eaffd700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f42d806af00 0x7f42d806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42e0006fd0 tx=0x7f42e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:43.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.524+0000 7f42d37fe700 1 -- 172.21.15.72:0/2380734347 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42ec0c3d40 con 0x7f42ec15c350 2023-10-14T12:33:43.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.730+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f42ec0c46e0 con 0x7f42ec15c350 2023-10-14T12:33:43.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.731+0000 7f42d37fe700 1 -- 172.21.15.72:0/2380734347 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f42ec0c46e0 con 0x7f42ec15c350 2023-10-14T12:33:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f42d806af00 msgr2=0x7f42d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f42d806af00 0x7f42d806d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42e0006fd0 tx=0x7f42e0008040 comp rx=0 tx=0).stop 2023-10-14T12:33:43.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 msgr2=0x7f42ec0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 0x7f42ec0c96a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f42e400cd50 tx=0x7f42e400a560 comp rx=0 tx=0).stop 2023-10-14T12:33:43.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 shutdown_connections 2023-10-14T12:33:43.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f42d806af00 0x7f42d806d3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42ec15c350 0x7f42ec0c96a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42ec06ec20 0x7f42ec0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 --2- 172.21.15.72:0/2380734347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42ec0ca860 0x7f42ec0c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 >> 172.21.15.72:0/2380734347 conn(0x7f42ec0d0210 msgr2=0x7f42ec06f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:43.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 shutdown_connections 2023-10-14T12:33:43.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.733+0000 7f42f1370700 1 -- 172.21.15.72:0/2380734347 wait complete. 2023-10-14T12:33:43.737 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-10-14T12:33:43.746 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:33:43.746 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:33:43.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:43.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.926+0000 7f555b9db700 1 Processor -- start 2023-10-14T12:33:43.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.926+0000 7f555b9db700 1 -- start start 2023-10-14T12:33:43.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f555b9db700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5554071cb0 0x7f555406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f555b9db700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555415ed10 con 0x7f555415daa0 2023-10-14T12:33:43.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f555b9db700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555415de80 con 0x7f5554071850 2023-10-14T12:33:43.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f555b9db700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555415e100 con 0x7f5554071cb0 2023-10-14T12:33:43.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f5559f78700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5554071cb0 0x7f555406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f5559777700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f555415daa0 0x7f55540af020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52780/0 (socket says 172.21.15.72:52780) 2023-10-14T12:33:43.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f5559777700 1 -- 172.21.15.72:0/3548276424 learned_addr learned my addr 172.21.15.72:0/3548276424 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:43.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f5559f78700 1 -- 172.21.15.72:0/3548276424 >> v1:172.21.15.123:6789/0 conn(0x7f5554071850 legacy=0x7f555406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f5559f78700 1 -- 172.21.15.72:0/3548276424 >> v1:172.21.15.72:6789/0 conn(0x7f555415daa0 legacy=0x7f55540af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f5559f78700 1 -- 172.21.15.72:0/3548276424 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555415e3e0 con 0x7f5554071cb0 2023-10-14T12:33:43.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f554bfff700 1 -- 172.21.15.72:0/3548276424 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621645139 0 0) 0x7f555415ed10 con 0x7f555415daa0 2023-10-14T12:33:43.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.927+0000 7f5559f78700 1 --2- 172.21.15.72:0/3548276424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5554071cb0 0x7f555406d810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f554c009d90 tx=0x7f554c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e9e9ff865e1ccf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:43.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f554bfff700 1 -- 172.21.15.72:0/3548276424 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00e070 con 0x7f5554071cb0 2023-10-14T12:33:43.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f554bfff700 1 -- 172.21.15.72:0/3548276424 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00bbd0 con 0x7f5554071cb0 2023-10-14T12:33:43.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f554bfff700 1 -- 172.21.15.72:0/3548276424 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c012430 con 0x7f5554071cb0 2023-10-14T12:33:43.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f555b9db700 1 -- 172.21.15.72:0/3548276424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5554071cb0 msgr2=0x7f555406d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f555b9db700 1 --2- 172.21.15.72:0/3548276424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5554071cb0 0x7f555406d810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f554c009d90 tx=0x7f554c00b330 comp rx=0 tx=0).stop 2023-10-14T12:33:43.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f555b9db700 1 -- 172.21.15.72:0/3548276424 shutdown_connections 2023-10-14T12:33:43.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f555b9db700 1 --2- 172.21.15.72:0/3548276424 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5554071cb0 0x7f555406d810 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f555b9db700 1 -- 172.21.15.72:0/3548276424 >> 172.21.15.72:0/3548276424 conn(0x7f55540d0180 msgr2=0x7f55540d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:43.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f555b9db700 1 -- 172.21.15.72:0/3548276424 shutdown_connections 2023-10-14T12:33:43.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.928+0000 7f555b9db700 1 -- 172.21.15.72:0/3548276424 wait complete. 2023-10-14T12:33:43.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.929+0000 7f555b9db700 1 Processor -- start 2023-10-14T12:33:43.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.929+0000 7f555b9db700 1 -- start start 2023-10-14T12:33:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f555b9db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5554071850 0x7f55541f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f555b9db700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5554071cb0 0x7f55540aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f555b9db700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555415daa0 0x7f555415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f555b9db700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540af6a0 con 0x7f555415daa0 2023-10-14T12:33:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f555b9db700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540af3c0 con 0x7f5554071850 2023-10-14T12:33:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f555b9db700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55541f3700 con 0x7f5554071cb0 2023-10-14T12:33:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559f78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555415daa0 0x7f555415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559f78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555415daa0 0x7f555415be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46488/0 (socket says 172.21.15.72:46488) 2023-10-14T12:33:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559f78700 1 -- 172.21.15.72:0/605379484 learned_addr learned my addr 172.21.15.72:0/605379484 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559777700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5554071850 0x7f55541f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5558f76700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5554071cb0 0x7f55540aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559f78700 1 -- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5554071cb0 msgr2=0x7f55540aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559f78700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5554071cb0 0x7f55540aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559f78700 1 -- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5554071850 msgr2=0x7f55541f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:43.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559f78700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5554071850 0x7f55541f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:43.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559f78700 1 -- 172.21.15.72:0/605379484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c009a70 con 0x7f555415daa0 2023-10-14T12:33:43.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5558f76700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5554071cb0 0x7f55540aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:43.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.930+0000 7f5559777700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5554071850 0x7f55541f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:43.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.931+0000 7f5559f78700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555415daa0 0x7f555415be90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f554c014040 tx=0x7f554c004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:43.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.931+0000 7f5549ffb700 1 -- 172.21.15.72:0/605379484 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c01b8d0 con 0x7f555415daa0 2023-10-14T12:33:43.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.931+0000 7f5549ffb700 1 -- 172.21.15.72:0/605379484 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c020070 con 0x7f555415daa0 2023-10-14T12:33:43.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.931+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55541f39e0 con 0x7f555415daa0 2023-10-14T12:33:43.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.931+0000 7f5549ffb700 1 -- 172.21.15.72:0/605379484 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c01bc70 con 0x7f555415daa0 2023-10-14T12:33:43.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.931+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5554156910 con 0x7f555415daa0 2023-10-14T12:33:43.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.932+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555404ebb0 con 0x7f555415daa0 2023-10-14T12:33:43.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.932+0000 7f5549ffb700 1 -- 172.21.15.72:0/605379484 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f554c01c400 con 0x7f555415daa0 2023-10-14T12:33:43.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.933+0000 7f5549ffb700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f553806af00 0x7f553806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:43.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.933+0000 7f5549ffb700 1 -- 172.21.15.72:0/605379484 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f554c022070 con 0x7f555415daa0 2023-10-14T12:33:43.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.933+0000 7f5559777700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f553806af00 0x7f553806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:43.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.933+0000 7f5559777700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f553806af00 0x7f553806d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5544000f60 tx=0x7f5544007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:43.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:43.937+0000 7f5549ffb700 1 -- 172.21.15.72:0/605379484 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f554c05a580 con 0x7f555415daa0 2023-10-14T12:33:44.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.127+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55540b5c60 con 0x7f555415daa0 2023-10-14T12:33:44.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.128+0000 7f5549ffb700 1 -- 172.21.15.72:0/605379484 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f554c05a110 con 0x7f555415daa0 2023-10-14T12:33:44.130 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:44.130 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:44.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.130+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f553806af00 msgr2=0x7f553806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.130+0000 7f555b9db700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f553806af00 0x7f553806d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5544000f60 tx=0x7f5544007e50 comp rx=0 tx=0).stop 2023-10-14T12:33:44.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.130+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555415daa0 msgr2=0x7f555415be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.130+0000 7f555b9db700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555415daa0 0x7f555415be90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f554c014040 tx=0x7f554c004b20 comp rx=0 tx=0).stop 2023-10-14T12:33:44.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.131+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 shutdown_connections 2023-10-14T12:33:44.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.131+0000 7f555b9db700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f553806af00 0x7f553806d3c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.131+0000 7f555b9db700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555415daa0 0x7f555415be90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.131+0000 7f555b9db700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5554071850 0x7f55541f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.131+0000 7f555b9db700 1 --2- 172.21.15.72:0/605379484 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5554071cb0 0x7f55540aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.131+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 >> 172.21.15.72:0/605379484 conn(0x7f55540d0180 msgr2=0x7f55540b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:44.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.131+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 shutdown_connections 2023-10-14T12:33:44.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.131+0000 7f555b9db700 1 -- 172.21.15.72:0/605379484 wait complete. 2023-10-14T12:33:44.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:33:44.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:33:44.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.266+0000 7f2ae030b700 1 Processor -- start 2023-10-14T12:33:44.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.266+0000 7f2ae030b700 1 -- start start 2023-10-14T12:33:44.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ae030b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ad815ed30 0x7f2ad815f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ae030b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ad815f6f0 0x7f2ad815fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ae030b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad80cad30 con 0x7f2ad806a820 2023-10-14T12:33:44.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ae030b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad80ca7b0 con 0x7f2ad815f6f0 2023-10-14T12:33:44.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ae030b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad80cb1c0 con 0x7f2ad815ed30 2023-10-14T12:33:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ade8a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ad815f6f0 0x7f2ad815fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ade8a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ad815f6f0 0x7f2ad815fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46496/0 (socket says 172.21.15.72:46496) 2023-10-14T12:33:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ade8a8700 1 -- 172.21.15.72:0/2947373338 learned_addr learned my addr 172.21.15.72:0/2947373338 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2add8a6700 1 --2- 172.21.15.72:0/2947373338 >> v2:172.21.15.123:3300/0 conn(0x7f2ad815ed30 0x7f2ad815f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ade8a8700 1 -- 172.21.15.72:0/2947373338 >> v2:172.21.15.123:3300/0 conn(0x7f2ad815ed30 msgr2=0x7f2ad815f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ade8a8700 1 --2- 172.21.15.72:0/2947373338 >> v2:172.21.15.123:3300/0 conn(0x7f2ad815ed30 0x7f2ad815f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ade8a8700 1 -- 172.21.15.72:0/2947373338 >> v1:172.21.15.123:6789/0 conn(0x7f2ad806a820 legacy=0x7f2ad806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ade8a8700 1 -- 172.21.15.72:0/2947373338 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad806df70 con 0x7f2ad815f6f0 2023-10-14T12:33:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2ade8a8700 1 --2- 172.21.15.72:0/2947373338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815f6f0 0x7f2ad815fb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8070360 tx=0x7f2ad000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08fcf25c0956759 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:44.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2add0a5700 1 -- 172.21.15.72:0/2947373338 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000e070 con 0x7f2ad815f6f0 2023-10-14T12:33:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2add0a5700 1 -- 172.21.15.72:0/2947373338 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad000b910 con 0x7f2ad815f6f0 2023-10-14T12:33:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.267+0000 7f2add0a5700 1 -- 172.21.15.72:0/2947373338 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000bcc0 con 0x7f2ad815f6f0 2023-10-14T12:33:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.268+0000 7f2ae030b700 1 -- 172.21.15.72:0/2947373338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815f6f0 msgr2=0x7f2ad815fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.268+0000 7f2ae030b700 1 --2- 172.21.15.72:0/2947373338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815f6f0 0x7f2ad815fb80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8070360 tx=0x7f2ad000b330 comp rx=0 tx=0).stop 2023-10-14T12:33:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.268+0000 7f2ae030b700 1 -- 172.21.15.72:0/2947373338 shutdown_connections 2023-10-14T12:33:44.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.268+0000 7f2ae030b700 1 --2- 172.21.15.72:0/2947373338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815f6f0 0x7f2ad815fb80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.268+0000 7f2ae030b700 1 --2- 172.21.15.72:0/2947373338 >> v2:172.21.15.123:3300/0 conn(0x7f2ad815ed30 0x7f2ad815f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.268+0000 7f2ae030b700 1 -- 172.21.15.72:0/2947373338 >> 172.21.15.72:0/2947373338 conn(0x7f2ad80ccbe0 msgr2=0x7f2ad80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:44.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.268+0000 7f2ae030b700 1 -- 172.21.15.72:0/2947373338 shutdown_connections 2023-10-14T12:33:44.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.268+0000 7f2ae030b700 1 -- 172.21.15.72:0/2947373338 wait complete. 2023-10-14T12:33:44.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.269+0000 7f2ae030b700 1 Processor -- start 2023-10-14T12:33:44.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.269+0000 7f2ae030b700 1 -- start start 2023-10-14T12:33:44.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2ae030b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ad806a820 0x7f2ad80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2ae030b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815ed30 0x7f2ad815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2ae030b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad815f6f0 0x7f2ad81e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2ae030b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad815d7c0 con 0x7f2ad815ed30 2023-10-14T12:33:44.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2ae030b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad815d230 con 0x7f2ad815f6f0 2023-10-14T12:33:44.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2ae030b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad815d4e0 con 0x7f2ad806a820 2023-10-14T12:33:44.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2add8a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815ed30 0x7f2ad815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2add8a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815ed30 0x7f2ad815ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46500/0 (socket says 172.21.15.72:46500) 2023-10-14T12:33:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2add8a6700 1 -- 172.21.15.72:0/332663765 learned_addr learned my addr 172.21.15.72:0/332663765 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2ade0a7700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ad806a820 0x7f2ad80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2ade8a8700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad815f6f0 0x7f2ad81e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2add8a6700 1 -- 172.21.15.72:0/332663765 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ad806a820 msgr2=0x7f2ad80b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2add8a6700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ad806a820 0x7f2ad80b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2add8a6700 1 -- 172.21.15.72:0/332663765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad815f6f0 msgr2=0x7f2ad81e69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2add8a6700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad815f6f0 0x7f2ad81e69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.270+0000 7f2add8a6700 1 -- 172.21.15.72:0/332663765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0009b30 con 0x7f2ad815ed30 2023-10-14T12:33:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.271+0000 7f2add8a6700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815ed30 0x7f2ad815ccf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800e9b0 tx=0x7f2ac800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:44.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.271+0000 7f2aceffd700 1 -- 172.21.15.72:0/332663765 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8009710 con 0x7f2ad815ed30 2023-10-14T12:33:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.271+0000 7f2aceffd700 1 -- 172.21.15.72:0/332663765 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac800ee50 con 0x7f2ad815ed30 2023-10-14T12:33:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.271+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad80b2ed0 con 0x7f2ad815ed30 2023-10-14T12:33:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.271+0000 7f2aceffd700 1 -- 172.21.15.72:0/332663765 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800ca50 con 0x7f2ad815ed30 2023-10-14T12:33:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.271+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad80b3490 con 0x7f2ad815ed30 2023-10-14T12:33:44.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.272+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad804ebb0 con 0x7f2ad815ed30 2023-10-14T12:33:44.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.272+0000 7f2aceffd700 1 -- 172.21.15.72:0/332663765 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ac800cbb0 con 0x7f2ad815ed30 2023-10-14T12:33:44.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.273+0000 7f2aceffd700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2abc06af00 0x7f2abc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.273+0000 7f2ade0a7700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2abc06af00 0x7f2abc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.273+0000 7f2aceffd700 1 -- 172.21.15.72:0/332663765 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ac80898a0 con 0x7f2ad815ed30 2023-10-14T12:33:44.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.273+0000 7f2ade0a7700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2abc06af00 0x7f2abc06d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4007fd0 tx=0x7f2ad4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:44.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.277+0000 7f2aceffd700 1 -- 172.21.15.72:0/332663765 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ac80546f0 con 0x7f2ad815ed30 2023-10-14T12:33:44.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.466+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ad80cd210 con 0x7f2ad815ed30 2023-10-14T12:33:44.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.466+0000 7f2aceffd700 1 -- 172.21.15.72:0/332663765 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ac800ce60 con 0x7f2ad815ed30 2023-10-14T12:33:44.468 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:33:44.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2abc06af00 msgr2=0x7f2abc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2abc06af00 0x7f2abc06d3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4007fd0 tx=0x7f2ad4009040 comp rx=0 tx=0).stop 2023-10-14T12:33:44.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815ed30 msgr2=0x7f2ad815ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815ed30 0x7f2ad815ccf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800e9b0 tx=0x7f2ac800ecc0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 shutdown_connections 2023-10-14T12:33:44.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2abc06af00 0x7f2abc06d3c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ad815f6f0 0x7f2ad81e69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2ad806a820 0x7f2ad80b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 --2- 172.21.15.72:0/332663765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ad815ed30 0x7f2ad815ccf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 >> 172.21.15.72:0/332663765 conn(0x7f2ad80ccbe0 msgr2=0x7f2ad80c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:44.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 shutdown_connections 2023-10-14T12:33:44.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.468+0000 7f2ae030b700 1 -- 172.21.15.72:0/332663765 wait complete. 2023-10-14T12:33:44.481 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:33:44.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.604+0000 7f16a4ae5700 1 Processor -- start 2023-10-14T12:33:44.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.604+0000 7f16a4ae5700 1 -- start start 2023-10-14T12:33:44.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f16a4ae5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16a006b370 0x7f16a015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f16a4ae5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f16a006a820 0x7f16a006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f16a4ae5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a0161360 con 0x7f16a00cdd30 2023-10-14T12:33:44.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f16a4ae5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a006b750 con 0x7f16a006a820 2023-10-14T12:33:44.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f16a4ae5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a015e300 con 0x7f16a006b370 2023-10-14T12:33:44.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f16a006a820 0x7f16a006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f16a006a820 0x7f16a006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46508/0 (socket says 172.21.15.72:46508) 2023-10-14T12:33:44.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169dd9b700 1 -- 172.21.15.72:0/307470563 learned_addr learned my addr 172.21.15.72:0/307470563 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:44.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169e59c700 1 --2- 172.21.15.72:0/307470563 >> v2:172.21.15.123:3300/0 conn(0x7f16a006b370 0x7f16a015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169dd9b700 1 -- 172.21.15.72:0/307470563 >> v2:172.21.15.123:3300/0 conn(0x7f16a006b370 msgr2=0x7f16a015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:44.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169dd9b700 1 --2- 172.21.15.72:0/307470563 >> v2:172.21.15.123:3300/0 conn(0x7f16a006b370 0x7f16a015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169dd9b700 1 -- 172.21.15.72:0/307470563 >> v1:172.21.15.123:6789/0 conn(0x7f16a00cdd30 legacy=0x7f16a01617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:44.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169dd9b700 1 -- 172.21.15.72:0/307470563 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a015e5e0 con 0x7f16a006a820 2023-10-14T12:33:44.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169e59c700 1 --2- 172.21.15.72:0/307470563 >> v2:172.21.15.123:3300/0 conn(0x7f16a006b370 0x7f16a015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:44.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.605+0000 7f169dd9b700 1 --2- 172.21.15.72:0/307470563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006a820 0x7f16a006d5b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f16a006d450 tx=0x7f1694009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e94fb32b39d2dc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:44.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f169d59a700 1 -- 172.21.15.72:0/307470563 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694004230 con 0x7f16a006a820 2023-10-14T12:33:44.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f169d59a700 1 -- 172.21.15.72:0/307470563 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694004390 con 0x7f16a006a820 2023-10-14T12:33:44.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f169d59a700 1 -- 172.21.15.72:0/307470563 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940036a0 con 0x7f16a006a820 2023-10-14T12:33:44.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f16a4ae5700 1 -- 172.21.15.72:0/307470563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006a820 msgr2=0x7f16a006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f16a4ae5700 1 --2- 172.21.15.72:0/307470563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006a820 0x7f16a006d5b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f16a006d450 tx=0x7f1694009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f16a4ae5700 1 -- 172.21.15.72:0/307470563 shutdown_connections 2023-10-14T12:33:44.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f16a4ae5700 1 --2- 172.21.15.72:0/307470563 >> v2:172.21.15.123:3300/0 conn(0x7f16a006b370 0x7f16a015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f16a4ae5700 1 --2- 172.21.15.72:0/307470563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006a820 0x7f16a006d5b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f16a4ae5700 1 -- 172.21.15.72:0/307470563 >> 172.21.15.72:0/307470563 conn(0x7f16a00ccbe0 msgr2=0x7f16a00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:44.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f16a4ae5700 1 -- 172.21.15.72:0/307470563 shutdown_connections 2023-10-14T12:33:44.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.606+0000 7f16a4ae5700 1 -- 172.21.15.72:0/307470563 wait complete. 2023-10-14T12:33:44.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f16a4ae5700 1 Processor -- start 2023-10-14T12:33:44.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f16a4ae5700 1 -- start start 2023-10-14T12:33:44.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f16a4ae5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16a006a820 0x7f16a0155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f16a4ae5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006b370 0x7f16a00b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f16a4ae5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cdd30 0x7f16a00b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f16a4ae5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a0155d90 con 0x7f16a006b370 2023-10-14T12:33:44.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f16a4ae5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00b3c20 con 0x7f16a00cdd30 2023-10-14T12:33:44.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f16a4ae5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a00ac9f0 con 0x7f16a006a820 2023-10-14T12:33:44.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f169dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006b370 0x7f16a00b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f169dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006b370 0x7f16a00b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46514/0 (socket says 172.21.15.72:46514) 2023-10-14T12:33:44.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.608+0000 7f169dd9b700 1 -- 172.21.15.72:0/2716674280 learned_addr learned my addr 172.21.15.72:0/2716674280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:44.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f169ed9d700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cdd30 0x7f16a00b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f169e59c700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16a006a820 0x7f16a0155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f169dd9b700 1 -- 172.21.15.72:0/2716674280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16a006a820 msgr2=0x7f16a0155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f169dd9b700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16a006a820 0x7f16a0155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f169dd9b700 1 -- 172.21.15.72:0/2716674280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cdd30 msgr2=0x7f16a00b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f169dd9b700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cdd30 0x7f16a00b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f169dd9b700 1 -- 172.21.15.72:0/2716674280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694009550 con 0x7f16a006b370 2023-10-14T12:33:44.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f169ed9d700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cdd30 0x7f16a00b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:44.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f169dd9b700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006b370 0x7f16a00b5110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1694009130 tx=0x7f1694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:44.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f168effd700 1 -- 172.21.15.72:0/2716674280 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694011630 con 0x7f16a006b370 2023-10-14T12:33:44.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f168effd700 1 -- 172.21.15.72:0/2716674280 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694011790 con 0x7f16a006b370 2023-10-14T12:33:44.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a00accd0 con 0x7f16a006b370 2023-10-14T12:33:44.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f168effd700 1 -- 172.21.15.72:0/2716674280 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694011b00 con 0x7f16a006b370 2023-10-14T12:33:44.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.609+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a00ad290 con 0x7f16a006b370 2023-10-14T12:33:44.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.610+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a0072d10 con 0x7f16a006b370 2023-10-14T12:33:44.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.610+0000 7f168effd700 1 -- 172.21.15.72:0/2716674280 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1694011c60 con 0x7f16a006b370 2023-10-14T12:33:44.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.611+0000 7f168effd700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f168006af00 0x7f168006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.611+0000 7f168effd700 1 -- 172.21.15.72:0/2716674280 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f169408aeb0 con 0x7f16a006b370 2023-10-14T12:33:44.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.611+0000 7f169e59c700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f168006af00 0x7f168006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.611+0000 7f169e59c700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f168006af00 0x7f168006d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1690006fd0 tx=0x7f1690008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:44.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.615+0000 7f168effd700 1 -- 172.21.15.72:0/2716674280 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1694055d00 con 0x7f16a006b370 2023-10-14T12:33:44.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.804+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16a004ebb0 con 0x7f16a006b370 2023-10-14T12:33:44.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.804+0000 7f168effd700 1 -- 172.21.15.72:0/2716674280 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1694059320 con 0x7f16a006b370 2023-10-14T12:33:44.806 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:33:44.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.806+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f168006af00 msgr2=0x7f168006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.806+0000 7f16a4ae5700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f168006af00 0x7f168006d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1690006fd0 tx=0x7f1690008040 comp rx=0 tx=0).stop 2023-10-14T12:33:44.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.806+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006b370 msgr2=0x7f16a00b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.806+0000 7f16a4ae5700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006b370 0x7f16a00b5110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1694009130 tx=0x7f1694004750 comp rx=0 tx=0).stop 2023-10-14T12:33:44.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.807+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 shutdown_connections 2023-10-14T12:33:44.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.807+0000 7f16a4ae5700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f168006af00 0x7f168006d3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.807+0000 7f16a4ae5700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00cdd30 0x7f16a00b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.807+0000 7f16a4ae5700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16a006a820 0x7f16a0155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.807+0000 7f16a4ae5700 1 --2- 172.21.15.72:0/2716674280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16a006b370 0x7f16a00b5110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.807+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 >> 172.21.15.72:0/2716674280 conn(0x7f16a00ccbe0 msgr2=0x7f16a0157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:44.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.807+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 shutdown_connections 2023-10-14T12:33:44.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.807+0000 7f16a4ae5700 1 -- 172.21.15.72:0/2716674280 wait complete. 2023-10-14T12:33:44.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:33:44.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.941+0000 7f90f1555700 1 Processor -- start 2023-10-14T12:33:44.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.941+0000 7f90f1555700 1 -- start start 2023-10-14T12:33:44.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90f1555700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f90ec0b9060 0x7f90ec0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90f1555700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90ec06b7e0 0x7f90ec06bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90f1555700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec0ce5e0 con 0x7f90ec15d760 2023-10-14T12:33:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90f1555700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec06c190 con 0x7f90ec0b9060 2023-10-14T12:33:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90f1555700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec0cf420 con 0x7f90ec06b7e0 2023-10-14T12:33:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90ea7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f90ec0b9060 0x7f90ec0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90ea7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f90ec0b9060 0x7f90ec0ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46522/0 (socket says 172.21.15.72:46522) 2023-10-14T12:33:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90ea7fc700 1 -- 172.21.15.72:0/663125788 learned_addr learned my addr 172.21.15.72:0/663125788 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90eb7fe700 1 --2- 172.21.15.72:0/663125788 >> v2:172.21.15.123:3300/0 conn(0x7f90ec06b7e0 0x7f90ec06bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90ea7fc700 1 -- 172.21.15.72:0/663125788 >> v2:172.21.15.123:3300/0 conn(0x7f90ec06b7e0 msgr2=0x7f90ec06bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90ea7fc700 1 --2- 172.21.15.72:0/663125788 >> v2:172.21.15.123:3300/0 conn(0x7f90ec06b7e0 0x7f90ec06bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90ea7fc700 1 -- 172.21.15.72:0/663125788 >> v1:172.21.15.123:6789/0 conn(0x7f90ec15d760 legacy=0x7f90ec0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90ea7fc700 1 -- 172.21.15.72:0/663125788 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0b94c0 con 0x7f90ec0b9060 2023-10-14T12:33:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90eb7fe700 1 --2- 172.21.15.72:0/663125788 >> v2:172.21.15.123:3300/0 conn(0x7f90ec06b7e0 0x7f90ec06bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90ea7fc700 1 --2- 172.21.15.72:0/663125788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec0b9060 0x7f90ec0ce0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0b6430 tx=0x7f90dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d496444658865c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90e9ffb700 1 -- 172.21.15.72:0/663125788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc004230 con 0x7f90ec0b9060 2023-10-14T12:33:44.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90e9ffb700 1 -- 172.21.15.72:0/663125788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc004390 con 0x7f90ec0b9060 2023-10-14T12:33:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.942+0000 7f90e9ffb700 1 -- 172.21.15.72:0/663125788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc0036a0 con 0x7f90ec0b9060 2023-10-14T12:33:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.943+0000 7f90f1555700 1 -- 172.21.15.72:0/663125788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec0b9060 msgr2=0x7f90ec0ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.943+0000 7f90f1555700 1 --2- 172.21.15.72:0/663125788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec0b9060 0x7f90ec0ce0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0b6430 tx=0x7f90dc009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.943+0000 7f90f1555700 1 -- 172.21.15.72:0/663125788 shutdown_connections 2023-10-14T12:33:44.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.943+0000 7f90f1555700 1 --2- 172.21.15.72:0/663125788 >> v2:172.21.15.123:3300/0 conn(0x7f90ec06b7e0 0x7f90ec06bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.943+0000 7f90f1555700 1 --2- 172.21.15.72:0/663125788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec0b9060 0x7f90ec0ce0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.943+0000 7f90f1555700 1 -- 172.21.15.72:0/663125788 >> 172.21.15.72:0/663125788 conn(0x7f90ec072340 msgr2=0x7f90ec072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.943+0000 7f90f1555700 1 -- 172.21.15.72:0/663125788 shutdown_connections 2023-10-14T12:33:44.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.943+0000 7f90f1555700 1 -- 172.21.15.72:0/663125788 wait complete. 2023-10-14T12:33:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.944+0000 7f90f1555700 1 Processor -- start 2023-10-14T12:33:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.944+0000 7f90f1555700 1 -- start start 2023-10-14T12:33:44.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90f1555700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec06b7e0 0x7f90ec0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90f1555700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90ec0b9060 0x7f90ec152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90f1555700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f90ec15d760 0x7f90ec0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90f1555700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0b41e0 con 0x7f90ec06b7e0 2023-10-14T12:33:44.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90f1555700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0b3560 con 0x7f90ec0b9060 2023-10-14T12:33:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90f1555700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec0b3840 con 0x7f90ec15d760 2023-10-14T12:33:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec06b7e0 0x7f90ec0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec06b7e0 0x7f90ec0b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46528/0 (socket says 172.21.15.72:46528) 2023-10-14T12:33:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eaffd700 1 -- 172.21.15.72:0/4170348775 learned_addr learned my addr 172.21.15.72:0/4170348775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:44.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90ea7fc700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90ec0b9060 0x7f90ec152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eb7fe700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f90ec15d760 0x7f90ec0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eaffd700 1 -- 172.21.15.72:0/4170348775 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f90ec15d760 msgr2=0x7f90ec0c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eaffd700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f90ec15d760 0x7f90ec0c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eaffd700 1 -- 172.21.15.72:0/4170348775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90ec0b9060 msgr2=0x7f90ec152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eaffd700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90ec0b9060 0x7f90ec152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:44.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eaffd700 1 -- 172.21.15.72:0/4170348775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc009550 con 0x7f90ec06b7e0 2023-10-14T12:33:44.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.945+0000 7f90eb7fe700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f90ec15d760 0x7f90ec0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:44.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.946+0000 7f90eaffd700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec06b7e0 0x7f90ec0b2f80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f90e000b4a0 tx=0x7f90e000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:44.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.946+0000 7f90d37fe700 1 -- 172.21.15.72:0/4170348775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0011830 con 0x7f90ec06b7e0 2023-10-14T12:33:44.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.946+0000 7f90d37fe700 1 -- 172.21.15.72:0/4170348775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e0011990 con 0x7f90ec06b7e0 2023-10-14T12:33:44.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.946+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec0b3b20 con 0x7f90ec06b7e0 2023-10-14T12:33:44.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.946+0000 7f90d37fe700 1 -- 172.21.15.72:0/4170348775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0011d40 con 0x7f90ec06b7e0 2023-10-14T12:33:44.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.946+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec0c7df0 con 0x7f90ec06b7e0 2023-10-14T12:33:44.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.947+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec04ebb0 con 0x7f90ec06b7e0 2023-10-14T12:33:44.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.947+0000 7f90d37fe700 1 -- 172.21.15.72:0/4170348775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90e001a400 con 0x7f90ec06b7e0 2023-10-14T12:33:44.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.947+0000 7f90d37fe700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f90d806af00 0x7f90d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:44.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.947+0000 7f90d37fe700 1 -- 172.21.15.72:0/4170348775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90e0089580 con 0x7f90ec06b7e0 2023-10-14T12:33:44.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.948+0000 7f90ea7fc700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f90d806af00 0x7f90d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:44.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.948+0000 7f90ea7fc700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f90d806af00 0x7f90d806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009130 tx=0x7f90dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:44.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:44.952+0000 7f90d37fe700 1 -- 172.21.15.72:0/4170348775 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90e00543d0 con 0x7f90ec06b7e0 2023-10-14T12:33:45.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.141+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90ec0d3fd0 con 0x7f90ec06b7e0 2023-10-14T12:33:45.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.141+0000 7f90d37fe700 1 -- 172.21.15.72:0/4170348775 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90e00579f0 con 0x7f90ec06b7e0 2023-10-14T12:33:45.143 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:33:45.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f90d806af00 msgr2=0x7f90d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f90d806af00 0x7f90d806d3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009130 tx=0x7f90dc008030 comp rx=0 tx=0).stop 2023-10-14T12:33:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec06b7e0 msgr2=0x7f90ec0b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec06b7e0 0x7f90ec0b2f80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f90e000b4a0 tx=0x7f90e000b860 comp rx=0 tx=0).stop 2023-10-14T12:33:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 shutdown_connections 2023-10-14T12:33:45.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f90d806af00 0x7f90d806d3c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f90ec15d760 0x7f90ec0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90ec06b7e0 0x7f90ec0b2f80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 --2- 172.21.15.72:0/4170348775 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90ec0b9060 0x7f90ec152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 >> 172.21.15.72:0/4170348775 conn(0x7f90ec072340 msgr2=0x7f90ec15eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:45.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 shutdown_connections 2023-10-14T12:33:45.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.143+0000 7f90f1555700 1 -- 172.21.15.72:0/4170348775 wait complete. 2023-10-14T12:33:45.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:33:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.278+0000 7f98dfeb4700 1 Processor -- start 2023-10-14T12:33:45.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.278+0000 7f98dfeb4700 1 -- start start 2023-10-14T12:33:45.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.279+0000 7f98dfeb4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98d815b4e0 0x7f98d806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.279+0000 7f98dfeb4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98d80cd770 0x7f98d80b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.279+0000 7f98dfeb4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d80b3670 con 0x7f98d80b3220 2023-10-14T12:33:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.279+0000 7f98dfeb4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d8070620 con 0x7f98d80cd770 2023-10-14T12:33:45.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.279+0000 7f98dfeb4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d8070900 con 0x7f98d815b4e0 2023-10-14T12:33:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.279+0000 7f98dd44f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98d80cd770 0x7f98d80b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.279+0000 7f98de451700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f98d80b3220 0x7f98d80cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52838/0 (socket says 172.21.15.72:52838) 2023-10-14T12:33:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.279+0000 7f98de451700 1 -- 172.21.15.72:0/896857504 learned_addr learned my addr 172.21.15.72:0/896857504 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98ddc50700 1 --2- 172.21.15.72:0/896857504 >> v2:172.21.15.123:3300/0 conn(0x7f98d815b4e0 0x7f98d806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98dd44f700 1 -- 172.21.15.72:0/896857504 >> v2:172.21.15.123:3300/0 conn(0x7f98d815b4e0 msgr2=0x7f98d806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98dd44f700 1 --2- 172.21.15.72:0/896857504 >> v2:172.21.15.123:3300/0 conn(0x7f98d815b4e0 0x7f98d806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98dd44f700 1 -- 172.21.15.72:0/896857504 >> v1:172.21.15.72:6789/0 conn(0x7f98d80b3220 legacy=0x7f98d80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98dd44f700 1 -- 172.21.15.72:0/896857504 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8070be0 con 0x7f98d80cd770 2023-10-14T12:33:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98dcc4e700 1 -- 172.21.15.72:0/896857504 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007626405 0 0) 0x7f98d0001490 con 0x7f98d80b3220 2023-10-14T12:33:45.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98dd44f700 1 --2- 172.21.15.72:0/896857504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80cd770 0x7f98d80b2ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f98d80c4d60 tx=0x7f98c8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d75bf9f6518b489 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98dcc4e700 1 -- 172.21.15.72:0/896857504 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8011830 con 0x7f98d80cd770 2023-10-14T12:33:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98dcc4e700 1 -- 172.21.15.72:0/896857504 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8011990 con 0x7f98d80cd770 2023-10-14T12:33:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.280+0000 7f98dcc4e700 1 -- 172.21.15.72:0/896857504 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c8011d20 con 0x7f98d80cd770 2023-10-14T12:33:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.281+0000 7f98dfeb4700 1 -- 172.21.15.72:0/896857504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80cd770 msgr2=0x7f98d80b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.281+0000 7f98dfeb4700 1 --2- 172.21.15.72:0/896857504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80cd770 0x7f98d80b2ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f98d80c4d60 tx=0x7f98c8009b20 comp rx=0 tx=0).stop 2023-10-14T12:33:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.281+0000 7f98dfeb4700 1 -- 172.21.15.72:0/896857504 shutdown_connections 2023-10-14T12:33:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.281+0000 7f98dfeb4700 1 --2- 172.21.15.72:0/896857504 >> v2:172.21.15.123:3300/0 conn(0x7f98d815b4e0 0x7f98d806f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.281+0000 7f98dfeb4700 1 --2- 172.21.15.72:0/896857504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80cd770 0x7f98d80b2ce0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.281+0000 7f98dfeb4700 1 -- 172.21.15.72:0/896857504 >> 172.21.15.72:0/896857504 conn(0x7f98d80cdce0 msgr2=0x7f98d80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:45.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.281+0000 7f98dfeb4700 1 -- 172.21.15.72:0/896857504 shutdown_connections 2023-10-14T12:33:45.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.281+0000 7f98dfeb4700 1 -- 172.21.15.72:0/896857504 wait complete. 2023-10-14T12:33:45.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.282+0000 7f98dfeb4700 1 Processor -- start 2023-10-14T12:33:45.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.282+0000 7f98dfeb4700 1 -- start start 2023-10-14T12:33:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98dfeb4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80b3220 0x7f98d80c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98dfeb4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98d80cd770 0x7f98d80ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98dfeb4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f98d815b4e0 0x7f98d81e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98dfeb4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80ca130 con 0x7f98d80b3220 2023-10-14T12:33:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98dfeb4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c9520 con 0x7f98d80cd770 2023-10-14T12:33:45.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98dfeb4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c9800 con 0x7f98d815b4e0 2023-10-14T12:33:45.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ddc50700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80b3220 0x7f98d80c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ddc50700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80b3220 0x7f98d80c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46540/0 (socket says 172.21.15.72:46540) 2023-10-14T12:33:45.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ddc50700 1 -- 172.21.15.72:0/1327817061 learned_addr learned my addr 172.21.15.72:0/1327817061 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:45.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ddc50700 1 -- 172.21.15.72:0/1327817061 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f98d815b4e0 msgr2=0x7f98d81e4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98dd44f700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98d80cd770 0x7f98d80ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ddc50700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f98d815b4e0 0x7f98d81e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ddc50700 1 -- 172.21.15.72:0/1327817061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98d80cd770 msgr2=0x7f98d80ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ddc50700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98d80cd770 0x7f98d80ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ddc50700 1 -- 172.21.15.72:0/1327817061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c80094a0 con 0x7f98d80b3220 2023-10-14T12:33:45.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ddc50700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80b3220 0x7f98d80c44a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98d400d800 tx=0x7f98d400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:45.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ce7fc700 1 -- 172.21.15.72:0/1327817061 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40125f0 con 0x7f98d80b3220 2023-10-14T12:33:45.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ce7fc700 1 -- 172.21.15.72:0/1327817061 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4012750 con 0x7f98d80b3220 2023-10-14T12:33:45.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d80c9ae0 con 0x7f98d80b3220 2023-10-14T12:33:45.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98ce7fc700 1 -- 172.21.15.72:0/1327817061 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4012b00 con 0x7f98d80b3220 2023-10-14T12:33:45.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.283+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d8154f00 con 0x7f98d80b3220 2023-10-14T12:33:45.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.284+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d80ca410 con 0x7f98d80b3220 2023-10-14T12:33:45.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.285+0000 7f98ce7fc700 1 -- 172.21.15.72:0/1327817061 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f98d4012c60 con 0x7f98d80b3220 2023-10-14T12:33:45.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.285+0000 7f98ce7fc700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98bc06af00 0x7f98bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.285+0000 7f98ce7fc700 1 -- 172.21.15.72:0/1327817061 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98d4089c70 con 0x7f98d80b3220 2023-10-14T12:33:45.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.285+0000 7f98dd44f700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98bc06af00 0x7f98bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.285+0000 7f98dd44f700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98bc06af00 0x7f98bc06d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f98d80cdbe0 tx=0x7f98c8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:45.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.289+0000 7f98ce7fc700 1 -- 172.21.15.72:0/1327817061 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98d4054a30 con 0x7f98d80b3220 2023-10-14T12:33:45.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.480+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f98d8070e90 con 0x7f98d80b3220 2023-10-14T12:33:45.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.480+0000 7f98ce7fc700 1 -- 172.21.15.72:0/1327817061 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f98d4058050 con 0x7f98d80b3220 2023-10-14T12:33:45.482 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:33:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.482+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98bc06af00 msgr2=0x7f98bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.482+0000 7f98dfeb4700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98bc06af00 0x7f98bc06d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f98d80cdbe0 tx=0x7f98c8008030 comp rx=0 tx=0).stop 2023-10-14T12:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.482+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80b3220 msgr2=0x7f98d80c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.482+0000 7f98dfeb4700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80b3220 0x7f98d80c44a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98d400d800 tx=0x7f98d400dbc0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.483+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 shutdown_connections 2023-10-14T12:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.483+0000 7f98dfeb4700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98bc06af00 0x7f98bc06d3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.483+0000 7f98dfeb4700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f98d815b4e0 0x7f98d81e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.483+0000 7f98dfeb4700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80b3220 0x7f98d80c44a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.483+0000 7f98dfeb4700 1 --2- 172.21.15.72:0/1327817061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98d80cd770 0x7f98d80ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.483+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 >> 172.21.15.72:0/1327817061 conn(0x7f98d80cdce0 msgr2=0x7f98d80c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.483+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 shutdown_connections 2023-10-14T12:33:45.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.483+0000 7f98dfeb4700 1 -- 172.21.15.72:0/1327817061 wait complete. 2023-10-14T12:33:45.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:33:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.615+0000 7fe1acfd4700 1 Processor -- start 2023-10-14T12:33:45.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.615+0000 7fe1acfd4700 1 -- start start 2023-10-14T12:33:45.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1acfd4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a80ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1acfd4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1a80cc310 0x7fe1a806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1acfd4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe1a80cdd50 0x7fe1a80ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1acfd4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a80cc790 con 0x7fe1a80cc310 2023-10-14T12:33:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1acfd4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a80726b0 con 0x7fe1a80cdd50 2023-10-14T12:33:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1acfd4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a806b140 con 0x7fe1a806a820 2023-10-14T12:33:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1a80cc310 0x7fe1a806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1a80cc310 0x7fe1a806ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46550/0 (socket says 172.21.15.72:46550) 2023-10-14T12:33:45.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a5d9b700 1 -- 172.21.15.72:0/2627227884 learned_addr learned my addr 172.21.15.72:0/2627227884 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a659c700 1 --2- 172.21.15.72:0/2627227884 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a80ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a6d9d700 1 --2- 172.21.15.72:0/2627227884 >> v2:172.21.15.123:3300/0 conn(0x7fe1a80cdd50 0x7fe1a80ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a5d9b700 1 -- 172.21.15.72:0/2627227884 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 msgr2=0x7fe1a80ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a5d9b700 1 --2- 172.21.15.72:0/2627227884 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a80ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a5d9b700 1 -- 172.21.15.72:0/2627227884 >> v2:172.21.15.123:3300/0 conn(0x7fe1a80cdd50 msgr2=0x7fe1a80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a5d9b700 1 --2- 172.21.15.72:0/2627227884 >> v2:172.21.15.123:3300/0 conn(0x7fe1a80cdd50 0x7fe1a80ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a5d9b700 1 -- 172.21.15.72:0/2627227884 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a80718f0 con 0x7fe1a80cc310 2023-10-14T12:33:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a6d9d700 1 --2- 172.21.15.72:0/2627227884 >> v2:172.21.15.123:3300/0 conn(0x7fe1a80cdd50 0x7fe1a80ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a659c700 1 --2- 172.21.15.72:0/2627227884 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a80ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:45.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a5d9b700 1 --2- 172.21.15.72:0/2627227884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 0x7fe1a806ac00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8072c10 tx=0x7fe19c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e84fec3e0f3738 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:45.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a559a700 1 -- 172.21.15.72:0/2627227884 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00b870 con 0x7fe1a80cc310 2023-10-14T12:33:45.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a559a700 1 -- 172.21.15.72:0/2627227884 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c00b9d0 con 0x7fe1a80cc310 2023-10-14T12:33:45.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.616+0000 7fe1a559a700 1 -- 172.21.15.72:0/2627227884 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00bd60 con 0x7fe1a80cc310 2023-10-14T12:33:45.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.617+0000 7fe1acfd4700 1 -- 172.21.15.72:0/2627227884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 msgr2=0x7fe1a806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.617+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/2627227884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 0x7fe1a806ac00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8072c10 tx=0x7fe19c009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.617+0000 7fe1acfd4700 1 -- 172.21.15.72:0/2627227884 shutdown_connections 2023-10-14T12:33:45.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.617+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/2627227884 >> v2:172.21.15.123:3300/0 conn(0x7fe1a80cdd50 0x7fe1a80ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.617+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/2627227884 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a80ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.617+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/2627227884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 0x7fe1a806ac00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.617+0000 7fe1acfd4700 1 -- 172.21.15.72:0/2627227884 >> 172.21.15.72:0/2627227884 conn(0x7fe1a80d0180 msgr2=0x7fe1a80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:45.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.617+0000 7fe1acfd4700 1 -- 172.21.15.72:0/2627227884 shutdown_connections 2023-10-14T12:33:45.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.617+0000 7fe1acfd4700 1 -- 172.21.15.72:0/2627227884 wait complete. 2023-10-14T12:33:45.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.619+0000 7fe1acfd4700 1 Processor -- start 2023-10-14T12:33:45.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.619+0000 7fe1acfd4700 1 -- start start 2023-10-14T12:33:45.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1acfd4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a809d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1acfd4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 0x7fe1a80c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1acfd4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1a80cdd50 0x7fe1a80afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1acfd4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a809d5b0 con 0x7fe1a80cc310 2023-10-14T12:33:45.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1acfd4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8155720 con 0x7fe1a80cdd50 2023-10-14T12:33:45.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1acfd4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a8155a00 con 0x7fe1a806a820 2023-10-14T12:33:45.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 0x7fe1a80c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 0x7fe1a80c5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46556/0 (socket says 172.21.15.72:46556) 2023-10-14T12:33:45.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a5d9b700 1 -- 172.21.15.72:0/983411883 learned_addr learned my addr 172.21.15.72:0/983411883 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:45.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a6d9d700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1a80cdd50 0x7fe1a80afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a659c700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a809d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a5d9b700 1 -- 172.21.15.72:0/983411883 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 msgr2=0x7fe1a809d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a5d9b700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a809d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a5d9b700 1 -- 172.21.15.72:0/983411883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1a80cdd50 msgr2=0x7fe1a80afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a5d9b700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1a80cdd50 0x7fe1a80afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a5d9b700 1 -- 172.21.15.72:0/983411883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c009550 con 0x7fe1a80cc310 2023-10-14T12:33:45.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a659c700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a809d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:45.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1a5d9b700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 0x7fe1a80c5840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe19c000c00 tx=0x7fe19c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:45.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe196ffd700 1 -- 172.21.15.72:0/983411883 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c004540 con 0x7fe1a80cc310 2023-10-14T12:33:45.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe196ffd700 1 -- 172.21.15.72:0/983411883 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c0036a0 con 0x7fe1a80cc310 2023-10-14T12:33:45.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe196ffd700 1 -- 172.21.15.72:0/983411883 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c003a50 con 0x7fe1a80cc310 2023-10-14T12:33:45.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a8155ce0 con 0x7fe1a80cc310 2023-10-14T12:33:45.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.620+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a81562a0 con 0x7fe1a80cc310 2023-10-14T12:33:45.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.621+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a8067d10 con 0x7fe1a80cc310 2023-10-14T12:33:45.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.622+0000 7fe196ffd700 1 -- 172.21.15.72:0/983411883 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe19c021070 con 0x7fe1a80cc310 2023-10-14T12:33:45.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.622+0000 7fe196ffd700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe18806af00 0x7fe18806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:45.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.622+0000 7fe196ffd700 1 -- 172.21.15.72:0/983411883 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe19c08af80 con 0x7fe1a80cc310 2023-10-14T12:33:45.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.622+0000 7fe1a659c700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe18806af00 0x7fe18806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:45.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.623+0000 7fe1a659c700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe18806af00 0x7fe18806d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1980099e0 tx=0x7fe198008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:45.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.627+0000 7fe196ffd700 1 -- 172.21.15.72:0/983411883 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe19c0bdca0 con 0x7fe1a80cc310 2023-10-14T12:33:45.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.832+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe1a804ebb0 con 0x7fe1a80cc310 2023-10-14T12:33:45.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.833+0000 7fe196ffd700 1 -- 172.21.15.72:0/983411883 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe19c029080 con 0x7fe1a80cc310 2023-10-14T12:33:45.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe18806af00 msgr2=0x7fe18806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe18806af00 0x7fe18806d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1980099e0 tx=0x7fe198008040 comp rx=0 tx=0).stop 2023-10-14T12:33:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 msgr2=0x7fe1a80c5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 0x7fe1a80c5840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe19c000c00 tx=0x7fe19c004750 comp rx=0 tx=0).stop 2023-10-14T12:33:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 shutdown_connections 2023-10-14T12:33:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe18806af00 0x7fe18806d3c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1a80cdd50 0x7fe1a80afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe1a806a820 0x7fe1a809d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 --2- 172.21.15.72:0/983411883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80cc310 0x7fe1a80c5840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 >> 172.21.15.72:0/983411883 conn(0x7fe1a80d0180 msgr2=0x7fe1a81586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 shutdown_connections 2023-10-14T12:33:45.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:45.835+0000 7fe1acfd4700 1 -- 172.21.15.72:0/983411883 wait complete. 2023-10-14T12:33:45.840 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-10-14T12:33:45.848 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-10-14T12:33:45.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:45.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:33:45.883 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[111522]: fuse finished with error 0 and tester_r 0 2023-10-14T12:33:45.884 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:33:45.923 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:33:45.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:45.924 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-14T12:33:45.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.146+0000 7f57cfc76700 1 Processor -- start 2023-10-14T12:33:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.146+0000 7f57cfc76700 1 -- start start 2023-10-14T12:33:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cfc76700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c8071850 0x7f57c8071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cfc76700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f57c806d100 0x7f57c806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cfc76700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c80721f0 con 0x7f57c815daa0 2023-10-14T12:33:46.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cfc76700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c815ed10 con 0x7f57c806d100 2023-10-14T12:33:46.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cfc76700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c815de80 con 0x7f57c8071850 2023-10-14T12:33:46.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cda12700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f57c815daa0 0x7f57c80af020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52866/0 (socket says 172.21.15.72:52866) 2023-10-14T12:33:46.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cda12700 1 -- 172.21.15.72:0/2435354391 learned_addr learned my addr 172.21.15.72:0/2435354391 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cd211700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c8071850 0x7f57c8071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57ce213700 1 --2- 172.21.15.72:0/2435354391 >> v2:172.21.15.123:3300/0 conn(0x7f57c806d100 0x7f57c806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592025539 0 0) 0x7f57c80721f0 con 0x7f57c815daa0 2023-10-14T12:33:46.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57b40035b0 con 0x7f57c815daa0 2023-10-14T12:33:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557055594 0 0) 0x7f57b40035b0 con 0x7f57c815daa0 2023-10-14T12:33:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c8071850 msgr2=0x7f57c8071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c8071850 0x7f57c8071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 >> v2:172.21.15.123:3300/0 conn(0x7f57c806d100 msgr2=0x7f57c806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:46.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 --2- 172.21.15.72:0/2435354391 >> v2:172.21.15.123:3300/0 conn(0x7f57c806d100 0x7f57c806d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c815e100 con 0x7f57c815daa0 2023-10-14T12:33:46.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f57c4001670 con 0x7f57c815daa0 2023-10-14T12:33:46.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 >> v1:172.21.15.72:6789/0 conn(0x7f57c815daa0 legacy=0x7f57c80af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4003a00 0x7f57b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.147+0000 7f57cca10700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57b4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cca10700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c8071850 0x7f57b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c815ed10 con 0x7f57b4004850 2023-10-14T12:33:46.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c815de80 con 0x7f57b4003a00 2023-10-14T12:33:46.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b400ba10 con 0x7f57c8071850 2023-10-14T12:33:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cd211700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57b4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cda12700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4003a00 0x7f57b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57ce213700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c8071850 0x7f57b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cd211700 1 -- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c8071850 msgr2=0x7f57b4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cd211700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c8071850 0x7f57b4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cd211700 1 -- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4003a00 msgr2=0x7f57b4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cd211700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57b4003a00 0x7f57b4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cd211700 1 -- 172.21.15.72:0/2435354391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40035b0 con 0x7f57b4004850 2023-10-14T12:33:46.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cd211700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57b4004cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009b60 tx=0x7f57b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9f8e81b80dcfab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800e6c0 con 0x7f57b4004850 2023-10-14T12:33:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b800e820 con 0x7f57b4004850 2023-10-14T12:33:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.148+0000 7f57cca10700 1 -- 172.21.15.72:0/2435354391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800eb90 con 0x7f57b4004850 2023-10-14T12:33:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.149+0000 7f57cfc76700 1 -- 172.21.15.72:0/2435354391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 msgr2=0x7f57b4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.149+0000 7f57cfc76700 1 --2- 172.21.15.72:0/2435354391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57b4004cd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009b60 tx=0x7f57b4005880 comp rx=0 tx=0).stop 2023-10-14T12:33:46.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.149+0000 7f57ce213700 1 -- 172.21.15.72:0/2435354391 reap_dead start 2023-10-14T12:33:46.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.149+0000 7f57cfc76700 1 -- 172.21.15.72:0/2435354391 shutdown_connections 2023-10-14T12:33:46.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.149+0000 7f57cfc76700 1 -- 172.21.15.72:0/2435354391 >> 172.21.15.72:0/2435354391 conn(0x7f57c80d0180 msgr2=0x7f57c80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:46.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.149+0000 7f57cfc76700 1 -- 172.21.15.72:0/2435354391 shutdown_connections 2023-10-14T12:33:46.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.149+0000 7f57cfc76700 1 -- 172.21.15.72:0/2435354391 wait complete. 2023-10-14T12:33:46.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.150+0000 7f57cfc76700 1 Processor -- start 2023-10-14T12:33:46.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.150+0000 7f57cfc76700 1 -- start start 2023-10-14T12:33:46.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cfc76700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57c814e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cfc76700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c80c4fe0 0x7f57c8099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cfc76700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57c809d160 0x7f57c80c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cfc76700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c809b030 con 0x7f57b4004850 2023-10-14T12:33:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cfc76700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c809c400 con 0x7f57c809d160 2023-10-14T12:33:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cfc76700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80c54e0 con 0x7f57c80c4fe0 2023-10-14T12:33:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cda12700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57c814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cda12700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57c814e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46574/0 (socket says 172.21.15.72:46574) 2023-10-14T12:33:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cda12700 1 -- 172.21.15.72:0/3730204865 learned_addr learned my addr 172.21.15.72:0/3730204865 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57ce213700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57c809d160 0x7f57c80c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cd211700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c80c4fe0 0x7f57c8099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cda12700 1 -- 172.21.15.72:0/3730204865 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c80c4fe0 msgr2=0x7f57c8099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cda12700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c80c4fe0 0x7f57c8099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cda12700 1 -- 172.21.15.72:0/3730204865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57c809d160 msgr2=0x7f57c80c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cda12700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57c809d160 0x7f57c80c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cda12700 1 -- 172.21.15.72:0/3730204865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c809c680 con 0x7f57b4004850 2023-10-14T12:33:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57ce213700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57c809d160 0x7f57c80c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cda12700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57c814e990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f57c4007340 tx=0x7f57c4007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:46.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57be7fc700 1 -- 172.21.15.72:0/3730204865 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c400f660 con 0x7f57b4004850 2023-10-14T12:33:46.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57be7fc700 1 -- 172.21.15.72:0/3730204865 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c400f800 con 0x7f57b4004850 2023-10-14T12:33:46.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57be7fc700 1 -- 172.21.15.72:0/3730204865 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c400fbb0 con 0x7f57b4004850 2023-10-14T12:33:46.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c809c960 con 0x7f57b4004850 2023-10-14T12:33:46.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.151+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c8099f80 con 0x7f57b4004850 2023-10-14T12:33:46.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.152+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c804ebb0 con 0x7f57b4004850 2023-10-14T12:33:46.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.153+0000 7f57be7fc700 1 -- 172.21.15.72:0/3730204865 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f57c400fd10 con 0x7f57b4004850 2023-10-14T12:33:46.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.153+0000 7f57be7fc700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f57ac06af00 0x7f57ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.153+0000 7f57be7fc700 1 -- 172.21.15.72:0/3730204865 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57c4089950 con 0x7f57b4004850 2023-10-14T12:33:46.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.153+0000 7f57cd211700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f57ac06af00 0x7f57ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.154+0000 7f57cd211700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f57ac06af00 0x7f57ac06d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009a80 tx=0x7f57b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.158+0000 7f57be7fc700 1 -- 172.21.15.72:0/3730204865 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57c4054670 con 0x7f57b4004850 2023-10-14T12:33:46.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.346+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57c8072690 con 0x7f57b4004850 2023-10-14T12:33:46.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.347+0000 7f57be7fc700 1 -- 172.21.15.72:0/3730204865 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f57c4057c90 con 0x7f57b4004850 2023-10-14T12:33:46.349 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:46.349 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:46.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f57ac06af00 msgr2=0x7f57ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f57ac06af00 0x7f57ac06d3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009a80 tx=0x7f57b8008030 comp rx=0 tx=0).stop 2023-10-14T12:33:46.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 msgr2=0x7f57c814e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57c814e990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f57c4007340 tx=0x7f57c4007650 comp rx=0 tx=0).stop 2023-10-14T12:33:46.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 shutdown_connections 2023-10-14T12:33:46.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f57ac06af00 0x7f57ac06d3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57c809d160 0x7f57c80c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57b4004850 0x7f57c814e990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 --2- 172.21.15.72:0/3730204865 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f57c80c4fe0 0x7f57c8099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 >> 172.21.15.72:0/3730204865 conn(0x7f57c80d0180 msgr2=0x7f57c80cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:46.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.349+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 shutdown_connections 2023-10-14T12:33:46.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.350+0000 7f57cfc76700 1 -- 172.21.15.72:0/3730204865 wait complete. 2023-10-14T12:33:46.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.481+0000 7f0e5f0b6700 1 Processor -- start 2023-10-14T12:33:46.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.481+0000 7f0e5f0b6700 1 -- start start 2023-10-14T12:33:46.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e5f0b6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e580cf7d0 0x7f0e5815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e5f0b6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580cfeb0 con 0x7f0e580ca7d0 2023-10-14T12:33:46.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e5f0b6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580cfc30 con 0x7f0e5806a820 2023-10-14T12:33:46.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e5f0b6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580ce410 con 0x7f0e580cf7d0 2023-10-14T12:33:46.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e57fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e580cf7d0 0x7f0e5815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e5d653700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0e580ca7d0 0x7f0e58071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52886/0 (socket says 172.21.15.72:52886) 2023-10-14T12:33:46.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e5d653700 1 -- 172.21.15.72:0/3131340944 learned_addr learned my addr 172.21.15.72:0/3131340944 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:46.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e57fff700 1 -- 172.21.15.72:0/3131340944 >> v1:172.21.15.123:6789/0 conn(0x7f0e5806a820 legacy=0x7f0e5806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e57fff700 1 -- 172.21.15.72:0/3131340944 >> v1:172.21.15.72:6789/0 conn(0x7f0e580ca7d0 legacy=0x7f0e58071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e57fff700 1 -- 172.21.15.72:0/3131340944 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580af9d0 con 0x7f0e580cf7d0 2023-10-14T12:33:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.482+0000 7f0e577fe700 1 -- 172.21.15.72:0/3131340944 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374720758 0 0) 0x7f0e580cfeb0 con 0x7f0e580ca7d0 2023-10-14T12:33:46.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e57fff700 1 --2- 172.21.15.72:0/3131340944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 0x7f0e5815e7f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009840 tx=0x7f0e44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a9b0567a4afa5d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:46.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e577fe700 1 -- 172.21.15.72:0/3131340944 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44011830 con 0x7f0e580cf7d0 2023-10-14T12:33:46.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e577fe700 1 -- 172.21.15.72:0/3131340944 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e44011990 con 0x7f0e580cf7d0 2023-10-14T12:33:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e577fe700 1 -- 172.21.15.72:0/3131340944 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44011d20 con 0x7f0e580cf7d0 2023-10-14T12:33:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/3131340944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 msgr2=0x7f0e5815e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e5f0b6700 1 --2- 172.21.15.72:0/3131340944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 0x7f0e5815e7f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009840 tx=0x7f0e44009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:46.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/3131340944 shutdown_connections 2023-10-14T12:33:46.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e5f0b6700 1 --2- 172.21.15.72:0/3131340944 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 0x7f0e5815e7f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/3131340944 >> 172.21.15.72:0/3131340944 conn(0x7f0e580d0180 msgr2=0x7f0e580d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:46.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/3131340944 shutdown_connections 2023-10-14T12:33:46.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.483+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/3131340944 wait complete. 2023-10-14T12:33:46.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.484+0000 7f0e5f0b6700 1 Processor -- start 2023-10-14T12:33:46.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.485+0000 7f0e5f0b6700 1 -- start start 2023-10-14T12:33:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.485+0000 7f0e5f0b6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0e5806a820 0x7f0e5814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.485+0000 7f0e5f0b6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e580ca7d0 0x7f0e580c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.485+0000 7f0e5f0b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 0x7f0e5815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.485+0000 7f0e5f0b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5814ba90 con 0x7f0e580cf7d0 2023-10-14T12:33:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.485+0000 7f0e5f0b6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580b2d50 con 0x7f0e580ca7d0 2023-10-14T12:33:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.485+0000 7f0e5f0b6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580b4a50 con 0x7f0e5806a820 2023-10-14T12:33:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5d653700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 0x7f0e5815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5d653700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 0x7f0e5815c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46590/0 (socket says 172.21.15.72:46590) 2023-10-14T12:33:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5d653700 1 -- 172.21.15.72:0/4152998578 learned_addr learned my addr 172.21.15.72:0/4152998578 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e57fff700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e580ca7d0 0x7f0e580c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5d653700 1 -- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0e5806a820 msgr2=0x7f0e5814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5ce52700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0e5806a820 0x7f0e5814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5d653700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0e5806a820 0x7f0e5814af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5d653700 1 -- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e580ca7d0 msgr2=0x7f0e580c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5d653700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e580ca7d0 0x7f0e580c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5d653700 1 -- 172.21.15.72:0/4152998578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440094a0 con 0x7f0e580cf7d0 2023-10-14T12:33:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e57fff700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e580ca7d0 0x7f0e580c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5ce52700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0e5806a820 0x7f0e5814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5d653700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 0x7f0e5815c790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000cba0 tx=0x7f0e5000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e557fa700 1 -- 172.21.15.72:0/4152998578 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000ab80 con 0x7f0e580cf7d0 2023-10-14T12:33:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e557fa700 1 -- 172.21.15.72:0/4152998578 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000ad00 con 0x7f0e580cf7d0 2023-10-14T12:33:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e580c9ce0 con 0x7f0e580cf7d0 2023-10-14T12:33:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e557fa700 1 -- 172.21.15.72:0/4152998578 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50007310 con 0x7f0e580cf7d0 2023-10-14T12:33:46.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.486+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e580b2fa0 con 0x7f0e580cf7d0 2023-10-14T12:33:46.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.487+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5804ebb0 con 0x7f0e580cf7d0 2023-10-14T12:33:46.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.487+0000 7f0e557fa700 1 -- 172.21.15.72:0/4152998578 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0e50007470 con 0x7f0e580cf7d0 2023-10-14T12:33:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.488+0000 7f0e557fa700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0e3c06af00 0x7f0e3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.488+0000 7f0e557fa700 1 -- 172.21.15.72:0/4152998578 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e50089690 con 0x7f0e580cf7d0 2023-10-14T12:33:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.488+0000 7f0e5ce52700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0e3c06af00 0x7f0e3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.488+0000 7f0e5ce52700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0e3c06af00 0x7f0e3c06d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000f60 tx=0x7f0e4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:46.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.492+0000 7f0e557fa700 1 -- 172.21.15.72:0/4152998578 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e50054450 con 0x7f0e580cf7d0 2023-10-14T12:33:46.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.682+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e580c7010 con 0x7f0e580cf7d0 2023-10-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.683+0000 7f0e557fa700 1 -- 172.21.15.72:0/4152998578 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f0e50057a70 con 0x7f0e580cf7d0 2023-10-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:46.685 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.685+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0e3c06af00 msgr2=0x7f0e3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.685+0000 7f0e5f0b6700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0e3c06af00 0x7f0e3c06d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000f60 tx=0x7f0e4c009040 comp rx=0 tx=0).stop 2023-10-14T12:33:46.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.685+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 msgr2=0x7f0e5815c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.685+0000 7f0e5f0b6700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 0x7f0e5815c790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000cba0 tx=0x7f0e5000cf60 comp rx=0 tx=0).stop 2023-10-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.686+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 shutdown_connections 2023-10-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.686+0000 7f0e5f0b6700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0e3c06af00 0x7f0e3c06d3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.686+0000 7f0e5f0b6700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e580cf7d0 0x7f0e5815c790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.686+0000 7f0e5f0b6700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0e5806a820 0x7f0e5814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.686+0000 7f0e5f0b6700 1 --2- 172.21.15.72:0/4152998578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e580ca7d0 0x7f0e580c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.686+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 >> 172.21.15.72:0/4152998578 conn(0x7f0e580d0180 msgr2=0x7f0e58071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.686+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 shutdown_connections 2023-10-14T12:33:46.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.686+0000 7f0e5f0b6700 1 -- 172.21.15.72:0/4152998578 wait complete. 2023-10-14T12:33:46.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T12:33:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.824+0000 7fd08303b700 1 Processor -- start 2023-10-14T12:33:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.824+0000 7fd08303b700 1 -- start start 2023-10-14T12:33:46.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd08303b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd07c06b370 0x7fd07c15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd08303b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd07c06a820 0x7fd07c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd08303b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07c161360 con 0x7fd07c0cdd30 2023-10-14T12:33:46.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd08303b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07c06b750 con 0x7fd07c06b370 2023-10-14T12:33:46.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd08303b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07c15e300 con 0x7fd07c06a820 2023-10-14T12:33:46.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd080dd7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd07c06b370 0x7fd07c15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd0815d8700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd07c0cdd30 0x7fd07c1617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52898/0 (socket says 172.21.15.72:52898) 2023-10-14T12:33:46.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd0815d8700 1 -- 172.21.15.72:0/2526370805 learned_addr learned my addr 172.21.15.72:0/2526370805 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:46.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd07bfff700 1 --2- 172.21.15.72:0/2526370805 >> v2:172.21.15.123:3300/0 conn(0x7fd07c06a820 0x7fd07c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd080dd7700 1 -- 172.21.15.72:0/2526370805 >> v2:172.21.15.123:3300/0 conn(0x7fd07c06a820 msgr2=0x7fd07c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:46.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd080dd7700 1 --2- 172.21.15.72:0/2526370805 >> v2:172.21.15.123:3300/0 conn(0x7fd07c06a820 0x7fd07c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd080dd7700 1 -- 172.21.15.72:0/2526370805 >> v1:172.21.15.72:6789/0 conn(0x7fd07c0cdd30 legacy=0x7fd07c1617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd07b7fe700 1 -- 172.21.15.72:0/2526370805 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713033605 0 0) 0x7fd07c161360 con 0x7fd07c0cdd30 2023-10-14T12:33:46.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.825+0000 7fd080dd7700 1 -- 172.21.15.72:0/2526370805 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c15e5e0 con 0x7fd07c06b370 2023-10-14T12:33:46.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd080dd7700 1 --2- 172.21.15.72:0/2526370805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06b370 0x7fd07c15dcb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd07c070360 tx=0x7fd070009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596c498b42f10726 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:46.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd07b7fe700 1 -- 172.21.15.72:0/2526370805 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070011830 con 0x7fd07c06b370 2023-10-14T12:33:46.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd07b7fe700 1 -- 172.21.15.72:0/2526370805 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd070011990 con 0x7fd07c06b370 2023-10-14T12:33:46.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd07b7fe700 1 -- 172.21.15.72:0/2526370805 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070011d20 con 0x7fd07c06b370 2023-10-14T12:33:46.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd08303b700 1 -- 172.21.15.72:0/2526370805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06b370 msgr2=0x7fd07c15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd08303b700 1 --2- 172.21.15.72:0/2526370805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06b370 0x7fd07c15dcb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd07c070360 tx=0x7fd070009b20 comp rx=0 tx=0).stop 2023-10-14T12:33:46.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd08303b700 1 -- 172.21.15.72:0/2526370805 shutdown_connections 2023-10-14T12:33:46.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd08303b700 1 --2- 172.21.15.72:0/2526370805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06b370 0x7fd07c15dcb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd08303b700 1 --2- 172.21.15.72:0/2526370805 >> v2:172.21.15.123:3300/0 conn(0x7fd07c06a820 0x7fd07c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.826+0000 7fd08303b700 1 -- 172.21.15.72:0/2526370805 >> 172.21.15.72:0/2526370805 conn(0x7fd07c0ccbe0 msgr2=0x7fd07c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:46.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.827+0000 7fd08303b700 1 -- 172.21.15.72:0/2526370805 shutdown_connections 2023-10-14T12:33:46.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.827+0000 7fd08303b700 1 -- 172.21.15.72:0/2526370805 wait complete. 2023-10-14T12:33:46.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.828+0000 7fd08303b700 1 Processor -- start 2023-10-14T12:33:46.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.828+0000 7fd08303b700 1 -- start start 2023-10-14T12:33:46.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd08303b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06a820 0x7fd07c0c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd08303b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd07c06b370 0x7fd07c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd08303b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd07c0cdd30 0x7fd07c0b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd08303b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c0c4990 con 0x7fd07c06a820 2023-10-14T12:33:46.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd08303b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c0c35c0 con 0x7fd07c06b370 2023-10-14T12:33:46.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd08303b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c0b32b0 con 0x7fd07c0cdd30 2023-10-14T12:33:46.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd080dd7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06a820 0x7fd07c0c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd080dd7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06a820 0x7fd07c0c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46600/0 (socket says 172.21.15.72:46600) 2023-10-14T12:33:46.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd080dd7700 1 -- 172.21.15.72:0/3994977485 learned_addr learned my addr 172.21.15.72:0/3994977485 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:46.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd07bfff700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd07c06b370 0x7fd07c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd0815d8700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd07c0cdd30 0x7fd07c0b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd080dd7700 1 -- 172.21.15.72:0/3994977485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd07c0cdd30 msgr2=0x7fd07c0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd080dd7700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd07c0cdd30 0x7fd07c0b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd080dd7700 1 -- 172.21.15.72:0/3994977485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd07c06b370 msgr2=0x7fd07c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:46.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd080dd7700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd07c06b370 0x7fd07c158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:46.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd080dd7700 1 -- 172.21.15.72:0/3994977485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0700094a0 con 0x7fd07c06a820 2023-10-14T12:33:46.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.829+0000 7fd080dd7700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06a820 0x7fd07c0c3080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd070009b60 tx=0x7fd070004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:46.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.830+0000 7fd0797fa700 1 -- 172.21.15.72:0/3994977485 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0700036a0 con 0x7fd07c06a820 2023-10-14T12:33:46.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.830+0000 7fd0797fa700 1 -- 172.21.15.72:0/3994977485 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07001e070 con 0x7fd07c06a820 2023-10-14T12:33:46.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.830+0000 7fd0797fa700 1 -- 172.21.15.72:0/3994977485 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070003a20 con 0x7fd07c06a820 2023-10-14T12:33:46.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.830+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07c0c4be0 con 0x7fd07c06a820 2023-10-14T12:33:46.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.830+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07c0c51a0 con 0x7fd07c06a820 2023-10-14T12:33:46.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.831+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07c072d10 con 0x7fd07c06a820 2023-10-14T12:33:46.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.831+0000 7fd0797fa700 1 -- 172.21.15.72:0/3994977485 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd070003b80 con 0x7fd07c06a820 2023-10-14T12:33:46.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.832+0000 7fd0797fa700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06006af00 0x7fd06006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:46.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.832+0000 7fd07bfff700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06006af00 0x7fd06006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:46.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.832+0000 7fd0797fa700 1 -- 172.21.15.72:0/3994977485 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd07008a750 con 0x7fd07c06a820 2023-10-14T12:33:46.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.832+0000 7fd07bfff700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06006af00 0x7fd06006d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0b0af0 tx=0x7fd068009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:46.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:46.836+0000 7fd0797fa700 1 -- 172.21.15.72:0/3994977485 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd070055510 con 0x7fd07c06a820 2023-10-14T12:33:47.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.070+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd07c0c39b0 con 0x7fd07c06a820 2023-10-14T12:33:47.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.516+0000 7fd0797fa700 1 -- 172.21.15.72:0/3994977485 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd070058b30 con 0x7fd07c06a820 2023-10-14T12:33:47.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06006af00 msgr2=0x7fd06006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:47.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06006af00 0x7fd06006d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0b0af0 tx=0x7fd068009210 comp rx=0 tx=0).stop 2023-10-14T12:33:47.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06a820 msgr2=0x7fd07c0c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:47.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06a820 0x7fd07c0c3080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd070009b60 tx=0x7fd070004750 comp rx=0 tx=0).stop 2023-10-14T12:33:47.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 shutdown_connections 2023-10-14T12:33:47.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06006af00 0x7fd06006d3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd07c0cdd30 0x7fd07c0b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd07c06a820 0x7fd07c0c3080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 --2- 172.21.15.72:0/3994977485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd07c06b370 0x7fd07c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 >> 172.21.15.72:0/3994977485 conn(0x7fd07c0ccbe0 msgr2=0x7fd07c1576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:47.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 shutdown_connections 2023-10-14T12:33:47.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.519+0000 7fd08303b700 1 -- 172.21.15.72:0/3994977485 wait complete. 2023-10-14T12:33:47.535 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-14T12:33:47.536 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T12:33:47.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.664+0000 7f2f4d26d700 1 Processor -- start 2023-10-14T12:33:47.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.665+0000 7f2f4d26d700 1 -- start start 2023-10-14T12:33:47.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.665+0000 7f2f4d26d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f4806b370 0x7f2f4815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:47.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.665+0000 7f2f4d26d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f4806a820 0x7f2f4806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:47.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.665+0000 7f2f4d26d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f480cdd30 0x7f2f480ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:47.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.665+0000 7f2f4d26d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480ce6d0 con 0x7f2f4806a820 2023-10-14T12:33:47.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.665+0000 7f2f4d26d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f48161360 con 0x7f2f480cdd30 2023-10-14T12:33:47.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.665+0000 7f2f4d26d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4806b750 con 0x7f2f4806b370 2023-10-14T12:33:47.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.665+0000 7f2f467fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f4806a820 0x7f2f4806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:47.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.665+0000 7f2f467fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2f4806a820 0x7f2f4806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46610/0 (socket says 172.21.15.72:46610) 2023-10-14T12:33:47.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f467fc700 1 -- 172.21.15.72:0/1723926041 learned_addr learned my addr 172.21.15.72:0/1723926041 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:47.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f477fe700 1 --2- 172.21.15.72:0/1723926041 >> v2:172.21.15.123:3300/0 conn(0x7f2f480cdd30 0x7f2f480ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:47.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f46ffd700 1 --2- 172.21.15.72:0/1723926041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f4806b370 0x7f2f4815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:47.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f467fc700 1 -- 172.21.15.72:0/1723926041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f4806b370 msgr2=0x7f2f4815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:47.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f467fc700 1 --2- 172.21.15.72:0/1723926041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f4806b370 0x7f2f4815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f467fc700 1 -- 172.21.15.72:0/1723926041 >> v2:172.21.15.123:3300/0 conn(0x7f2f480cdd30 msgr2=0x7f2f480ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:47.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f467fc700 1 --2- 172.21.15.72:0/1723926041 >> v2:172.21.15.123:3300/0 conn(0x7f2f480cdd30 0x7f2f480ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f467fc700 1 -- 172.21.15.72:0/1723926041 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4815e300 con 0x7f2f4806a820 2023-10-14T12:33:47.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f467fc700 1 --2- 172.21.15.72:0/1723926041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 0x7f2f4806d5b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2f480cfb80 tx=0x7f2f38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a17cdea19429cd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:47.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f45ffb700 1 -- 172.21.15.72:0/1723926041 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38011830 con 0x7f2f4806a820 2023-10-14T12:33:47.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f45ffb700 1 -- 172.21.15.72:0/1723926041 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f38011990 con 0x7f2f4806a820 2023-10-14T12:33:47.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.666+0000 7f2f45ffb700 1 -- 172.21.15.72:0/1723926041 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38011d20 con 0x7f2f4806a820 2023-10-14T12:33:47.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.667+0000 7f2f4d26d700 1 -- 172.21.15.72:0/1723926041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 msgr2=0x7f2f4806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:47.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.667+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/1723926041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 0x7f2f4806d5b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2f480cfb80 tx=0x7f2f38009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.667+0000 7f2f4d26d700 1 -- 172.21.15.72:0/1723926041 shutdown_connections 2023-10-14T12:33:47.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.667+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/1723926041 >> v2:172.21.15.123:3300/0 conn(0x7f2f480cdd30 0x7f2f480ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.667+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/1723926041 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f4806b370 0x7f2f4815dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.667+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/1723926041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 0x7f2f4806d5b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.667+0000 7f2f4d26d700 1 -- 172.21.15.72:0/1723926041 >> 172.21.15.72:0/1723926041 conn(0x7f2f480ccbe0 msgr2=0x7f2f480ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:47.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.667+0000 7f2f4d26d700 1 -- 172.21.15.72:0/1723926041 shutdown_connections 2023-10-14T12:33:47.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.667+0000 7f2f4d26d700 1 -- 172.21.15.72:0/1723926041 wait complete. 2023-10-14T12:33:47.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.668+0000 7f2f4d26d700 1 Processor -- start 2023-10-14T12:33:47.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.668+0000 7f2f4d26d700 1 -- start start 2023-10-14T12:33:47.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f4d26d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 0x7f2f48155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:47.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f4d26d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f4806b370 0x7f2f4815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:47.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f4d26d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f480cdd30 0x7f2f480c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:47.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f4d26d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4815d650 con 0x7f2f4806a820 2023-10-14T12:33:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f4d26d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f481557d0 con 0x7f2f4806b370 2023-10-14T12:33:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f4d26d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4815d370 con 0x7f2f480cdd30 2023-10-14T12:33:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f46ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 0x7f2f48155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f46ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 0x7f2f48155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46616/0 (socket says 172.21.15.72:46616) 2023-10-14T12:33:47.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f46ffd700 1 -- 172.21.15.72:0/2397839728 learned_addr learned my addr 172.21.15.72:0/2397839728 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f467fc700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f4806b370 0x7f2f4815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f477fe700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f480cdd30 0x7f2f480c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f46ffd700 1 -- 172.21.15.72:0/2397839728 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f480cdd30 msgr2=0x7f2f480c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f46ffd700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f480cdd30 0x7f2f480c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f46ffd700 1 -- 172.21.15.72:0/2397839728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f4806b370 msgr2=0x7f2f4815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f46ffd700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f4806b370 0x7f2f4815c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f46ffd700 1 -- 172.21.15.72:0/2397839728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38009550 con 0x7f2f4806a820 2023-10-14T12:33:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f467fc700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f4806b370 0x7f2f4815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.669+0000 7f2f46ffd700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 0x7f2f48155290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00e870 tx=0x7f2f3c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:47.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.670+0000 7f2f2f7fe700 1 -- 172.21.15.72:0/2397839728 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c013680 con 0x7f2f4806a820 2023-10-14T12:33:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.670+0000 7f2f2f7fe700 1 -- 172.21.15.72:0/2397839728 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0137e0 con 0x7f2f4806a820 2023-10-14T12:33:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.670+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f480aca60 con 0x7f2f4806a820 2023-10-14T12:33:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.670+0000 7f2f2f7fe700 1 -- 172.21.15.72:0/2397839728 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c013b90 con 0x7f2f4806a820 2023-10-14T12:33:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.670+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f480ad020 con 0x7f2f4806a820 2023-10-14T12:33:47.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.671+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f480ad390 con 0x7f2f4806a820 2023-10-14T12:33:47.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.672+0000 7f2f2f7fe700 1 -- 172.21.15.72:0/2397839728 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f3c013cf0 con 0x7f2f4806a820 2023-10-14T12:33:47.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.672+0000 7f2f2f7fe700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2f3406af00 0x7f2f3406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:47.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.672+0000 7f2f2f7fe700 1 -- 172.21.15.72:0/2397839728 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f3c089e70 con 0x7f2f4806a820 2023-10-14T12:33:47.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.672+0000 7f2f467fc700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2f3406af00 0x7f2f3406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:47.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.673+0000 7f2f467fc700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2f3406af00 0x7f2f3406d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f38014040 tx=0x7f2f38008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:47.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.676+0000 7f2f2f7fe700 1 -- 172.21.15.72:0/2397839728 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f3c054d10 con 0x7f2f4806a820 2023-10-14T12:33:47.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:47.919+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2f48072d10 con 0x7f2f4806a820 2023-10-14T12:33:48.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.517+0000 7f2f2f7fe700 1 -- 172.21.15.72:0/2397839728 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2f3c0170c0 con 0x7f2f4806a820 2023-10-14T12:33:48.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2f3406af00 msgr2=0x7f2f3406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:48.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2f3406af00 0x7f2f3406d3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f38014040 tx=0x7f2f38008030 comp rx=0 tx=0).stop 2023-10-14T12:33:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 msgr2=0x7f2f48155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 0x7f2f48155290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00e870 tx=0x7f2f3c00eb80 comp rx=0 tx=0).stop 2023-10-14T12:33:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 shutdown_connections 2023-10-14T12:33:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2f3406af00 0x7f2f3406d3c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2f480cdd30 0x7f2f480c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4806a820 0x7f2f48155290 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 --2- 172.21.15.72:0/2397839728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f4806b370 0x7f2f4815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 >> 172.21.15.72:0/2397839728 conn(0x7f2f480ccbe0 msgr2=0x7f2f480b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:48.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 shutdown_connections 2023-10-14T12:33:48.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.520+0000 7f2f4d26d700 1 -- 172.21.15.72:0/2397839728 wait complete. 2023-10-14T12:33:48.535 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-14T12:33:48.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:33:48.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.655+0000 7f4f5dd15700 1 Processor -- start 2023-10-14T12:33:48.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.655+0000 7f4f5dd15700 1 -- start start 2023-10-14T12:33:48.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f5dd15700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 0x7f4f580ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:48.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f5dd15700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f5815c910 0x7f4f580ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f5dd15700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f580cdf20 con 0x7f4f580cebd0 2023-10-14T12:33:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f5dd15700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f580cf770 con 0x7f4f5815c910 2023-10-14T12:33:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f5dd15700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580ca810 con 0x7f4f580c9ef0 2023-10-14T12:33:48.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f56ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f5815c910 0x7f4f580ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:48.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f56ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f5815c910 0x7f4f580ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46624/0 (socket says 172.21.15.72:46624) 2023-10-14T12:33:48.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f56ffd700 1 -- 172.21.15.72:0/2479153006 learned_addr learned my addr 172.21.15.72:0/2479153006 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:48.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f577fe700 1 --2- 172.21.15.72:0/2479153006 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 0x7f4f580ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:48.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f56ffd700 1 -- 172.21.15.72:0/2479153006 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 msgr2=0x7f4f580ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f56ffd700 1 --2- 172.21.15.72:0/2479153006 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 0x7f4f580ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.656+0000 7f4f56ffd700 1 -- 172.21.15.72:0/2479153006 >> v1:172.21.15.123:6789/0 conn(0x7f4f580cebd0 legacy=0x7f4f5806a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f56ffd700 1 -- 172.21.15.72:0/2479153006 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f580cf490 con 0x7f4f5815c910 2023-10-14T12:33:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f56ffd700 1 --2- 172.21.15.72:0/2479153006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 0x7f4f580ca2d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4f480098f0 tx=0x7f4f48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e056c0fd4145bd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:48.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f567fc700 1 -- 172.21.15.72:0/2479153006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4800b8a0 con 0x7f4f5815c910 2023-10-14T12:33:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f567fc700 1 -- 172.21.15.72:0/2479153006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4800ba00 con 0x7f4f5815c910 2023-10-14T12:33:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f567fc700 1 -- 172.21.15.72:0/2479153006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4800bd90 con 0x7f4f5815c910 2023-10-14T12:33:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f5dd15700 1 -- 172.21.15.72:0/2479153006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 msgr2=0x7f4f580ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:48.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f5dd15700 1 --2- 172.21.15.72:0/2479153006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 0x7f4f580ca2d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4f480098f0 tx=0x7f4f48009c00 comp rx=0 tx=0).stop 2023-10-14T12:33:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f5dd15700 1 -- 172.21.15.72:0/2479153006 shutdown_connections 2023-10-14T12:33:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f5dd15700 1 --2- 172.21.15.72:0/2479153006 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 0x7f4f580ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f5dd15700 1 --2- 172.21.15.72:0/2479153006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 0x7f4f580ca2d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f5dd15700 1 -- 172.21.15.72:0/2479153006 >> 172.21.15.72:0/2479153006 conn(0x7f4f580b1420 msgr2=0x7f4f580b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:48.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f5dd15700 1 -- 172.21.15.72:0/2479153006 shutdown_connections 2023-10-14T12:33:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.657+0000 7f4f5dd15700 1 -- 172.21.15.72:0/2479153006 wait complete. 2023-10-14T12:33:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.659+0000 7f4f5dd15700 1 Processor -- start 2023-10-14T12:33:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.659+0000 7f4f5dd15700 1 -- start start 2023-10-14T12:33:48.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.659+0000 7f4f5dd15700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 0x7f4f58154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.659+0000 7f4f5dd15700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580cebd0 0x7f4f580ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.659+0000 7f4f5dd15700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 0x7f4f580c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.659+0000 7f4f5dd15700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f580c6d20 con 0x7f4f5815c910 2023-10-14T12:33:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.659+0000 7f4f5dd15700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f581f2fa0 con 0x7f4f580cebd0 2023-10-14T12:33:48.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.659+0000 7f4f5dd15700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f581553d0 con 0x7f4f580c9ef0 2023-10-14T12:33:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f57fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 0x7f4f580c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f57fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 0x7f4f580c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46632/0 (socket says 172.21.15.72:46632) 2023-10-14T12:33:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f57fff700 1 -- 172.21.15.72:0/1197773178 learned_addr learned my addr 172.21.15.72:0/1197773178 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f577fe700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 0x7f4f58154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f56ffd700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580cebd0 0x7f4f580ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:48.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f57fff700 1 -- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 msgr2=0x7f4f58154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:48.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f57fff700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 0x7f4f58154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f57fff700 1 -- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580cebd0 msgr2=0x7f4f580ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:48.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f57fff700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580cebd0 0x7f4f580ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f57fff700 1 -- 172.21.15.72:0/1197773178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48009550 con 0x7f4f5815c910 2023-10-14T12:33:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f577fe700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 0x7f4f58154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f56ffd700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580cebd0 0x7f4f580ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f57fff700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 0x7f4f580c8220 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000cb50 tx=0x7f4f5000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f3ffff700 1 -- 172.21.15.72:0/1197773178 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50003c00 con 0x7f4f5815c910 2023-10-14T12:33:48.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f3ffff700 1 -- 172.21.15.72:0/1197773178 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f50003d60 con 0x7f4f5815c910 2023-10-14T12:33:48.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5806d710 con 0x7f4f5815c910 2023-10-14T12:33:48.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f3ffff700 1 -- 172.21.15.72:0/1197773178 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5000ab70 con 0x7f4f5815c910 2023-10-14T12:33:48.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.660+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5806d150 con 0x7f4f5815c910 2023-10-14T12:33:48.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.661+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f581f3110 con 0x7f4f5815c910 2023-10-14T12:33:48.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.662+0000 7f4f3ffff700 1 -- 172.21.15.72:0/1197773178 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f5000acd0 con 0x7f4f5815c910 2023-10-14T12:33:48.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.662+0000 7f4f3ffff700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4f4406af00 0x7f4f4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:48.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.662+0000 7f4f3ffff700 1 -- 172.21.15.72:0/1197773178 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f50089920 con 0x7f4f5815c910 2023-10-14T12:33:48.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.662+0000 7f4f577fe700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4f4406af00 0x7f4f4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:48.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.662+0000 7f4f577fe700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4f4406af00 0x7f4f4406d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009820 tx=0x7f4f4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:48.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.667+0000 7f4f3ffff700 1 -- 172.21.15.72:0/1197773178 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f500546e0 con 0x7f4f5815c910 2023-10-14T12:33:48.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.900+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f580743d0 con 0x7f4f5815c910 2023-10-14T12:33:48.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.901+0000 7f4f3ffff700 1 -- 172.21.15.72:0/1197773178 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f4f50057d00 con 0x7f4f5815c910 2023-10-14T12:33:48.903 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:48.904 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:47.920500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:33:48.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4f4406af00 msgr2=0x7f4f4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:48.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4f4406af00 0x7f4f4406d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009820 tx=0x7f4f4c008040 comp rx=0 tx=0).stop 2023-10-14T12:33:48.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 msgr2=0x7f4f580c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:48.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 0x7f4f580c8220 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000cb50 tx=0x7f4f5000cf10 comp rx=0 tx=0).stop 2023-10-14T12:33:48.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 shutdown_connections 2023-10-14T12:33:48.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4f4406af00 0x7f4f4406d3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f5815c910 0x7f4f580c8220 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f580c9ef0 0x7f4f58154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 --2- 172.21.15.72:0/1197773178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f580cebd0 0x7f4f580ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:48.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 >> 172.21.15.72:0/1197773178 conn(0x7f4f580b1420 msgr2=0x7f4f5815e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:48.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 shutdown_connections 2023-10-14T12:33:48.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:48.903+0000 7f4f5dd15700 1 -- 172.21.15.72:0/1197773178 wait complete. 2023-10-14T12:33:48.916 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-10-14T12:33:48.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.038+0000 7ff0e3115700 1 Processor -- start 2023-10-14T12:33:49.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.038+0000 7ff0e3115700 1 -- start start 2023-10-14T12:33:49.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0e3115700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff0dc071850 0x7ff0dc071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0e3115700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc0721f0 con 0x7ff0dc06d100 2023-10-14T12:33:49.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0e3115700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc15ed10 con 0x7ff0dc15daa0 2023-10-14T12:33:49.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0e3115700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc15de80 con 0x7ff0dc071850 2023-10-14T12:33:49.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff0dc071850 0x7ff0dc071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0e16b2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff0dc06d100 0x7ff0dc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52940/0 (socket says 172.21.15.72:52940) 2023-10-14T12:33:49.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0e16b2700 1 -- 172.21.15.72:0/2956402359 learned_addr learned my addr 172.21.15.72:0/2956402359 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:49.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0db7fe700 1 -- 172.21.15.72:0/2956402359 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888336637 0 0) 0x7ff0dc0721f0 con 0x7ff0dc06d100 2023-10-14T12:33:49.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0db7fe700 1 -- 172.21.15.72:0/2956402359 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0cc0035b0 con 0x7ff0dc06d100 2023-10-14T12:33:49.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0dbfff700 1 -- 172.21.15.72:0/2956402359 >> v1:172.21.15.123:6789/0 conn(0x7ff0dc15daa0 legacy=0x7ff0dc0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0dbfff700 1 -- 172.21.15.72:0/2956402359 >> v1:172.21.15.72:6789/0 conn(0x7ff0dc06d100 legacy=0x7ff0dc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0db7fe700 1 -- 172.21.15.72:0/2956402359 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494644831 0 0) 0x7ff0dc15ed10 con 0x7ff0dc15daa0 2023-10-14T12:33:49.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0dbfff700 1 -- 172.21.15.72:0/2956402359 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc15e100 con 0x7ff0dc071850 2023-10-14T12:33:49.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.039+0000 7ff0dbfff700 1 --2- 172.21.15.72:0/2956402359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc071850 0x7ff0dc071cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009840 tx=0x7ff0c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc93267d0f59355 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:49.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0db7fe700 1 -- 172.21.15.72:0/2956402359 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8011830 con 0x7ff0dc071850 2023-10-14T12:33:49.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0db7fe700 1 -- 172.21.15.72:0/2956402359 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c8011990 con 0x7ff0dc071850 2023-10-14T12:33:49.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0db7fe700 1 -- 172.21.15.72:0/2956402359 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8011d20 con 0x7ff0dc071850 2023-10-14T12:33:49.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0e3115700 1 -- 172.21.15.72:0/2956402359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc071850 msgr2=0x7ff0dc071cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0e3115700 1 --2- 172.21.15.72:0/2956402359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc071850 0x7ff0dc071cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009840 tx=0x7ff0c8009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0e3115700 1 -- 172.21.15.72:0/2956402359 shutdown_connections 2023-10-14T12:33:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0e3115700 1 --2- 172.21.15.72:0/2956402359 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc071850 0x7ff0dc071cb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0e3115700 1 -- 172.21.15.72:0/2956402359 >> 172.21.15.72:0/2956402359 conn(0x7ff0dc0d0180 msgr2=0x7ff0dc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0e3115700 1 -- 172.21.15.72:0/2956402359 shutdown_connections 2023-10-14T12:33:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.040+0000 7ff0e3115700 1 -- 172.21.15.72:0/2956402359 wait complete. 2023-10-14T12:33:49.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.041+0000 7ff0e3115700 1 Processor -- start 2023-10-14T12:33:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.041+0000 7ff0e3115700 1 -- start start 2023-10-14T12:33:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e3115700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc06d100 0x7ff0dc0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e3115700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0dc071850 0x7ff0dc1468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e3115700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0dc15daa0 0x7ff0dc0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e3115700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc146de0 con 0x7ff0dc06d100 2023-10-14T12:33:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e3115700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc14a040 con 0x7ff0dc071850 2023-10-14T12:33:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e3115700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b48b0 con 0x7ff0dc15daa0 2023-10-14T12:33:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e0eb1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc06d100 0x7ff0dc0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e0eb1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc06d100 0x7ff0dc0b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46642/0 (socket says 172.21.15.72:46642) 2023-10-14T12:33:49.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e0eb1700 1 -- 172.21.15.72:0/3219380038 learned_addr learned my addr 172.21.15.72:0/3219380038 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0dbfff700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0dc071850 0x7ff0dc1468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e16b2700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0dc15daa0 0x7ff0dc0c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e0eb1700 1 -- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0dc15daa0 msgr2=0x7ff0dc0c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.042+0000 7ff0e0eb1700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0dc15daa0 0x7ff0dc0c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0e0eb1700 1 -- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0dc071850 msgr2=0x7ff0dc1468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0e0eb1700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0dc071850 0x7ff0dc1468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0e0eb1700 1 -- 172.21.15.72:0/3219380038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80094a0 con 0x7ff0dc06d100 2023-10-14T12:33:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0dbfff700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0dc071850 0x7ff0dc1468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0e16b2700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0dc15daa0 0x7ff0dc0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:49.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0e0eb1700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc06d100 0x7ff0dc0b5950 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c530 tx=0x7ff0d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0d97fa700 1 -- 172.21.15.72:0/3219380038 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00054e0 con 0x7ff0dc06d100 2023-10-14T12:33:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0d97fa700 1 -- 172.21.15.72:0/3219380038 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0003680 con 0x7ff0dc06d100 2023-10-14T12:33:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0d97fa700 1 -- 172.21.15.72:0/3219380038 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0003a30 con 0x7ff0dc06d100 2023-10-14T12:33:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc0b4b90 con 0x7ff0dc06d100 2023-10-14T12:33:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.043+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc0b5150 con 0x7ff0dc06d100 2023-10-14T12:33:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.044+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc04ebb0 con 0x7ff0dc06d100 2023-10-14T12:33:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.044+0000 7ff0d97fa700 1 -- 172.21.15.72:0/3219380038 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff0d0003b90 con 0x7ff0dc06d100 2023-10-14T12:33:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.044+0000 7ff0d97fa700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff0c006af00 0x7ff0c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.045+0000 7ff0dbfff700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff0c006af00 0x7ff0c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.045+0000 7ff0d97fa700 1 -- 172.21.15.72:0/3219380038 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0d0088c60 con 0x7ff0dc06d100 2023-10-14T12:33:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.045+0000 7ff0dbfff700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff0c006af00 0x7ff0c006d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc154f50 tx=0x7ff0c801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.049+0000 7ff0d97fa700 1 -- 172.21.15.72:0/3219380038 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff0d0053ab0 con 0x7ff0dc06d100 2023-10-14T12:33:49.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.238+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0dc072690 con 0x7ff0dc06d100 2023-10-14T12:33:49.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.239+0000 7ff0d97fa700 1 -- 172.21.15.72:0/3219380038 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7ff0d0017070 con 0x7ff0dc06d100 2023-10-14T12:33:49.241 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:49.241 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.241+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff0c006af00 msgr2=0x7ff0c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.241+0000 7ff0e3115700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff0c006af00 0x7ff0c006d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc154f50 tx=0x7ff0c801c040 comp rx=0 tx=0).stop 2023-10-14T12:33:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.241+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc06d100 msgr2=0x7ff0dc0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.241+0000 7ff0e3115700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc06d100 0x7ff0dc0b5950 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000c530 tx=0x7ff0d000c8f0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.241+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 shutdown_connections 2023-10-14T12:33:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.242+0000 7ff0e3115700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff0c006af00 0x7ff0c006d3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.242+0000 7ff0e3115700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff0dc15daa0 0x7ff0dc0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.242+0000 7ff0e3115700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0dc06d100 0x7ff0dc0b5950 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.242+0000 7ff0e3115700 1 --2- 172.21.15.72:0/3219380038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0dc071850 0x7ff0dc1468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.242+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 >> 172.21.15.72:0/3219380038 conn(0x7ff0dc0d0180 msgr2=0x7ff0dc0ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:49.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.242+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 shutdown_connections 2023-10-14T12:33:49.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.242+0000 7ff0e3115700 1 -- 172.21.15.72:0/3219380038 wait complete. 2023-10-14T12:33:49.255 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T12:33:49.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:33:49.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.375+0000 7f4d8c105700 1 Processor -- start 2023-10-14T12:33:49.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.375+0000 7f4d8c105700 1 -- start start 2023-10-14T12:33:49.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d8c105700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d840712e0 0x7f4d8415f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d8c105700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d840cd4b0 con 0x7f4d840cbc10 2023-10-14T12:33:49.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d8c105700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8415b8f0 con 0x7f4d84144ea0 2023-10-14T12:33:49.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d8c105700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840cc0a0 con 0x7f4d840712e0 2023-10-14T12:33:49.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d8a6a2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4d840cbc10 0x7f4d840cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52954/0 (socket says 172.21.15.72:52954) 2023-10-14T12:33:49.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d8a6a2700 1 -- 172.21.15.72:0/2355563991 learned_addr learned my addr 172.21.15.72:0/2355563991 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:49.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d89ea1700 1 --2- 172.21.15.72:0/2355563991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d840712e0 0x7f4d8415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d88e9f700 1 -- 172.21.15.72:0/2355563991 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137201379 0 0) 0x7f4d840cd4b0 con 0x7f4d840cbc10 2023-10-14T12:33:49.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d88e9f700 1 -- 172.21.15.72:0/2355563991 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d700035b0 con 0x7f4d840cbc10 2023-10-14T12:33:49.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d88e9f700 1 -- 172.21.15.72:0/2355563991 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313823717 0 0) 0x7f4d8415b8f0 con 0x7f4d84144ea0 2023-10-14T12:33:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d88e9f700 1 -- 172.21.15.72:0/2355563991 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d840cd4b0 con 0x7f4d84144ea0 2023-10-14T12:33:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d89ea1700 1 -- 172.21.15.72:0/2355563991 >> v1:172.21.15.123:6789/0 conn(0x7f4d84144ea0 legacy=0x7f4d840716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d89ea1700 1 -- 172.21.15.72:0/2355563991 >> v1:172.21.15.72:6789/0 conn(0x7f4d840cbc10 legacy=0x7f4d840cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d89ea1700 1 -- 172.21.15.72:0/2355563991 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8415fdb0 con 0x7f4d840712e0 2023-10-14T12:33:49.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.376+0000 7f4d89ea1700 1 --2- 172.21.15.72:0/2355563991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d840712e0 0x7f4d8415f790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009870 tx=0x7f4d80009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88e3d9352a054047 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d88e9f700 1 -- 172.21.15.72:0/2355563991 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80011830 con 0x7f4d840712e0 2023-10-14T12:33:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d88e9f700 1 -- 172.21.15.72:0/2355563991 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d80011990 con 0x7f4d840712e0 2023-10-14T12:33:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d88e9f700 1 -- 172.21.15.72:0/2355563991 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80011d20 con 0x7f4d840712e0 2023-10-14T12:33:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d8c105700 1 -- 172.21.15.72:0/2355563991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d840712e0 msgr2=0x7f4d8415f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d8c105700 1 --2- 172.21.15.72:0/2355563991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d840712e0 0x7f4d8415f790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009870 tx=0x7f4d80009b80 comp rx=0 tx=0).stop 2023-10-14T12:33:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d8c105700 1 -- 172.21.15.72:0/2355563991 shutdown_connections 2023-10-14T12:33:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d8c105700 1 --2- 172.21.15.72:0/2355563991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d840712e0 0x7f4d8415f790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d8c105700 1 -- 172.21.15.72:0/2355563991 >> 172.21.15.72:0/2355563991 conn(0x7f4d840cfcd0 msgr2=0x7f4d840d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d8c105700 1 -- 172.21.15.72:0/2355563991 shutdown_connections 2023-10-14T12:33:49.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.377+0000 7f4d8c105700 1 -- 172.21.15.72:0/2355563991 wait complete. 2023-10-14T12:33:49.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.378+0000 7f4d8c105700 1 Processor -- start 2023-10-14T12:33:49.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d8c105700 1 -- start start 2023-10-14T12:33:49.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d8c105700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d840712e0 0x7f4d84159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d8c105700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d840cbc10 0x7f4d840b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d8c105700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d84144ea0 0x7f4d840c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d8c105700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840ad750 con 0x7f4d840712e0 2023-10-14T12:33:49.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d8c105700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8406cda0 con 0x7f4d840cbc10 2023-10-14T12:33:49.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d8c105700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840ac8c0 con 0x7f4d84144ea0 2023-10-14T12:33:49.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d89ea1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d840712e0 0x7f4d84159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d89ea1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d840712e0 0x7f4d84159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46656/0 (socket says 172.21.15.72:46656) 2023-10-14T12:33:49.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d89ea1700 1 -- 172.21.15.72:0/1749168667 learned_addr learned my addr 172.21.15.72:0/1749168667 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:49.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d8a6a2700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d84144ea0 0x7f4d840c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.379+0000 7f4d896a0700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d840cbc10 0x7f4d840b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d89ea1700 1 -- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d84144ea0 msgr2=0x7f4d840c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d89ea1700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d84144ea0 0x7f4d840c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d89ea1700 1 -- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d840cbc10 msgr2=0x7f4d840b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d89ea1700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d840cbc10 0x7f4d840b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d89ea1700 1 -- 172.21.15.72:0/1749168667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d800094a0 con 0x7f4d840712e0 2023-10-14T12:33:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d8a6a2700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d84144ea0 0x7f4d840c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d896a0700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d840cbc10 0x7f4d840b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d89ea1700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d840712e0 0x7f4d84159340 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4d800097c0 tx=0x7f4d80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d7a7fc700 1 -- 172.21.15.72:0/1749168667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8001a8f0 con 0x7f4d840712e0 2023-10-14T12:33:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d7a7fc700 1 -- 172.21.15.72:0/1749168667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8001aa50 con 0x7f4d840712e0 2023-10-14T12:33:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d7a7fc700 1 -- 172.21.15.72:0/1749168667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8001adc0 con 0x7f4d840712e0 2023-10-14T12:33:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d840acad0 con 0x7f4d840712e0 2023-10-14T12:33:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.380+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d840ad090 con 0x7f4d840712e0 2023-10-14T12:33:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.381+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8404ebb0 con 0x7f4d840712e0 2023-10-14T12:33:49.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.381+0000 7f4d7a7fc700 1 -- 172.21.15.72:0/1749168667 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d800243f0 con 0x7f4d840712e0 2023-10-14T12:33:49.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.382+0000 7f4d7a7fc700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4d6806af00 0x7f4d6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.382+0000 7f4d7a7fc700 1 -- 172.21.15.72:0/1749168667 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4d8008ab70 con 0x7f4d840712e0 2023-10-14T12:33:49.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.382+0000 7f4d896a0700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4d6806af00 0x7f4d6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.382+0000 7f4d896a0700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4d6806af00 0x7f4d6806d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d840adbb0 tx=0x7f4d74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.386+0000 7f4d7a7fc700 1 -- 172.21.15.72:0/1749168667 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d80055ae0 con 0x7f4d840712e0 2023-10-14T12:33:49.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.576+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d840ca2b0 con 0x7f4d6806af00 2023-10-14T12:33:49.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.586+0000 7f4d7a7fc700 1 -- 172.21.15.72:0/1749168667 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345328 (secure 0 0 0) 0x7f4d74001c50 con 0x7f4d6806af00 2023-10-14T12:33:49.591 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:49.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4d6806af00 msgr2=0x7f4d6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4d6806af00 0x7f4d6806d3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d840adbb0 tx=0x7f4d74009040 comp rx=0 tx=0).stop 2023-10-14T12:33:49.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d840712e0 msgr2=0x7f4d84159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d840712e0 0x7f4d84159340 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4d800097c0 tx=0x7f4d80004750 comp rx=0 tx=0).stop 2023-10-14T12:33:49.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 shutdown_connections 2023-10-14T12:33:49.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4d6806af00 0x7f4d6806d3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4d84144ea0 0x7f4d840c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d840712e0 0x7f4d84159340 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 --2- 172.21.15.72:0/1749168667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d840cbc10 0x7f4d840b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.589+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 >> 172.21.15.72:0/1749168667 conn(0x7f4d840cfcd0 msgr2=0x7f4d840b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.590+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 shutdown_connections 2023-10-14T12:33:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.590+0000 7f4d8c105700 1 -- 172.21.15.72:0/1749168667 wait complete. 2023-10-14T12:33:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:33:49.603 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-10-14T12:33:49.388094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1987974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002510"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839274+0000","last_change":"2023-10-14T12:33:31.821005+0000","last_active":"2023-10-14T12:33:35.839274+0000","last_peered":"2023-10-14T12:33:35.839274+0000","last_clean":"2023-10-14T12:33:35.839274+0000","last_became_active":"2023-10-14T12:33:31.820734+0000","last_became_peered":"2023-10-14T12:33:31.820734+0000","last_unstale":"2023-10-14T12:33:35.839274+0000","last_undegraded":"2023-10-14T12:33:35.839274+0000","last_fullsized":"2023-10-14T12:33:35.839274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:09.495473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854834+0000","last_change":"2023-10-14T12:33:31.821170+0000","last_active":"2023-10-14T12:33:35.854834+0000","last_peered":"2023-10-14T12:33:35.854834+0000","last_clean":"2023-10-14T12:33:35.854834+0000","last_became_active":"2023-10-14T12:33:31.820856+0000","last_became_peered":"2023-10-14T12:33:31.820856+0000","last_unstale":"2023-10-14T12:33:35.854834+0000","last_undegraded":"2023-10-14T12:33:35.854834+0000","last_fullsized":"2023-10-14T12:33:35.854834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851677+0000","last_change":"2023-10-14T12:33:31.819460+0000","last_active":"2023-10-14T12:33:35.851677+0000","last_peered":"2023-10-14T12:33:35.851677+0000","last_clean":"2023-10-14T12:33:35.851677+0000","last_became_active":"2023-10-14T12:33:31.819214+0000","last_became_peered":"2023-10-14T12:33:31.819214+0000","last_unstale":"2023-10-14T12:33:35.851677+0000","last_undegraded":"2023-10-14T12:33:35.851677+0000","last_fullsized":"2023-10-14T12:33:35.851677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:45.477157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847884+0000","last_change":"2023-10-14T12:33:31.866158+0000","last_active":"2023-10-14T12:33:35.847884+0000","last_peered":"2023-10-14T12:33:35.847884+0000","last_clean":"2023-10-14T12:33:35.847884+0000","last_became_active":"2023-10-14T12:33:31.865728+0000","last_became_peered":"2023-10-14T12:33:31.865728+0000","last_unstale":"2023-10-14T12:33:35.847884+0000","last_undegraded":"2023-10-14T12:33:35.847884+0000","last_fullsized":"2023-10-14T12:33:35.847884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839008+0000","last_change":"2023-10-14T12:33:31.819060+0000","last_active":"2023-10-14T12:33:35.839008+0000","last_peered":"2023-10-14T12:33:35.839008+0000","last_clean":"2023-10-14T12:33:35.839008+0000","last_became_active":"2023-10-14T12:33:31.818717+0000","last_became_peered":"2023-10-14T12:33:31.818717+0000","last_unstale":"2023-10-14T12:33:35.839008+0000","last_undegraded":"2023-10-14T12:33:35.839008+0000","last_fullsized":"2023-10-14T12:33:35.839008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847401+0000","last_change":"2023-10-14T12:33:31.866358+0000","last_active":"2023-10-14T12:33:35.847401+0000","last_peered":"2023-10-14T12:33:35.847401+0000","last_clean":"2023-10-14T12:33:35.847401+0000","last_became_active":"2023-10-14T12:33:31.865112+0000","last_became_peered":"2023-10-14T12:33:31.865112+0000","last_unstale":"2023-10-14T12:33:35.847401+0000","last_undegraded":"2023-10-14T12:33:35.847401+0000","last_fullsized":"2023-10-14T12:33:35.847401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838459+0000","last_change":"2023-10-14T12:33:31.821764+0000","last_active":"2023-10-14T12:33:35.838459+0000","last_peered":"2023-10-14T12:33:35.838459+0000","last_clean":"2023-10-14T12:33:35.838459+0000","last_became_active":"2023-10-14T12:33:31.821450+0000","last_became_peered":"2023-10-14T12:33:31.821450+0000","last_unstale":"2023-10-14T12:33:35.838459+0000","last_undegraded":"2023-10-14T12:33:35.838459+0000","last_fullsized":"2023-10-14T12:33:35.838459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.850717+0000","last_change":"2023-10-14T12:33:31.861876+0000","last_active":"2023-10-14T12:33:35.850717+0000","last_peered":"2023-10-14T12:33:35.850717+0000","last_clean":"2023-10-14T12:33:35.850717+0000","last_became_active":"2023-10-14T12:33:31.861620+0000","last_became_peered":"2023-10-14T12:33:31.861620+0000","last_unstale":"2023-10-14T12:33:35.850717+0000","last_undegraded":"2023-10-14T12:33:35.850717+0000","last_fullsized":"2023-10-14T12:33:35.850717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839160+0000","last_change":"2023-10-14T12:33:31.863420+0000","last_active":"2023-10-14T12:33:35.839160+0000","last_peered":"2023-10-14T12:33:35.839160+0000","last_clean":"2023-10-14T12:33:35.839160+0000","last_became_active":"2023-10-14T12:33:31.863132+0000","last_became_peered":"2023-10-14T12:33:31.863132+0000","last_unstale":"2023-10-14T12:33:35.839160+0000","last_undegraded":"2023-10-14T12:33:35.839160+0000","last_fullsized":"2023-10-14T12:33:35.839160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:19.041798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.845863+0000","last_change":"2023-10-14T12:33:31.863478+0000","last_active":"2023-10-14T12:33:35.845863+0000","last_peered":"2023-10-14T12:33:35.845863+0000","last_clean":"2023-10-14T12:33:35.845863+0000","last_became_active":"2023-10-14T12:33:31.863150+0000","last_became_peered":"2023-10-14T12:33:31.863150+0000","last_unstale":"2023-10-14T12:33:35.845863+0000","last_undegraded":"2023-10-14T12:33:35.845863+0000","last_fullsized":"2023-10-14T12:33:35.845863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.845900+0000","last_change":"2023-10-14T12:33:31.866438+0000","last_active":"2023-10-14T12:33:35.845900+0000","last_peered":"2023-10-14T12:33:35.845900+0000","last_clean":"2023-10-14T12:33:35.845900+0000","last_became_active":"2023-10-14T12:33:31.866147+0000","last_became_peered":"2023-10-14T12:33:31.866147+0000","last_unstale":"2023-10-14T12:33:35.845900+0000","last_undegraded":"2023-10-14T12:33:35.845900+0000","last_fullsized":"2023-10-14T12:33:35.845900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839597+0000","last_change":"2023-10-14T12:33:31.829329+0000","last_active":"2023-10-14T12:33:35.839597+0000","last_peered":"2023-10-14T12:33:35.839597+0000","last_clean":"2023-10-14T12:33:35.839597+0000","last_became_active":"2023-10-14T12:33:31.828803+0000","last_became_peered":"2023-10-14T12:33:31.828803+0000","last_unstale":"2023-10-14T12:33:35.839597+0000","last_undegraded":"2023-10-14T12:33:35.839597+0000","last_fullsized":"2023-10-14T12:33:35.839597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:34.169023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844063+0000","last_change":"2023-10-14T12:33:31.817287+0000","last_active":"2023-10-14T12:33:35.844063+0000","last_peered":"2023-10-14T12:33:35.844063+0000","last_clean":"2023-10-14T12:33:35.844063+0000","last_became_active":"2023-10-14T12:33:31.817007+0000","last_became_peered":"2023-10-14T12:33:31.817007+0000","last_unstale":"2023-10-14T12:33:35.844063+0000","last_undegraded":"2023-10-14T12:33:35.844063+0000","last_fullsized":"2023-10-14T12:33:35.844063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852024+0000","last_change":"2023-10-14T12:33:31.818967+0000","last_active":"2023-10-14T12:33:35.852024+0000","last_peered":"2023-10-14T12:33:35.852024+0000","last_clean":"2023-10-14T12:33:35.852024+0000","last_became_active":"2023-10-14T12:33:31.818735+0000","last_became_peered":"2023-10-14T12:33:31.818735+0000","last_unstale":"2023-10-14T12:33:35.852024+0000","last_undegraded":"2023-10-14T12:33:35.852024+0000","last_fullsized":"2023-10-14T12:33:35.852024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:42.240740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854372+0000","last_change":"2023-10-14T12:33:31.834837+0000","last_active":"2023-10-14T12:33:35.854372+0000","last_peered":"2023-10-14T12:33:35.854372+0000","last_clean":"2023-10-14T12:33:35.854372+0000","last_became_active":"2023-10-14T12:33:31.834576+0000","last_became_peered":"2023-10-14T12:33:31.834576+0000","last_unstale":"2023-10-14T12:33:35.854372+0000","last_undegraded":"2023-10-14T12:33:35.854372+0000","last_fullsized":"2023-10-14T12:33:35.854372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847198+0000","last_change":"2023-10-14T12:33:31.865491+0000","last_active":"2023-10-14T12:33:35.847198+0000","last_peered":"2023-10-14T12:33:35.847198+0000","last_clean":"2023-10-14T12:33:35.847198+0000","last_became_active":"2023-10-14T12:33:31.865142+0000","last_became_peered":"2023-10-14T12:33:31.865142+0000","last_unstale":"2023-10-14T12:33:35.847198+0000","last_undegraded":"2023-10-14T12:33:35.847198+0000","last_fullsized":"2023-10-14T12:33:35.847198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848563+0000","last_change":"2023-10-14T12:33:31.861934+0000","last_active":"2023-10-14T12:33:35.848563+0000","last_peered":"2023-10-14T12:33:35.848563+0000","last_clean":"2023-10-14T12:33:35.848563+0000","last_became_active":"2023-10-14T12:33:31.861682+0000","last_became_peered":"2023-10-14T12:33:31.861682+0000","last_unstale":"2023-10-14T12:33:35.848563+0000","last_undegraded":"2023-10-14T12:33:35.848563+0000","last_fullsized":"2023-10-14T12:33:35.848563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:10.562723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.855911+0000","last_change":"2023-10-14T12:33:31.819647+0000","last_active":"2023-10-14T12:33:35.855911+0000","last_peered":"2023-10-14T12:33:35.855911+0000","last_clean":"2023-10-14T12:33:35.855911+0000","last_became_active":"2023-10-14T12:33:31.817659+0000","last_became_peered":"2023-10-14T12:33:31.817659+0000","last_unstale":"2023-10-14T12:33:35.855911+0000","last_undegraded":"2023-10-14T12:33:35.855911+0000","last_fullsized":"2023-10-14T12:33:35.855911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:54.849594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839113+0000","last_change":"2023-10-14T12:33:31.823287+0000","last_active":"2023-10-14T12:33:35.839113+0000","last_peered":"2023-10-14T12:33:35.839113+0000","last_clean":"2023-10-14T12:33:35.839113+0000","last_became_active":"2023-10-14T12:33:31.823062+0000","last_became_peered":"2023-10-14T12:33:31.823062+0000","last_unstale":"2023-10-14T12:33:35.839113+0000","last_undegraded":"2023-10-14T12:33:35.839113+0000","last_fullsized":"2023-10-14T12:33:35.839113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027435+0000","last_change":"2023-10-14T12:33:35.856495+0000","last_active":"2023-10-14T12:33:38.027435+0000","last_peered":"2023-10-14T12:33:38.027435+0000","last_clean":"2023-10-14T12:33:38.027435+0000","last_became_active":"2023-10-14T12:33:35.856098+0000","last_became_peered":"2023-10-14T12:33:35.856098+0000","last_unstale":"2023-10-14T12:33:38.027435+0000","last_undegraded":"2023-10-14T12:33:38.027435+0000","last_fullsized":"2023-10-14T12:33:38.027435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:19.985088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852656+0000","last_change":"2023-10-14T12:33:30.830266+0000","last_active":"2023-10-14T12:33:35.852656+0000","last_peered":"2023-10-14T12:33:35.852656+0000","last_clean":"2023-10-14T12:33:35.852656+0000","last_became_active":"2023-10-14T12:33:30.829974+0000","last_became_peered":"2023-10-14T12:33:30.829974+0000","last_unstale":"2023-10-14T12:33:35.852656+0000","last_undegraded":"2023-10-14T12:33:35.852656+0000","last_fullsized":"2023-10-14T12:33:35.852656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843869+0000","last_change":"2023-10-14T12:33:31.823407+0000","last_active":"2023-10-14T12:33:35.843869+0000","last_peered":"2023-10-14T12:33:35.843869+0000","last_clean":"2023-10-14T12:33:35.843869+0000","last_became_active":"2023-10-14T12:33:31.823134+0000","last_became_peered":"2023-10-14T12:33:31.823134+0000","last_unstale":"2023-10-14T12:33:35.843869+0000","last_undegraded":"2023-10-14T12:33:35.843869+0000","last_fullsized":"2023-10-14T12:33:35.843869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846110+0000","last_change":"2023-10-14T12:33:35.860480+0000","last_active":"2023-10-14T12:33:36.846110+0000","last_peered":"2023-10-14T12:33:36.846110+0000","last_clean":"2023-10-14T12:33:36.846110+0000","last_became_active":"2023-10-14T12:33:35.860054+0000","last_became_peered":"2023-10-14T12:33:35.860054+0000","last_unstale":"2023-10-14T12:33:36.846110+0000","last_undegraded":"2023-10-14T12:33:36.846110+0000","last_fullsized":"2023-10-14T12:33:36.846110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:46.147663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843810+0000","last_change":"2023-10-14T12:33:30.828686+0000","last_active":"2023-10-14T12:33:35.843810+0000","last_peered":"2023-10-14T12:33:35.843810+0000","last_clean":"2023-10-14T12:33:35.843810+0000","last_became_active":"2023-10-14T12:33:30.828358+0000","last_became_peered":"2023-10-14T12:33:30.828358+0000","last_unstale":"2023-10-14T12:33:35.843810+0000","last_undegraded":"2023-10-14T12:33:35.843810+0000","last_fullsized":"2023-10-14T12:33:35.843810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852396+0000","last_change":"2023-10-14T12:33:31.863657+0000","last_active":"2023-10-14T12:33:35.852396+0000","last_peered":"2023-10-14T12:33:35.852396+0000","last_clean":"2023-10-14T12:33:35.852396+0000","last_became_active":"2023-10-14T12:33:31.863270+0000","last_became_peered":"2023-10-14T12:33:31.863270+0000","last_unstale":"2023-10-14T12:33:35.852396+0000","last_undegraded":"2023-10-14T12:33:35.852396+0000","last_fullsized":"2023-10-14T12:33:35.852396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846369+0000","last_change":"2023-10-14T12:33:35.860669+0000","last_active":"2023-10-14T12:33:36.846369+0000","last_peered":"2023-10-14T12:33:36.846369+0000","last_clean":"2023-10-14T12:33:36.846369+0000","last_became_active":"2023-10-14T12:33:35.860172+0000","last_became_peered":"2023-10-14T12:33:35.860172+0000","last_unstale":"2023-10-14T12:33:36.846369+0000","last_undegraded":"2023-10-14T12:33:36.846369+0000","last_fullsized":"2023-10-14T12:33:36.846369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:34.560475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838805+0000","last_change":"2023-10-14T12:33:30.823902+0000","last_active":"2023-10-14T12:33:35.838805+0000","last_peered":"2023-10-14T12:33:35.838805+0000","last_clean":"2023-10-14T12:33:35.838805+0000","last_became_active":"2023-10-14T12:33:30.823644+0000","last_became_peered":"2023-10-14T12:33:30.823644+0000","last_unstale":"2023-10-14T12:33:35.838805+0000","last_undegraded":"2023-10-14T12:33:35.838805+0000","last_fullsized":"2023-10-14T12:33:35.838805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:29.522892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847636+0000","last_change":"2023-10-14T12:33:31.865659+0000","last_active":"2023-10-14T12:33:35.847636+0000","last_peered":"2023-10-14T12:33:35.847636+0000","last_clean":"2023-10-14T12:33:35.847636+0000","last_became_active":"2023-10-14T12:33:31.865277+0000","last_became_peered":"2023-10-14T12:33:31.865277+0000","last_unstale":"2023-10-14T12:33:35.847636+0000","last_undegraded":"2023-10-14T12:33:35.847636+0000","last_fullsized":"2023-10-14T12:33:35.847636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:15.636750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846392+0000","last_change":"2023-10-14T12:33:35.854228+0000","last_active":"2023-10-14T12:33:36.846392+0000","last_peered":"2023-10-14T12:33:36.846392+0000","last_clean":"2023-10-14T12:33:36.846392+0000","last_became_active":"2023-10-14T12:33:35.853491+0000","last_became_peered":"2023-10-14T12:33:35.853491+0000","last_unstale":"2023-10-14T12:33:36.846392+0000","last_undegraded":"2023-10-14T12:33:36.846392+0000","last_fullsized":"2023-10-14T12:33:36.846392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:41.319662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838457+0000","last_change":"2023-10-14T12:33:30.829300+0000","last_active":"2023-10-14T12:33:35.838457+0000","last_peered":"2023-10-14T12:33:35.838457+0000","last_clean":"2023-10-14T12:33:35.838457+0000","last_became_active":"2023-10-14T12:33:30.829047+0000","last_became_peered":"2023-10-14T12:33:30.829047+0000","last_unstale":"2023-10-14T12:33:35.838457+0000","last_undegraded":"2023-10-14T12:33:35.838457+0000","last_fullsized":"2023-10-14T12:33:35.838457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:41.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848050+0000","last_change":"2023-10-14T12:33:31.866122+0000","last_active":"2023-10-14T12:33:35.848050+0000","last_peered":"2023-10-14T12:33:35.848050+0000","last_clean":"2023-10-14T12:33:35.848050+0000","last_became_active":"2023-10-14T12:33:31.865828+0000","last_became_peered":"2023-10-14T12:33:31.865828+0000","last_unstale":"2023-10-14T12:33:35.848050+0000","last_undegraded":"2023-10-14T12:33:35.848050+0000","last_fullsized":"2023-10-14T12:33:35.848050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:13.669993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027681+0000","last_change":"2023-10-14T12:33:35.866746+0000","last_active":"2023-10-14T12:33:38.027681+0000","last_peered":"2023-10-14T12:33:38.027681+0000","last_clean":"2023-10-14T12:33:38.027681+0000","last_became_active":"2023-10-14T12:33:35.866256+0000","last_became_peered":"2023-10-14T12:33:35.866256+0000","last_unstale":"2023-10-14T12:33:38.027681+0000","last_undegraded":"2023-10-14T12:33:38.027681+0000","last_fullsized":"2023-10-14T12:33:38.027681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:45:51.637024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844274+0000","last_change":"2023-10-14T12:33:30.816017+0000","last_active":"2023-10-14T12:33:35.844274+0000","last_peered":"2023-10-14T12:33:35.844274+0000","last_clean":"2023-10-14T12:33:35.844274+0000","last_became_active":"2023-10-14T12:33:30.815728+0000","last_became_peered":"2023-10-14T12:33:30.815728+0000","last_unstale":"2023-10-14T12:33:35.844274+0000","last_undegraded":"2023-10-14T12:33:35.844274+0000","last_fullsized":"2023-10-14T12:33:35.844274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:23.740058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838523+0000","last_change":"2023-10-14T12:33:31.830404+0000","last_active":"2023-10-14T12:33:35.838523+0000","last_peered":"2023-10-14T12:33:35.838523+0000","last_clean":"2023-10-14T12:33:35.838523+0000","last_became_active":"2023-10-14T12:33:31.830125+0000","last_became_peered":"2023-10-14T12:33:31.830125+0000","last_unstale":"2023-10-14T12:33:35.838523+0000","last_undegraded":"2023-10-14T12:33:35.838523+0000","last_fullsized":"2023-10-14T12:33:35.838523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:13.312142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.318744+0000","last_change":"2023-10-14T12:33:35.865486+0000","last_active":"2023-10-14T12:33:37.318744+0000","last_peered":"2023-10-14T12:33:37.318744+0000","last_clean":"2023-10-14T12:33:37.318744+0000","last_became_active":"2023-10-14T12:33:35.865104+0000","last_became_peered":"2023-10-14T12:33:35.865104+0000","last_unstale":"2023-10-14T12:33:37.318744+0000","last_undegraded":"2023-10-14T12:33:37.318744+0000","last_fullsized":"2023-10-14T12:33:37.318744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:46.272679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846748+0000","last_change":"2023-10-14T12:33:30.818159+0000","last_active":"2023-10-14T12:33:35.846748+0000","last_peered":"2023-10-14T12:33:35.846748+0000","last_clean":"2023-10-14T12:33:35.846748+0000","last_became_active":"2023-10-14T12:33:30.817845+0000","last_became_peered":"2023-10-14T12:33:30.817845+0000","last_unstale":"2023-10-14T12:33:35.846748+0000","last_undegraded":"2023-10-14T12:33:35.846748+0000","last_fullsized":"2023-10-14T12:33:35.846748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851619+0000","last_change":"2023-10-14T12:33:31.833662+0000","last_active":"2023-10-14T12:33:35.851619+0000","last_peered":"2023-10-14T12:33:35.851619+0000","last_clean":"2023-10-14T12:33:35.851619+0000","last_became_active":"2023-10-14T12:33:31.833398+0000","last_became_peered":"2023-10-14T12:33:31.833398+0000","last_unstale":"2023-10-14T12:33:35.851619+0000","last_undegraded":"2023-10-14T12:33:35.851619+0000","last_fullsized":"2023-10-14T12:33:35.851619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.841255+0000","last_change":"2023-10-14T12:33:35.866463+0000","last_active":"2023-10-14T12:33:36.841255+0000","last_peered":"2023-10-14T12:33:36.841255+0000","last_clean":"2023-10-14T12:33:36.841255+0000","last_became_active":"2023-10-14T12:33:35.866062+0000","last_became_peered":"2023-10-14T12:33:35.866062+0000","last_unstale":"2023-10-14T12:33:36.841255+0000","last_undegraded":"2023-10-14T12:33:36.841255+0000","last_fullsized":"2023-10-14T12:33:36.841255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847361+0000","last_change":"2023-10-14T12:33:30.821259+0000","last_active":"2023-10-14T12:33:35.847361+0000","last_peered":"2023-10-14T12:33:35.847361+0000","last_clean":"2023-10-14T12:33:35.847361+0000","last_became_active":"2023-10-14T12:33:30.820962+0000","last_became_peered":"2023-10-14T12:33:30.820962+0000","last_unstale":"2023-10-14T12:33:35.847361+0000","last_undegraded":"2023-10-14T12:33:35.847361+0000","last_fullsized":"2023-10-14T12:33:35.847361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844696+0000","last_change":"2023-10-14T12:33:31.821784+0000","last_active":"2023-10-14T12:33:35.844696+0000","last_peered":"2023-10-14T12:33:35.844696+0000","last_clean":"2023-10-14T12:33:35.844696+0000","last_became_active":"2023-10-14T12:33:31.821472+0000","last_became_peered":"2023-10-14T12:33:31.821472+0000","last_unstale":"2023-10-14T12:33:35.844696+0000","last_undegraded":"2023-10-14T12:33:35.844696+0000","last_fullsized":"2023-10-14T12:33:35.844696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025944+0000","last_change":"2023-10-14T12:33:35.861224+0000","last_active":"2023-10-14T12:33:38.025944+0000","last_peered":"2023-10-14T12:33:38.025944+0000","last_clean":"2023-10-14T12:33:38.025944+0000","last_became_active":"2023-10-14T12:33:35.860816+0000","last_became_peered":"2023-10-14T12:33:35.860816+0000","last_unstale":"2023-10-14T12:33:38.025944+0000","last_undegraded":"2023-10-14T12:33:38.025944+0000","last_fullsized":"2023-10-14T12:33:38.025944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:23.073737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847265+0000","last_change":"2023-10-14T12:33:30.826762+0000","last_active":"2023-10-14T12:33:35.847265+0000","last_peered":"2023-10-14T12:33:35.847265+0000","last_clean":"2023-10-14T12:33:35.847265+0000","last_became_active":"2023-10-14T12:33:30.826477+0000","last_became_peered":"2023-10-14T12:33:30.826477+0000","last_unstale":"2023-10-14T12:33:35.847265+0000","last_undegraded":"2023-10-14T12:33:35.847265+0000","last_fullsized":"2023-10-14T12:33:35.847265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854580+0000","last_change":"2023-10-14T12:33:31.817507+0000","last_active":"2023-10-14T12:33:35.854580+0000","last_peered":"2023-10-14T12:33:35.854580+0000","last_clean":"2023-10-14T12:33:35.854580+0000","last_became_active":"2023-10-14T12:33:31.817121+0000","last_became_peered":"2023-10-14T12:33:31.817121+0000","last_unstale":"2023-10-14T12:33:35.854580+0000","last_undegraded":"2023-10-14T12:33:35.854580+0000","last_fullsized":"2023-10-14T12:33:35.854580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027281+0000","last_change":"2023-10-14T12:33:35.856441+0000","last_active":"2023-10-14T12:33:38.027281+0000","last_peered":"2023-10-14T12:33:38.027281+0000","last_clean":"2023-10-14T12:33:38.027281+0000","last_became_active":"2023-10-14T12:33:35.856034+0000","last_became_peered":"2023-10-14T12:33:35.856034+0000","last_unstale":"2023-10-14T12:33:38.027281+0000","last_undegraded":"2023-10-14T12:33:38.027281+0000","last_fullsized":"2023-10-14T12:33:38.027281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:56.042282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846794+0000","last_change":"2023-10-14T12:33:30.827702+0000","last_active":"2023-10-14T12:33:35.846794+0000","last_peered":"2023-10-14T12:33:35.846794+0000","last_clean":"2023-10-14T12:33:35.846794+0000","last_became_active":"2023-10-14T12:33:30.827300+0000","last_became_peered":"2023-10-14T12:33:30.827300+0000","last_unstale":"2023-10-14T12:33:35.846794+0000","last_undegraded":"2023-10-14T12:33:35.846794+0000","last_fullsized":"2023-10-14T12:33:35.846794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848452+0000","last_change":"2023-10-14T12:33:31.865300+0000","last_active":"2023-10-14T12:33:35.848452+0000","last_peered":"2023-10-14T12:33:35.848452+0000","last_clean":"2023-10-14T12:33:35.848452+0000","last_became_active":"2023-10-14T12:33:31.865011+0000","last_became_peered":"2023-10-14T12:33:31.865011+0000","last_unstale":"2023-10-14T12:33:35.848452+0000","last_undegraded":"2023-10-14T12:33:35.848452+0000","last_fullsized":"2023-10-14T12:33:35.848452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:21.583926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027294+0000","last_change":"2023-10-14T12:33:35.862519+0000","last_active":"2023-10-14T12:33:38.027294+0000","last_peered":"2023-10-14T12:33:38.027294+0000","last_clean":"2023-10-14T12:33:38.027294+0000","last_became_active":"2023-10-14T12:33:35.861926+0000","last_became_peered":"2023-10-14T12:33:35.861926+0000","last_unstale":"2023-10-14T12:33:38.027294+0000","last_undegraded":"2023-10-14T12:33:38.027294+0000","last_fullsized":"2023-10-14T12:33:38.027294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:27.584701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848363+0000","last_change":"2023-10-14T12:33:30.826679+0000","last_active":"2023-10-14T12:33:35.848363+0000","last_peered":"2023-10-14T12:33:35.848363+0000","last_clean":"2023-10-14T12:33:35.848363+0000","last_became_active":"2023-10-14T12:33:30.826407+0000","last_became_peered":"2023-10-14T12:33:30.826407+0000","last_unstale":"2023-10-14T12:33:35.848363+0000","last_undegraded":"2023-10-14T12:33:35.848363+0000","last_fullsized":"2023-10-14T12:33:35.848363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:48.937270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852489+0000","last_change":"2023-10-14T12:33:31.866686+0000","last_active":"2023-10-14T12:33:35.852489+0000","last_peered":"2023-10-14T12:33:35.852489+0000","last_clean":"2023-10-14T12:33:35.852489+0000","last_became_active":"2023-10-14T12:33:31.866296+0000","last_became_peered":"2023-10-14T12:33:31.866296+0000","last_unstale":"2023-10-14T12:33:35.852489+0000","last_undegraded":"2023-10-14T12:33:35.852489+0000","last_fullsized":"2023-10-14T12:33:35.852489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846622+0000","last_change":"2023-10-14T12:33:35.860504+0000","last_active":"2023-10-14T12:33:36.846622+0000","last_peered":"2023-10-14T12:33:36.846622+0000","last_clean":"2023-10-14T12:33:36.846622+0000","last_became_active":"2023-10-14T12:33:35.860105+0000","last_became_peered":"2023-10-14T12:33:35.860105+0000","last_unstale":"2023-10-14T12:33:36.846622+0000","last_undegraded":"2023-10-14T12:33:36.846622+0000","last_fullsized":"2023-10-14T12:33:36.846622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:29.627124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854796+0000","last_change":"2023-10-14T12:33:30.828734+0000","last_active":"2023-10-14T12:33:35.854796+0000","last_peered":"2023-10-14T12:33:35.854796+0000","last_clean":"2023-10-14T12:33:35.854796+0000","last_became_active":"2023-10-14T12:33:30.827180+0000","last_became_peered":"2023-10-14T12:33:30.827180+0000","last_unstale":"2023-10-14T12:33:35.854796+0000","last_undegraded":"2023-10-14T12:33:35.854796+0000","last_fullsized":"2023-10-14T12:33:35.854796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:17.918071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839536+0000","last_change":"2023-10-14T12:33:31.829359+0000","last_active":"2023-10-14T12:33:35.839536+0000","last_peered":"2023-10-14T12:33:35.839536+0000","last_clean":"2023-10-14T12:33:35.839536+0000","last_became_active":"2023-10-14T12:33:31.828972+0000","last_became_peered":"2023-10-14T12:33:31.828972+0000","last_unstale":"2023-10-14T12:33:35.839536+0000","last_undegraded":"2023-10-14T12:33:35.839536+0000","last_fullsized":"2023-10-14T12:33:35.839536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:35.674331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025766+0000","last_change":"2023-10-14T12:33:35.857105+0000","last_active":"2023-10-14T12:33:38.025766+0000","last_peered":"2023-10-14T12:33:38.025766+0000","last_clean":"2023-10-14T12:33:38.025766+0000","last_became_active":"2023-10-14T12:33:35.856756+0000","last_became_peered":"2023-10-14T12:33:35.856756+0000","last_unstale":"2023-10-14T12:33:38.025766+0000","last_undegraded":"2023-10-14T12:33:38.025766+0000","last_fullsized":"2023-10-14T12:33:38.025766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:41.136443+0000","last_change":"2023-10-14T12:33:30.825111+0000","last_active":"2023-10-14T12:33:41.136443+0000","last_peered":"2023-10-14T12:33:41.136443+0000","last_clean":"2023-10-14T12:33:41.136443+0000","last_became_active":"2023-10-14T12:33:30.824768+0000","last_became_peered":"2023-10-14T12:33:30.824768+0000","last_unstale":"2023-10-14T12:33:41.136443+0000","last_undegraded":"2023-10-14T12:33:41.136443+0000","last_fullsized":"2023-10-14T12:33:41.136443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:09.427953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839014+0000","last_change":"2023-10-14T12:33:31.822451+0000","last_active":"2023-10-14T12:33:35.839014+0000","last_peered":"2023-10-14T12:33:35.839014+0000","last_clean":"2023-10-14T12:33:35.839014+0000","last_became_active":"2023-10-14T12:33:31.822131+0000","last_became_peered":"2023-10-14T12:33:31.822131+0000","last_unstale":"2023-10-14T12:33:35.839014+0000","last_undegraded":"2023-10-14T12:33:35.839014+0000","last_fullsized":"2023-10-14T12:33:35.839014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.319564+0000","last_change":"2023-10-14T12:33:35.864107+0000","last_active":"2023-10-14T12:33:37.319564+0000","last_peered":"2023-10-14T12:33:37.319564+0000","last_clean":"2023-10-14T12:33:37.319564+0000","last_became_active":"2023-10-14T12:33:35.863602+0000","last_became_peered":"2023-10-14T12:33:35.863602+0000","last_unstale":"2023-10-14T12:33:37.319564+0000","last_undegraded":"2023-10-14T12:33:37.319564+0000","last_fullsized":"2023-10-14T12:33:37.319564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:27.584701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851934+0000","last_change":"2023-10-14T12:33:30.830335+0000","last_active":"2023-10-14T12:33:35.851934+0000","last_peered":"2023-10-14T12:33:35.851934+0000","last_clean":"2023-10-14T12:33:35.851934+0000","last_became_active":"2023-10-14T12:33:30.829756+0000","last_became_peered":"2023-10-14T12:33:30.829756+0000","last_unstale":"2023-10-14T12:33:35.851934+0000","last_undegraded":"2023-10-14T12:33:35.851934+0000","last_fullsized":"2023-10-14T12:33:35.851934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:49.417513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852109+0000","last_change":"2023-10-14T12:33:31.822308+0000","last_active":"2023-10-14T12:33:35.852109+0000","last_peered":"2023-10-14T12:33:35.852109+0000","last_clean":"2023-10-14T12:33:35.852109+0000","last_became_active":"2023-10-14T12:33:31.822055+0000","last_became_peered":"2023-10-14T12:33:31.822055+0000","last_unstale":"2023-10-14T12:33:35.852109+0000","last_undegraded":"2023-10-14T12:33:35.852109+0000","last_fullsized":"2023-10-14T12:33:35.852109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:10.433597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027505+0000","last_change":"2023-10-14T12:33:35.869237+0000","last_active":"2023-10-14T12:33:38.027505+0000","last_peered":"2023-10-14T12:33:38.027505+0000","last_clean":"2023-10-14T12:33:38.027505+0000","last_became_active":"2023-10-14T12:33:35.866485+0000","last_became_peered":"2023-10-14T12:33:35.866485+0000","last_unstale":"2023-10-14T12:33:38.027505+0000","last_undegraded":"2023-10-14T12:33:38.027505+0000","last_fullsized":"2023-10-14T12:33:38.027505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:51:59.414054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847188+0000","last_change":"2023-10-14T12:33:30.826101+0000","last_active":"2023-10-14T12:33:35.847188+0000","last_peered":"2023-10-14T12:33:35.847188+0000","last_clean":"2023-10-14T12:33:35.847188+0000","last_became_active":"2023-10-14T12:33:30.825904+0000","last_became_peered":"2023-10-14T12:33:30.825904+0000","last_unstale":"2023-10-14T12:33:35.847188+0000","last_undegraded":"2023-10-14T12:33:35.847188+0000","last_fullsized":"2023-10-14T12:33:35.847188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:34.109444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839117+0000","last_change":"2023-10-14T12:33:31.829811+0000","last_active":"2023-10-14T12:33:35.839117+0000","last_peered":"2023-10-14T12:33:35.839117+0000","last_clean":"2023-10-14T12:33:35.839117+0000","last_became_active":"2023-10-14T12:33:31.829557+0000","last_became_peered":"2023-10-14T12:33:31.829557+0000","last_unstale":"2023-10-14T12:33:35.839117+0000","last_undegraded":"2023-10-14T12:33:35.839117+0000","last_fullsized":"2023-10-14T12:33:35.839117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:21.583926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027964+0000","last_change":"2023-10-14T12:33:35.866238+0000","last_active":"2023-10-14T12:33:38.027964+0000","last_peered":"2023-10-14T12:33:38.027964+0000","last_clean":"2023-10-14T12:33:38.027964+0000","last_became_active":"2023-10-14T12:33:35.865766+0000","last_became_peered":"2023-10-14T12:33:35.865766+0000","last_unstale":"2023-10-14T12:33:38.027964+0000","last_undegraded":"2023-10-14T12:33:38.027964+0000","last_fullsized":"2023-10-14T12:33:38.027964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:29:39.610994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846622+0000","last_change":"2023-10-14T12:33:30.818254+0000","last_active":"2023-10-14T12:33:35.846622+0000","last_peered":"2023-10-14T12:33:35.846622+0000","last_clean":"2023-10-14T12:33:35.846622+0000","last_became_active":"2023-10-14T12:33:30.817968+0000","last_became_peered":"2023-10-14T12:33:30.817968+0000","last_unstale":"2023-10-14T12:33:35.846622+0000","last_undegraded":"2023-10-14T12:33:35.846622+0000","last_fullsized":"2023-10-14T12:33:35.846622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:34.668687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847416+0000","last_change":"2023-10-14T12:33:31.822035+0000","last_active":"2023-10-14T12:33:35.847416+0000","last_peered":"2023-10-14T12:33:35.847416+0000","last_clean":"2023-10-14T12:33:35.847416+0000","last_became_active":"2023-10-14T12:33:31.821751+0000","last_became_peered":"2023-10-14T12:33:31.821751+0000","last_unstale":"2023-10-14T12:33:35.847416+0000","last_undegraded":"2023-10-14T12:33:35.847416+0000","last_fullsized":"2023-10-14T12:33:35.847416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025739+0000","last_change":"2023-10-14T12:33:35.864410+0000","last_active":"2023-10-14T12:33:38.025739+0000","last_peered":"2023-10-14T12:33:38.025739+0000","last_clean":"2023-10-14T12:33:38.025739+0000","last_became_active":"2023-10-14T12:33:35.863490+0000","last_became_peered":"2023-10-14T12:33:35.863490+0000","last_unstale":"2023-10-14T12:33:38.025739+0000","last_undegraded":"2023-10-14T12:33:38.025739+0000","last_fullsized":"2023-10-14T12:33:38.025739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854376+0000","last_change":"2023-10-14T12:33:30.825658+0000","last_active":"2023-10-14T12:33:35.854376+0000","last_peered":"2023-10-14T12:33:35.854376+0000","last_clean":"2023-10-14T12:33:35.854376+0000","last_became_active":"2023-10-14T12:33:30.825377+0000","last_became_peered":"2023-10-14T12:33:30.825377+0000","last_unstale":"2023-10-14T12:33:35.854376+0000","last_undegraded":"2023-10-14T12:33:35.854376+0000","last_fullsized":"2023-10-14T12:33:35.854376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:45.725924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839717+0000","last_change":"2023-10-14T12:33:31.829114+0000","last_active":"2023-10-14T12:33:35.839717+0000","last_peered":"2023-10-14T12:33:35.839717+0000","last_clean":"2023-10-14T12:33:35.839717+0000","last_became_active":"2023-10-14T12:33:31.828836+0000","last_became_peered":"2023-10-14T12:33:31.828836+0000","last_unstale":"2023-10-14T12:33:35.839717+0000","last_undegraded":"2023-10-14T12:33:35.839717+0000","last_fullsized":"2023-10-14T12:33:35.839717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846100+0000","last_change":"2023-10-14T12:33:35.861113+0000","last_active":"2023-10-14T12:33:36.846100+0000","last_peered":"2023-10-14T12:33:36.846100+0000","last_clean":"2023-10-14T12:33:36.846100+0000","last_became_active":"2023-10-14T12:33:35.860576+0000","last_became_peered":"2023-10-14T12:33:35.860576+0000","last_unstale":"2023-10-14T12:33:36.846100+0000","last_undegraded":"2023-10-14T12:33:36.846100+0000","last_fullsized":"2023-10-14T12:33:36.846100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:01.926300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838546+0000","last_change":"2023-10-14T12:33:30.831073+0000","last_active":"2023-10-14T12:33:35.838546+0000","last_peered":"2023-10-14T12:33:35.838546+0000","last_clean":"2023-10-14T12:33:35.838546+0000","last_became_active":"2023-10-14T12:33:30.830742+0000","last_became_peered":"2023-10-14T12:33:30.830742+0000","last_unstale":"2023-10-14T12:33:35.838546+0000","last_undegraded":"2023-10-14T12:33:35.838546+0000","last_fullsized":"2023-10-14T12:33:35.838546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:45.725924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839426+0000","last_change":"2023-10-14T12:33:31.827984+0000","last_active":"2023-10-14T12:33:35.839426+0000","last_peered":"2023-10-14T12:33:35.839426+0000","last_clean":"2023-10-14T12:33:35.839426+0000","last_became_active":"2023-10-14T12:33:31.827707+0000","last_became_peered":"2023-10-14T12:33:31.827707+0000","last_unstale":"2023-10-14T12:33:35.839426+0000","last_undegraded":"2023-10-14T12:33:35.839426+0000","last_fullsized":"2023-10-14T12:33:35.839426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:15.636750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025631+0000","last_change":"2023-10-14T12:33:35.859968+0000","last_active":"2023-10-14T12:33:38.025631+0000","last_peered":"2023-10-14T12:33:38.025631+0000","last_clean":"2023-10-14T12:33:38.025631+0000","last_became_active":"2023-10-14T12:33:35.859542+0000","last_became_peered":"2023-10-14T12:33:35.859542+0000","last_unstale":"2023-10-14T12:33:38.025631+0000","last_undegraded":"2023-10-14T12:33:38.025631+0000","last_fullsized":"2023-10-14T12:33:38.025631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:28.879987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854731+0000","last_change":"2023-10-14T12:33:30.829611+0000","last_active":"2023-10-14T12:33:35.854731+0000","last_peered":"2023-10-14T12:33:35.854731+0000","last_clean":"2023-10-14T12:33:35.854731+0000","last_became_active":"2023-10-14T12:33:30.829317+0000","last_became_peered":"2023-10-14T12:33:30.829317+0000","last_unstale":"2023-10-14T12:33:35.854731+0000","last_undegraded":"2023-10-14T12:33:35.854731+0000","last_fullsized":"2023-10-14T12:33:35.854731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847512+0000","last_change":"2023-10-14T12:33:31.867826+0000","last_active":"2023-10-14T12:33:35.847512+0000","last_peered":"2023-10-14T12:33:35.847512+0000","last_clean":"2023-10-14T12:33:35.847512+0000","last_became_active":"2023-10-14T12:33:31.867531+0000","last_became_peered":"2023-10-14T12:33:31.867531+0000","last_unstale":"2023-10-14T12:33:35.847512+0000","last_undegraded":"2023-10-14T12:33:35.847512+0000","last_fullsized":"2023-10-14T12:33:35.847512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:19.041798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026385+0000","last_change":"2023-10-14T12:33:35.860655+0000","last_active":"2023-10-14T12:33:38.026385+0000","last_peered":"2023-10-14T12:33:38.026385+0000","last_clean":"2023-10-14T12:33:38.026385+0000","last_became_active":"2023-10-14T12:33:35.859946+0000","last_became_peered":"2023-10-14T12:33:35.859946+0000","last_unstale":"2023-10-14T12:33:38.026385+0000","last_undegraded":"2023-10-14T12:33:38.026385+0000","last_fullsized":"2023-10-14T12:33:38.026385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:17.701932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847196+0000","last_change":"2023-10-14T12:33:30.828530+0000","last_active":"2023-10-14T12:33:35.847196+0000","last_peered":"2023-10-14T12:33:35.847196+0000","last_clean":"2023-10-14T12:33:35.847196+0000","last_became_active":"2023-10-14T12:33:30.828070+0000","last_became_peered":"2023-10-14T12:33:30.828070+0000","last_unstale":"2023-10-14T12:33:35.847196+0000","last_undegraded":"2023-10-14T12:33:35.847196+0000","last_fullsized":"2023-10-14T12:33:35.847196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:29.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.841114+0000","last_change":"2023-10-14T12:33:31.828949+0000","last_active":"2023-10-14T12:33:35.841114+0000","last_peered":"2023-10-14T12:33:35.841114+0000","last_clean":"2023-10-14T12:33:35.841114+0000","last_became_active":"2023-10-14T12:33:31.828658+0000","last_became_peered":"2023-10-14T12:33:31.828658+0000","last_unstale":"2023-10-14T12:33:35.841114+0000","last_undegraded":"2023-10-14T12:33:35.841114+0000","last_fullsized":"2023-10-14T12:33:35.841114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:24.745702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026150+0000","last_change":"2023-10-14T12:33:35.860287+0000","last_active":"2023-10-14T12:33:38.026150+0000","last_peered":"2023-10-14T12:33:38.026150+0000","last_clean":"2023-10-14T12:33:38.026150+0000","last_became_active":"2023-10-14T12:33:35.859467+0000","last_became_peered":"2023-10-14T12:33:35.859467+0000","last_unstale":"2023-10-14T12:33:38.026150+0000","last_undegraded":"2023-10-14T12:33:38.026150+0000","last_fullsized":"2023-10-14T12:33:38.026150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854284+0000","last_change":"2023-10-14T12:33:31.820322+0000","last_active":"2023-10-14T12:33:35.854284+0000","last_peered":"2023-10-14T12:33:35.854284+0000","last_clean":"2023-10-14T12:33:35.854284+0000","last_became_active":"2023-10-14T12:33:31.820087+0000","last_became_peered":"2023-10-14T12:33:31.820087+0000","last_unstale":"2023-10-14T12:33:35.854284+0000","last_undegraded":"2023-10-14T12:33:35.854284+0000","last_fullsized":"2023-10-14T12:33:35.854284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:45.477157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854363+0000","last_change":"2023-10-14T12:33:30.821383+0000","last_active":"2023-10-14T12:33:35.854363+0000","last_peered":"2023-10-14T12:33:35.854363+0000","last_clean":"2023-10-14T12:33:35.854363+0000","last_became_active":"2023-10-14T12:33:30.821096+0000","last_became_peered":"2023-10-14T12:33:30.821096+0000","last_unstale":"2023-10-14T12:33:35.854363+0000","last_undegraded":"2023-10-14T12:33:35.854363+0000","last_fullsized":"2023-10-14T12:33:35.854363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:23.650329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.840950+0000","last_change":"2023-10-14T12:33:35.858076+0000","last_active":"2023-10-14T12:33:36.840950+0000","last_peered":"2023-10-14T12:33:36.840950+0000","last_clean":"2023-10-14T12:33:36.840950+0000","last_became_active":"2023-10-14T12:33:35.857526+0000","last_became_peered":"2023-10-14T12:33:35.857526+0000","last_unstale":"2023-10-14T12:33:36.840950+0000","last_undegraded":"2023-10-14T12:33:36.840950+0000","last_fullsized":"2023-10-14T12:33:36.840950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843234+0000","last_change":"2023-10-14T12:33:31.868186+0000","last_active":"2023-10-14T12:33:35.843234+0000","last_peered":"2023-10-14T12:33:35.843234+0000","last_clean":"2023-10-14T12:33:35.843234+0000","last_became_active":"2023-10-14T12:33:31.867909+0000","last_became_peered":"2023-10-14T12:33:31.867909+0000","last_unstale":"2023-10-14T12:33:35.843234+0000","last_undegraded":"2023-10-14T12:33:35.843234+0000","last_fullsized":"2023-10-14T12:33:35.843234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847138+0000","last_change":"2023-10-14T12:33:30.828058+0000","last_active":"2023-10-14T12:33:35.847138+0000","last_peered":"2023-10-14T12:33:35.847138+0000","last_clean":"2023-10-14T12:33:35.847138+0000","last_became_active":"2023-10-14T12:33:30.827816+0000","last_became_peered":"2023-10-14T12:33:30.827816+0000","last_unstale":"2023-10-14T12:33:35.847138+0000","last_undegraded":"2023-10-14T12:33:35.847138+0000","last_fullsized":"2023-10-14T12:33:35.847138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:23.650329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839385+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:33:35.839385+0000","last_peered":"2023-10-14T12:33:35.839385+0000","last_clean":"2023-10-14T12:33:35.839385+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:33:35.839385+0000","last_undegraded":"2023-10-14T12:33:35.839385+0000","last_fullsized":"2023-10-14T12:33:35.839385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025827+0000","last_change":"2023-10-14T12:33:35.864687+0000","last_active":"2023-10-14T12:33:38.025827+0000","last_peered":"2023-10-14T12:33:38.025827+0000","last_clean":"2023-10-14T12:33:38.025827+0000","last_became_active":"2023-10-14T12:33:35.864048+0000","last_became_peered":"2023-10-14T12:33:35.864048+0000","last_unstale":"2023-10-14T12:33:38.025827+0000","last_undegraded":"2023-10-14T12:33:38.025827+0000","last_fullsized":"2023-10-14T12:33:38.025827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:17.701932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.849606+0000","last_change":"2023-10-14T12:33:31.833047+0000","last_active":"2023-10-14T12:33:35.849606+0000","last_peered":"2023-10-14T12:33:35.849606+0000","last_clean":"2023-10-14T12:33:35.849606+0000","last_became_active":"2023-10-14T12:33:31.832727+0000","last_became_peered":"2023-10-14T12:33:31.832727+0000","last_unstale":"2023-10-14T12:33:35.849606+0000","last_undegraded":"2023-10-14T12:33:35.849606+0000","last_fullsized":"2023-10-14T12:33:35.849606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839488+0000","last_change":"2023-10-14T12:33:30.825584+0000","last_active":"2023-10-14T12:33:35.839488+0000","last_peered":"2023-10-14T12:33:35.839488+0000","last_clean":"2023-10-14T12:33:35.839488+0000","last_became_active":"2023-10-14T12:33:30.825306+0000","last_became_peered":"2023-10-14T12:33:30.825306+0000","last_unstale":"2023-10-14T12:33:35.839488+0000","last_undegraded":"2023-10-14T12:33:35.839488+0000","last_fullsized":"2023-10-14T12:33:35.839488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025810+0000","last_change":"2023-10-14T12:33:35.869042+0000","last_active":"2023-10-14T12:33:38.025810+0000","last_peered":"2023-10-14T12:33:38.025810+0000","last_clean":"2023-10-14T12:33:38.025810+0000","last_became_active":"2023-10-14T12:33:35.866286+0000","last_became_peered":"2023-10-14T12:33:35.866286+0000","last_unstale":"2023-10-14T12:33:38.025810+0000","last_undegraded":"2023-10-14T12:33:38.025810+0000","last_fullsized":"2023-10-14T12:33:38.025810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838691+0000","last_change":"2023-10-14T12:33:30.830475+0000","last_active":"2023-10-14T12:33:35.838691+0000","last_peered":"2023-10-14T12:33:35.838691+0000","last_clean":"2023-10-14T12:33:35.838691+0000","last_became_active":"2023-10-14T12:33:30.830146+0000","last_became_peered":"2023-10-14T12:33:30.830146+0000","last_unstale":"2023-10-14T12:33:35.838691+0000","last_undegraded":"2023-10-14T12:33:35.838691+0000","last_fullsized":"2023-10-14T12:33:35.838691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:41.110080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854835+0000","last_change":"2023-10-14T12:33:31.820598+0000","last_active":"2023-10-14T12:33:35.854835+0000","last_peered":"2023-10-14T12:33:35.854835+0000","last_clean":"2023-10-14T12:33:35.854835+0000","last_became_active":"2023-10-14T12:33:31.820407+0000","last_became_peered":"2023-10-14T12:33:31.820407+0000","last_unstale":"2023-10-14T12:33:35.854835+0000","last_undegraded":"2023-10-14T12:33:35.854835+0000","last_fullsized":"2023-10-14T12:33:35.854835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027136+0000","last_change":"2023-10-14T12:33:35.862298+0000","last_active":"2023-10-14T12:33:38.027136+0000","last_peered":"2023-10-14T12:33:38.027136+0000","last_clean":"2023-10-14T12:33:38.027136+0000","last_became_active":"2023-10-14T12:33:35.861343+0000","last_became_peered":"2023-10-14T12:33:35.861343+0000","last_unstale":"2023-10-14T12:33:38.027136+0000","last_undegraded":"2023-10-14T12:33:38.027136+0000","last_fullsized":"2023-10-14T12:33:38.027136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:08:15.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854868+0000","last_change":"2023-10-14T12:33:30.822607+0000","last_active":"2023-10-14T12:33:35.854868+0000","last_peered":"2023-10-14T12:33:35.854868+0000","last_clean":"2023-10-14T12:33:35.854868+0000","last_became_active":"2023-10-14T12:33:30.822335+0000","last_became_peered":"2023-10-14T12:33:30.822335+0000","last_unstale":"2023-10-14T12:33:35.854868+0000","last_undegraded":"2023-10-14T12:33:35.854868+0000","last_fullsized":"2023-10-14T12:33:35.854868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.842317+0000","last_change":"2023-10-14T12:33:31.819508+0000","last_active":"2023-10-14T12:33:35.842317+0000","last_peered":"2023-10-14T12:33:35.842317+0000","last_clean":"2023-10-14T12:33:35.842317+0000","last_became_active":"2023-10-14T12:33:31.819245+0000","last_became_peered":"2023-10-14T12:33:31.819245+0000","last_unstale":"2023-10-14T12:33:35.842317+0000","last_undegraded":"2023-10-14T12:33:35.842317+0000","last_fullsized":"2023-10-14T12:33:35.842317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846081+0000","last_change":"2023-10-14T12:33:35.852496+0000","last_active":"2023-10-14T12:33:36.846081+0000","last_peered":"2023-10-14T12:33:36.846081+0000","last_clean":"2023-10-14T12:33:36.846081+0000","last_became_active":"2023-10-14T12:33:35.852067+0000","last_became_peered":"2023-10-14T12:33:35.852067+0000","last_unstale":"2023-10-14T12:33:36.846081+0000","last_undegraded":"2023-10-14T12:33:36.846081+0000","last_fullsized":"2023-10-14T12:33:36.846081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:22.810399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846693+0000","last_change":"2023-10-14T12:33:30.823983+0000","last_active":"2023-10-14T12:33:35.846693+0000","last_peered":"2023-10-14T12:33:35.846693+0000","last_clean":"2023-10-14T12:33:35.846693+0000","last_became_active":"2023-10-14T12:33:30.823708+0000","last_became_peered":"2023-10-14T12:33:30.823708+0000","last_unstale":"2023-10-14T12:33:35.846693+0000","last_undegraded":"2023-10-14T12:33:35.846693+0000","last_fullsized":"2023-10-14T12:33:35.846693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:21.825878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852271+0000","last_change":"2023-10-14T12:33:31.818663+0000","last_active":"2023-10-14T12:33:35.852271+0000","last_peered":"2023-10-14T12:33:35.852271+0000","last_clean":"2023-10-14T12:33:35.852271+0000","last_became_active":"2023-10-14T12:33:31.818315+0000","last_became_peered":"2023-10-14T12:33:31.818315+0000","last_unstale":"2023-10-14T12:33:35.852271+0000","last_undegraded":"2023-10-14T12:33:35.852271+0000","last_fullsized":"2023-10-14T12:33:35.852271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846628+0000","last_change":"2023-10-14T12:33:35.861468+0000","last_active":"2023-10-14T12:33:36.846628+0000","last_peered":"2023-10-14T12:33:36.846628+0000","last_clean":"2023-10-14T12:33:36.846628+0000","last_became_active":"2023-10-14T12:33:35.861024+0000","last_became_peered":"2023-10-14T12:33:35.861024+0000","last_unstale":"2023-10-14T12:33:36.846628+0000","last_undegraded":"2023-10-14T12:33:36.846628+0000","last_fullsized":"2023-10-14T12:33:36.846628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:32.157229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838156+0000","last_change":"2023-10-14T12:33:30.828550+0000","last_active":"2023-10-14T12:33:35.838156+0000","last_peered":"2023-10-14T12:33:35.838156+0000","last_clean":"2023-10-14T12:33:35.838156+0000","last_became_active":"2023-10-14T12:33:30.828270+0000","last_became_peered":"2023-10-14T12:33:30.828270+0000","last_unstale":"2023-10-14T12:33:35.838156+0000","last_undegraded":"2023-10-14T12:33:35.838156+0000","last_fullsized":"2023-10-14T12:33:35.838156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:49.417513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.840140+0000","last_change":"2023-10-14T12:33:31.827714+0000","last_active":"2023-10-14T12:33:35.840140+0000","last_peered":"2023-10-14T12:33:35.840140+0000","last_clean":"2023-10-14T12:33:35.840140+0000","last_became_active":"2023-10-14T12:33:31.827425+0000","last_became_peered":"2023-10-14T12:33:31.827425+0000","last_unstale":"2023-10-14T12:33:35.840140+0000","last_undegraded":"2023-10-14T12:33:35.840140+0000","last_fullsized":"2023-10-14T12:33:35.840140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:22.831522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026298+0000","last_change":"2023-10-14T12:33:35.862529+0000","last_active":"2023-10-14T12:33:38.026298+0000","last_peered":"2023-10-14T12:33:38.026298+0000","last_clean":"2023-10-14T12:33:38.026298+0000","last_became_active":"2023-10-14T12:33:35.862060+0000","last_became_peered":"2023-10-14T12:33:35.862060+0000","last_unstale":"2023-10-14T12:33:38.026298+0000","last_undegraded":"2023-10-14T12:33:38.026298+0000","last_fullsized":"2023-10-14T12:33:38.026298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854468+0000","last_change":"2023-10-14T12:33:30.820328+0000","last_active":"2023-10-14T12:33:35.854468+0000","last_peered":"2023-10-14T12:33:35.854468+0000","last_clean":"2023-10-14T12:33:35.854468+0000","last_became_active":"2023-10-14T12:33:30.820025+0000","last_became_peered":"2023-10-14T12:33:30.820025+0000","last_unstale":"2023-10-14T12:33:35.854468+0000","last_undegraded":"2023-10-14T12:33:35.854468+0000","last_fullsized":"2023-10-14T12:33:35.854468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:41.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844808+0000","last_change":"2023-10-14T12:33:31.818199+0000","last_active":"2023-10-14T12:33:35.844808+0000","last_peered":"2023-10-14T12:33:35.844808+0000","last_clean":"2023-10-14T12:33:35.844808+0000","last_became_active":"2023-10-14T12:33:31.817925+0000","last_became_peered":"2023-10-14T12:33:31.817925+0000","last_unstale":"2023-10-14T12:33:35.844808+0000","last_undegraded":"2023-10-14T12:33:35.844808+0000","last_fullsized":"2023-10-14T12:33:35.844808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846730+0000","last_change":"2023-10-14T12:33:35.861719+0000","last_active":"2023-10-14T12:33:36.846730+0000","last_peered":"2023-10-14T12:33:36.846730+0000","last_clean":"2023-10-14T12:33:36.846730+0000","last_became_active":"2023-10-14T12:33:35.861312+0000","last_became_peered":"2023-10-14T12:33:35.861312+0000","last_unstale":"2023-10-14T12:33:36.846730+0000","last_undegraded":"2023-10-14T12:33:36.846730+0000","last_fullsized":"2023-10-14T12:33:36.846730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:28.879987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.856801+0000","last_change":"2023-10-14T12:33:30.825142+0000","last_active":"2023-10-14T12:33:35.856801+0000","last_peered":"2023-10-14T12:33:35.856801+0000","last_clean":"2023-10-14T12:33:35.856801+0000","last_became_active":"2023-10-14T12:33:30.824853+0000","last_became_peered":"2023-10-14T12:33:30.824853+0000","last_unstale":"2023-10-14T12:33:35.856801+0000","last_undegraded":"2023-10-14T12:33:35.856801+0000","last_fullsized":"2023-10-14T12:33:35.856801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844382+0000","last_change":"2023-10-14T12:33:31.821965+0000","last_active":"2023-10-14T12:33:35.844382+0000","last_peered":"2023-10-14T12:33:35.844382+0000","last_clean":"2023-10-14T12:33:35.844382+0000","last_became_active":"2023-10-14T12:33:31.821689+0000","last_became_peered":"2023-10-14T12:33:31.821689+0000","last_unstale":"2023-10-14T12:33:35.844382+0000","last_undegraded":"2023-10-14T12:33:35.844382+0000","last_fullsized":"2023-10-14T12:33:35.844382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846686+0000","last_change":"2023-10-14T12:33:35.864185+0000","last_active":"2023-10-14T12:33:36.846686+0000","last_peered":"2023-10-14T12:33:36.846686+0000","last_clean":"2023-10-14T12:33:36.846686+0000","last_became_active":"2023-10-14T12:33:35.863769+0000","last_became_peered":"2023-10-14T12:33:35.863769+0000","last_unstale":"2023-10-14T12:33:36.846686+0000","last_undegraded":"2023-10-14T12:33:36.846686+0000","last_fullsized":"2023-10-14T12:33:36.846686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:32.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839226+0000","last_change":"2023-10-14T12:33:30.823464+0000","last_active":"2023-10-14T12:33:35.839226+0000","last_peered":"2023-10-14T12:33:35.839226+0000","last_clean":"2023-10-14T12:33:35.839226+0000","last_became_active":"2023-10-14T12:33:30.823177+0000","last_became_peered":"2023-10-14T12:33:30.823177+0000","last_unstale":"2023-10-14T12:33:35.839226+0000","last_undegraded":"2023-10-14T12:33:35.839226+0000","last_fullsized":"2023-10-14T12:33:35.839226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:29.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846843+0000","last_change":"2023-10-14T12:33:31.828060+0000","last_active":"2023-10-14T12:33:35.846843+0000","last_peered":"2023-10-14T12:33:35.846843+0000","last_clean":"2023-10-14T12:33:35.846843+0000","last_became_active":"2023-10-14T12:33:31.827687+0000","last_became_peered":"2023-10-14T12:33:31.827687+0000","last_unstale":"2023-10-14T12:33:35.846843+0000","last_undegraded":"2023-10-14T12:33:35.846843+0000","last_fullsized":"2023-10-14T12:33:35.846843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.840897+0000","last_change":"2023-10-14T12:33:35.865932+0000","last_active":"2023-10-14T12:33:36.840897+0000","last_peered":"2023-10-14T12:33:36.840897+0000","last_clean":"2023-10-14T12:33:36.840897+0000","last_became_active":"2023-10-14T12:33:35.865529+0000","last_became_peered":"2023-10-14T12:33:35.865529+0000","last_unstale":"2023-10-14T12:33:36.840897+0000","last_undegraded":"2023-10-14T12:33:36.840897+0000","last_fullsized":"2023-10-14T12:33:36.840897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.856213+0000","last_change":"2023-10-14T12:33:30.828503+0000","last_active":"2023-10-14T12:33:35.856213+0000","last_peered":"2023-10-14T12:33:35.856213+0000","last_clean":"2023-10-14T12:33:35.856213+0000","last_became_active":"2023-10-14T12:33:30.828211+0000","last_became_peered":"2023-10-14T12:33:30.828211+0000","last_unstale":"2023-10-14T12:33:35.856213+0000","last_undegraded":"2023-10-14T12:33:35.856213+0000","last_fullsized":"2023-10-14T12:33:35.856213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:21.825878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838912+0000","last_change":"2023-10-14T12:33:31.866962+0000","last_active":"2023-10-14T12:33:35.838912+0000","last_peered":"2023-10-14T12:33:35.838912+0000","last_clean":"2023-10-14T12:33:35.838912+0000","last_became_active":"2023-10-14T12:33:31.866696+0000","last_became_peered":"2023-10-14T12:33:31.866696+0000","last_unstale":"2023-10-14T12:33:35.838912+0000","last_undegraded":"2023-10-14T12:33:35.838912+0000","last_fullsized":"2023-10-14T12:33:35.838912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:10.562723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025680+0000","last_change":"2023-10-14T12:33:35.866856+0000","last_active":"2023-10-14T12:33:38.025680+0000","last_peered":"2023-10-14T12:33:38.025680+0000","last_clean":"2023-10-14T12:33:38.025680+0000","last_became_active":"2023-10-14T12:33:35.865775+0000","last_became_peered":"2023-10-14T12:33:35.865775+0000","last_unstale":"2023-10-14T12:33:38.025680+0000","last_undegraded":"2023-10-14T12:33:38.025680+0000","last_fullsized":"2023-10-14T12:33:38.025680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854778+0000","last_change":"2023-10-14T12:33:30.824177+0000","last_active":"2023-10-14T12:33:35.854778+0000","last_peered":"2023-10-14T12:33:35.854778+0000","last_clean":"2023-10-14T12:33:35.854778+0000","last_became_active":"2023-10-14T12:33:30.823858+0000","last_became_peered":"2023-10-14T12:33:30.823858+0000","last_unstale":"2023-10-14T12:33:35.854778+0000","last_undegraded":"2023-10-14T12:33:35.854778+0000","last_fullsized":"2023-10-14T12:33:35.854778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:09.427953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847722+0000","last_change":"2023-10-14T12:33:31.867990+0000","last_active":"2023-10-14T12:33:35.847722+0000","last_peered":"2023-10-14T12:33:35.847722+0000","last_clean":"2023-10-14T12:33:35.847722+0000","last_became_active":"2023-10-14T12:33:31.867711+0000","last_became_peered":"2023-10-14T12:33:31.867711+0000","last_unstale":"2023-10-14T12:33:35.847722+0000","last_undegraded":"2023-10-14T12:33:35.847722+0000","last_fullsized":"2023-10-14T12:33:35.847722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.319023+0000","last_change":"2023-10-14T12:33:35.852643+0000","last_active":"2023-10-14T12:33:37.319023+0000","last_peered":"2023-10-14T12:33:37.319023+0000","last_clean":"2023-10-14T12:33:37.319023+0000","last_became_active":"2023-10-14T12:33:35.852237+0000","last_became_peered":"2023-10-14T12:33:35.852237+0000","last_unstale":"2023-10-14T12:33:37.319023+0000","last_undegraded":"2023-10-14T12:33:37.319023+0000","last_fullsized":"2023-10-14T12:33:37.319023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:56.042282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.855802+0000","last_change":"2023-10-14T12:33:30.819872+0000","last_active":"2023-10-14T12:33:35.855802+0000","last_peered":"2023-10-14T12:33:35.855802+0000","last_clean":"2023-10-14T12:33:35.855802+0000","last_became_active":"2023-10-14T12:33:30.819553+0000","last_became_peered":"2023-10-14T12:33:30.819553+0000","last_unstale":"2023-10-14T12:33:35.855802+0000","last_undegraded":"2023-10-14T12:33:35.855802+0000","last_fullsized":"2023-10-14T12:33:35.855802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:23.740058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838889+0000","last_change":"2023-10-14T12:33:31.833122+0000","last_active":"2023-10-14T12:33:35.838889+0000","last_peered":"2023-10-14T12:33:35.838889+0000","last_clean":"2023-10-14T12:33:35.838889+0000","last_became_active":"2023-10-14T12:33:31.832825+0000","last_became_peered":"2023-10-14T12:33:31.832825+0000","last_unstale":"2023-10-14T12:33:35.838889+0000","last_undegraded":"2023-10-14T12:33:35.838889+0000","last_fullsized":"2023-10-14T12:33:35.838889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:13.669993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847506+0000","last_change":"2023-10-14T12:33:31.822399+0000","last_active":"2023-10-14T12:33:35.847506+0000","last_peered":"2023-10-14T12:33:35.847506+0000","last_clean":"2023-10-14T12:33:35.847506+0000","last_became_active":"2023-10-14T12:33:31.822073+0000","last_became_peered":"2023-10-14T12:33:31.822073+0000","last_unstale":"2023-10-14T12:33:35.847506+0000","last_undegraded":"2023-10-14T12:33:35.847506+0000","last_fullsized":"2023-10-14T12:33:35.847506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854508+0000","last_change":"2023-10-14T12:33:31.859894+0000","last_active":"2023-10-14T12:33:35.854508+0000","last_peered":"2023-10-14T12:33:35.854508+0000","last_clean":"2023-10-14T12:33:35.854508+0000","last_became_active":"2023-10-14T12:33:31.859679+0000","last_became_peered":"2023-10-14T12:33:31.859679+0000","last_unstale":"2023-10-14T12:33:35.854508+0000","last_undegraded":"2023-10-14T12:33:35.854508+0000","last_fullsized":"2023-10-14T12:33:35.854508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:34.169023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847296+0000","last_change":"2023-10-14T12:33:31.867239+0000","last_active":"2023-10-14T12:33:35.847296+0000","last_peered":"2023-10-14T12:33:35.847296+0000","last_clean":"2023-10-14T12:33:35.847296+0000","last_became_active":"2023-10-14T12:33:31.866961+0000","last_became_peered":"2023-10-14T12:33:31.866961+0000","last_unstale":"2023-10-14T12:33:35.847296+0000","last_undegraded":"2023-10-14T12:33:35.847296+0000","last_fullsized":"2023-10-14T12:33:35.847296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851705+0000","last_change":"2023-10-14T12:33:31.822450+0000","last_active":"2023-10-14T12:33:35.851705+0000","last_peered":"2023-10-14T12:33:35.851705+0000","last_clean":"2023-10-14T12:33:35.851705+0000","last_became_active":"2023-10-14T12:33:31.822248+0000","last_became_peered":"2023-10-14T12:33:31.822248+0000","last_unstale":"2023-10-14T12:33:35.851705+0000","last_undegraded":"2023-10-14T12:33:35.851705+0000","last_fullsized":"2023-10-14T12:33:35.851705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844108+0000","last_change":"2023-10-14T12:33:31.829535+0000","last_active":"2023-10-14T12:33:35.844108+0000","last_peered":"2023-10-14T12:33:35.844108+0000","last_clean":"2023-10-14T12:33:35.844108+0000","last_became_active":"2023-10-14T12:33:31.829266+0000","last_became_peered":"2023-10-14T12:33:31.829266+0000","last_unstale":"2023-10-14T12:33:35.844108+0000","last_undegraded":"2023-10-14T12:33:35.844108+0000","last_fullsized":"2023-10-14T12:33:35.844108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854698+0000","last_change":"2023-10-14T12:33:31.817303+0000","last_active":"2023-10-14T12:33:35.854698+0000","last_peered":"2023-10-14T12:33:35.854698+0000","last_clean":"2023-10-14T12:33:35.854698+0000","last_became_active":"2023-10-14T12:33:31.817008+0000","last_became_peered":"2023-10-14T12:33:31.817008+0000","last_unstale":"2023-10-14T12:33:35.854698+0000","last_undegraded":"2023-10-14T12:33:35.854698+0000","last_fullsized":"2023-10-14T12:33:35.854698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846113+0000","last_change":"2023-10-14T12:33:31.821532+0000","last_active":"2023-10-14T12:33:35.846113+0000","last_peered":"2023-10-14T12:33:35.846113+0000","last_clean":"2023-10-14T12:33:35.846113+0000","last_became_active":"2023-10-14T12:33:31.821205+0000","last_became_peered":"2023-10-14T12:33:31.821205+0000","last_unstale":"2023-10-14T12:33:35.846113+0000","last_undegraded":"2023-10-14T12:33:35.846113+0000","last_fullsized":"2023-10-14T12:33:35.846113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.842791+0000","last_change":"2023-10-14T12:33:31.832580+0000","last_active":"2023-10-14T12:33:35.842791+0000","last_peered":"2023-10-14T12:33:35.842791+0000","last_clean":"2023-10-14T12:33:35.842791+0000","last_became_active":"2023-10-14T12:33:31.832277+0000","last_became_peered":"2023-10-14T12:33:31.832277+0000","last_unstale":"2023-10-14T12:33:35.842791+0000","last_undegraded":"2023-10-14T12:33:35.842791+0000","last_fullsized":"2023-10-14T12:33:35.842791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848235+0000","last_change":"2023-10-14T12:33:31.865900+0000","last_active":"2023-10-14T12:33:35.848235+0000","last_peered":"2023-10-14T12:33:35.848235+0000","last_clean":"2023-10-14T12:33:35.848235+0000","last_became_active":"2023-10-14T12:33:31.865207+0000","last_became_peered":"2023-10-14T12:33:31.865207+0000","last_unstale":"2023-10-14T12:33:35.848235+0000","last_undegraded":"2023-10-14T12:33:35.848235+0000","last_fullsized":"2023-10-14T12:33:35.848235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847269+0000","last_change":"2023-10-14T12:33:31.832616+0000","last_active":"2023-10-14T12:33:35.847269+0000","last_peered":"2023-10-14T12:33:35.847269+0000","last_clean":"2023-10-14T12:33:35.847269+0000","last_became_active":"2023-10-14T12:33:31.832363+0000","last_became_peered":"2023-10-14T12:33:31.832363+0000","last_unstale":"2023-10-14T12:33:35.847269+0000","last_undegraded":"2023-10-14T12:33:35.847269+0000","last_fullsized":"2023-10-14T12:33:35.847269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847336+0000","last_change":"2023-10-14T12:33:31.866907+0000","last_active":"2023-10-14T12:33:35.847336+0000","last_peered":"2023-10-14T12:33:35.847336+0000","last_clean":"2023-10-14T12:33:35.847336+0000","last_became_active":"2023-10-14T12:33:31.866600+0000","last_became_peered":"2023-10-14T12:33:31.866600+0000","last_unstale":"2023-10-14T12:33:35.847336+0000","last_undegraded":"2023-10-14T12:33:35.847336+0000","last_fullsized":"2023-10-14T12:33:35.847336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851789+0000","last_change":"2023-10-14T12:33:31.822750+0000","last_active":"2023-10-14T12:33:35.851789+0000","last_peered":"2023-10-14T12:33:35.851789+0000","last_clean":"2023-10-14T12:33:35.851789+0000","last_became_active":"2023-10-14T12:33:31.822413+0000","last_became_peered":"2023-10-14T12:33:31.822413+0000","last_unstale":"2023-10-14T12:33:35.851789+0000","last_undegraded":"2023-10-14T12:33:35.851789+0000","last_fullsized":"2023-10-14T12:33:35.851789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:18.923716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847017+0000","last_change":"2023-10-14T12:33:31.831194+0000","last_active":"2023-10-14T12:33:35.847017+0000","last_peered":"2023-10-14T12:33:35.847017+0000","last_clean":"2023-10-14T12:33:35.847017+0000","last_became_active":"2023-10-14T12:33:31.830888+0000","last_became_peered":"2023-10-14T12:33:31.830888+0000","last_unstale":"2023-10-14T12:33:35.847017+0000","last_undegraded":"2023-10-14T12:33:35.847017+0000","last_fullsized":"2023-10-14T12:33:35.847017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:33:49.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:33:49.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.762+0000 7f7b0c5db700 1 Processor -- start 2023-10-14T12:33:49.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.762+0000 7f7b0c5db700 1 -- start start 2023-10-14T12:33:49.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b0c5db700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b0415daa0 0x7f7b040af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b0c5db700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0415ed10 con 0x7f7b04071f60 2023-10-14T12:33:49.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b0c5db700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0415de80 con 0x7f7b040af560 2023-10-14T12:33:49.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b0c5db700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0415e100 con 0x7f7b0415daa0 2023-10-14T12:33:49.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b0ab78700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7b04071f60 0x7f7b0406d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:52966/0 (socket says 172.21.15.72:52966) 2023-10-14T12:33:49.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b0ab78700 1 -- 172.21.15.72:0/2311569938 learned_addr learned my addr 172.21.15.72:0/2311569938 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:49.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202992762 0 0) 0x7f7b0415ed10 con 0x7f7b04071f60 2023-10-14T12:33:49.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b0a377700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b0415daa0 0x7f7b040af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7af00035b0 con 0x7f7b04071f60 2023-10-14T12:33:49.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2941930899 0 0) 0x7f7af00035b0 con 0x7f7b04071f60 2023-10-14T12:33:49.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b0415daa0 msgr2=0x7f7b040af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:49.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b0415daa0 0x7f7b040af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 >> v1:172.21.15.123:6789/0 conn(0x7f7b040af560 legacy=0x7f7b04071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0415e3e0 con 0x7f7b04071f60 2023-10-14T12:33:49.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f7afc001a40 con 0x7f7b04071f60 2023-10-14T12:33:49.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 >> v1:172.21.15.72:6789/0 conn(0x7f7b04071f60 legacy=0x7f7b0406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.763+0000 7f7b09375700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b0415daa0 0x7f7af0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09375700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af0003fb0 0x7f7af0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09375700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af0004d90 0x7f7af0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0415e100 con 0x7f7af0003fb0 2023-10-14T12:33:49.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af000dd00 con 0x7f7af0004d90 2023-10-14T12:33:49.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af000dec0 con 0x7f7b0415daa0 2023-10-14T12:33:49.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09b76700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af0003fb0 0x7f7af0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b0a377700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b0415daa0 0x7f7af0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b0ab78700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af0004d90 0x7f7af0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09b76700 1 -- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b0415daa0 msgr2=0x7f7af0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:49.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09b76700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b0415daa0 0x7f7af0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09b76700 1 -- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af0004d90 msgr2=0x7f7af0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:49.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09b76700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af0004d90 0x7f7af0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09b76700 1 -- 172.21.15.72:0/2311569938 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af00035b0 con 0x7f7af0003fb0 2023-10-14T12:33:49.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09b76700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af0003fb0 0x7f7af0004850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7af40017c0 tx=0x7f7af0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d47fba6cc9592f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40052d0 con 0x7f7af0003fb0 2023-10-14T12:33:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af4005430 con 0x7f7af0003fb0 2023-10-14T12:33:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.764+0000 7f7b09375700 1 -- 172.21.15.72:0/2311569938 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af40038c0 con 0x7f7af0003fb0 2023-10-14T12:33:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.765+0000 7f7b0c5db700 1 -- 172.21.15.72:0/2311569938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af0003fb0 msgr2=0x7f7af0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.765+0000 7f7b0c5db700 1 --2- 172.21.15.72:0/2311569938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7af0003fb0 0x7f7af0004850 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7af40017c0 tx=0x7f7af0005880 comp rx=0 tx=0).stop 2023-10-14T12:33:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.765+0000 7f7b0ab78700 1 -- 172.21.15.72:0/2311569938 reap_dead start 2023-10-14T12:33:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.765+0000 7f7b0c5db700 1 -- 172.21.15.72:0/2311569938 shutdown_connections 2023-10-14T12:33:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.765+0000 7f7b0c5db700 1 -- 172.21.15.72:0/2311569938 >> 172.21.15.72:0/2311569938 conn(0x7f7b040d0180 msgr2=0x7f7b040d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.765+0000 7f7b0c5db700 1 -- 172.21.15.72:0/2311569938 shutdown_connections 2023-10-14T12:33:49.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.765+0000 7f7b0c5db700 1 -- 172.21.15.72:0/2311569938 wait complete. 2023-10-14T12:33:49.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.766+0000 7f7b0c5db700 1 Processor -- start 2023-10-14T12:33:49.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.766+0000 7f7b0c5db700 1 -- start start 2023-10-14T12:33:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.767+0000 7f7b0c5db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af0003fb0 0x7f7b040c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.767+0000 7f7b0c5db700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b04159eb0 0x7f7b04146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.767+0000 7f7b0c5db700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0415a330 0x7f7b04146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.767+0000 7f7b0c5db700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04156e40 con 0x7f7b0415a330 2023-10-14T12:33:49.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.767+0000 7f7b0c5db700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04157120 con 0x7f7af0003fb0 2023-10-14T12:33:49.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.767+0000 7f7b0c5db700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b04157400 con 0x7f7b04159eb0 2023-10-14T12:33:49.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0ab78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0415a330 0x7f7b04146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0ab78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0415a330 0x7f7b04146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46678/0 (socket says 172.21.15.72:46678) 2023-10-14T12:33:49.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0ab78700 1 -- 172.21.15.72:0/3102605246 learned_addr learned my addr 172.21.15.72:0/3102605246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:49.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b09b76700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b04159eb0 0x7f7b04146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0a377700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af0003fb0 0x7f7b040c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0ab78700 1 -- 172.21.15.72:0/3102605246 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b04159eb0 msgr2=0x7f7b04146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0ab78700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b04159eb0 0x7f7b04146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0ab78700 1 -- 172.21.15.72:0/3102605246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af0003fb0 msgr2=0x7f7b040c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0ab78700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af0003fb0 0x7f7b040c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0ab78700 1 -- 172.21.15.72:0/3102605246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04156b30 con 0x7f7b0415a330 2023-10-14T12:33:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0ab78700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0415a330 0x7f7b04146960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0011e0 tx=0x7f7afc00a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7afaffd700 1 -- 172.21.15.72:0/3102605246 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc00ac50 con 0x7f7b0415a330 2023-10-14T12:33:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7afaffd700 1 -- 172.21.15.72:0/3102605246 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc00adb0 con 0x7f7b0415a330 2023-10-14T12:33:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b04157c00 con 0x7f7b0415a330 2023-10-14T12:33:49.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7afaffd700 1 -- 172.21.15.72:0/3102605246 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc013630 con 0x7f7b0415a330 2023-10-14T12:33:49.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.768+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b04147200 con 0x7f7b0415a330 2023-10-14T12:33:49.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.769+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b04156f80 con 0x7f7b0415a330 2023-10-14T12:33:49.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.769+0000 7f7afaffd700 1 -- 172.21.15.72:0/3102605246 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7afc007d50 con 0x7f7b0415a330 2023-10-14T12:33:49.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.770+0000 7f7afaffd700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ae806af00 0x7f7ae806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:49.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.770+0000 7f7b0a377700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ae806af00 0x7f7ae806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:49.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.770+0000 7f7afaffd700 1 -- 172.21.15.72:0/3102605246 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7afc089e10 con 0x7f7b0415a330 2023-10-14T12:33:49.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.770+0000 7f7b0a377700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ae806af00 0x7f7ae806d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009c60 tx=0x7f7b00009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:49.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.775+0000 7f7afaffd700 1 -- 172.21.15.72:0/3102605246 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b04156f80 con 0x7f7b0415a330 2023-10-14T12:33:49.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.961+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b0415e9a0 con 0x7f7ae806af00 2023-10-14T12:33:49.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.970+0000 7f7afaffd700 1 -- 172.21.15.72:0/3102605246 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345328 (secure 0 0 0) 0x7f7b00019070 con 0x7f7ae806af00 2023-10-14T12:33:49.975 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.973+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ae806af00 msgr2=0x7f7ae806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.973+0000 7f7b0c5db700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ae806af00 0x7f7ae806d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009c60 tx=0x7f7b00009210 comp rx=0 tx=0).stop 2023-10-14T12:33:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.973+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0415a330 msgr2=0x7f7b04146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.973+0000 7f7b0c5db700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0415a330 0x7f7b04146960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0011e0 tx=0x7f7afc00a590 comp rx=0 tx=0).stop 2023-10-14T12:33:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.974+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 shutdown_connections 2023-10-14T12:33:49.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.974+0000 7f7b0c5db700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7ae806af00 0x7f7ae806d3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.974+0000 7f7b0c5db700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b0415a330 0x7f7b04146960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.974+0000 7f7b0c5db700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7af0003fb0 0x7f7b040c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.974+0000 7f7b0c5db700 1 --2- 172.21.15.72:0/3102605246 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7b04159eb0 0x7f7b04146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:49.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.974+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 >> 172.21.15.72:0/3102605246 conn(0x7f7b040d0180 msgr2=0x7f7b040ad060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:49.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.974+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 shutdown_connections 2023-10-14T12:33:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:49.974+0000 7f7b0c5db700 1 -- 172.21.15.72:0/3102605246 wait complete. 2023-10-14T12:33:49.981 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:33:49.987 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-10-14T12:33:49.388094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1987974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002510"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839274+0000","last_change":"2023-10-14T12:33:31.821005+0000","last_active":"2023-10-14T12:33:35.839274+0000","last_peered":"2023-10-14T12:33:35.839274+0000","last_clean":"2023-10-14T12:33:35.839274+0000","last_became_active":"2023-10-14T12:33:31.820734+0000","last_became_peered":"2023-10-14T12:33:31.820734+0000","last_unstale":"2023-10-14T12:33:35.839274+0000","last_undegraded":"2023-10-14T12:33:35.839274+0000","last_fullsized":"2023-10-14T12:33:35.839274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:09.495473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854834+0000","last_change":"2023-10-14T12:33:31.821170+0000","last_active":"2023-10-14T12:33:35.854834+0000","last_peered":"2023-10-14T12:33:35.854834+0000","last_clean":"2023-10-14T12:33:35.854834+0000","last_became_active":"2023-10-14T12:33:31.820856+0000","last_became_peered":"2023-10-14T12:33:31.820856+0000","last_unstale":"2023-10-14T12:33:35.854834+0000","last_undegraded":"2023-10-14T12:33:35.854834+0000","last_fullsized":"2023-10-14T12:33:35.854834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851677+0000","last_change":"2023-10-14T12:33:31.819460+0000","last_active":"2023-10-14T12:33:35.851677+0000","last_peered":"2023-10-14T12:33:35.851677+0000","last_clean":"2023-10-14T12:33:35.851677+0000","last_became_active":"2023-10-14T12:33:31.819214+0000","last_became_peered":"2023-10-14T12:33:31.819214+0000","last_unstale":"2023-10-14T12:33:35.851677+0000","last_undegraded":"2023-10-14T12:33:35.851677+0000","last_fullsized":"2023-10-14T12:33:35.851677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:45.477157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847884+0000","last_change":"2023-10-14T12:33:31.866158+0000","last_active":"2023-10-14T12:33:35.847884+0000","last_peered":"2023-10-14T12:33:35.847884+0000","last_clean":"2023-10-14T12:33:35.847884+0000","last_became_active":"2023-10-14T12:33:31.865728+0000","last_became_peered":"2023-10-14T12:33:31.865728+0000","last_unstale":"2023-10-14T12:33:35.847884+0000","last_undegraded":"2023-10-14T12:33:35.847884+0000","last_fullsized":"2023-10-14T12:33:35.847884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839008+0000","last_change":"2023-10-14T12:33:31.819060+0000","last_active":"2023-10-14T12:33:35.839008+0000","last_peered":"2023-10-14T12:33:35.839008+0000","last_clean":"2023-10-14T12:33:35.839008+0000","last_became_active":"2023-10-14T12:33:31.818717+0000","last_became_peered":"2023-10-14T12:33:31.818717+0000","last_unstale":"2023-10-14T12:33:35.839008+0000","last_undegraded":"2023-10-14T12:33:35.839008+0000","last_fullsized":"2023-10-14T12:33:35.839008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847401+0000","last_change":"2023-10-14T12:33:31.866358+0000","last_active":"2023-10-14T12:33:35.847401+0000","last_peered":"2023-10-14T12:33:35.847401+0000","last_clean":"2023-10-14T12:33:35.847401+0000","last_became_active":"2023-10-14T12:33:31.865112+0000","last_became_peered":"2023-10-14T12:33:31.865112+0000","last_unstale":"2023-10-14T12:33:35.847401+0000","last_undegraded":"2023-10-14T12:33:35.847401+0000","last_fullsized":"2023-10-14T12:33:35.847401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838459+0000","last_change":"2023-10-14T12:33:31.821764+0000","last_active":"2023-10-14T12:33:35.838459+0000","last_peered":"2023-10-14T12:33:35.838459+0000","last_clean":"2023-10-14T12:33:35.838459+0000","last_became_active":"2023-10-14T12:33:31.821450+0000","last_became_peered":"2023-10-14T12:33:31.821450+0000","last_unstale":"2023-10-14T12:33:35.838459+0000","last_undegraded":"2023-10-14T12:33:35.838459+0000","last_fullsized":"2023-10-14T12:33:35.838459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.850717+0000","last_change":"2023-10-14T12:33:31.861876+0000","last_active":"2023-10-14T12:33:35.850717+0000","last_peered":"2023-10-14T12:33:35.850717+0000","last_clean":"2023-10-14T12:33:35.850717+0000","last_became_active":"2023-10-14T12:33:31.861620+0000","last_became_peered":"2023-10-14T12:33:31.861620+0000","last_unstale":"2023-10-14T12:33:35.850717+0000","last_undegraded":"2023-10-14T12:33:35.850717+0000","last_fullsized":"2023-10-14T12:33:35.850717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839160+0000","last_change":"2023-10-14T12:33:31.863420+0000","last_active":"2023-10-14T12:33:35.839160+0000","last_peered":"2023-10-14T12:33:35.839160+0000","last_clean":"2023-10-14T12:33:35.839160+0000","last_became_active":"2023-10-14T12:33:31.863132+0000","last_became_peered":"2023-10-14T12:33:31.863132+0000","last_unstale":"2023-10-14T12:33:35.839160+0000","last_undegraded":"2023-10-14T12:33:35.839160+0000","last_fullsized":"2023-10-14T12:33:35.839160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:19.041798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.845863+0000","last_change":"2023-10-14T12:33:31.863478+0000","last_active":"2023-10-14T12:33:35.845863+0000","last_peered":"2023-10-14T12:33:35.845863+0000","last_clean":"2023-10-14T12:33:35.845863+0000","last_became_active":"2023-10-14T12:33:31.863150+0000","last_became_peered":"2023-10-14T12:33:31.863150+0000","last_unstale":"2023-10-14T12:33:35.845863+0000","last_undegraded":"2023-10-14T12:33:35.845863+0000","last_fullsized":"2023-10-14T12:33:35.845863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.845900+0000","last_change":"2023-10-14T12:33:31.866438+0000","last_active":"2023-10-14T12:33:35.845900+0000","last_peered":"2023-10-14T12:33:35.845900+0000","last_clean":"2023-10-14T12:33:35.845900+0000","last_became_active":"2023-10-14T12:33:31.866147+0000","last_became_peered":"2023-10-14T12:33:31.866147+0000","last_unstale":"2023-10-14T12:33:35.845900+0000","last_undegraded":"2023-10-14T12:33:35.845900+0000","last_fullsized":"2023-10-14T12:33:35.845900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839597+0000","last_change":"2023-10-14T12:33:31.829329+0000","last_active":"2023-10-14T12:33:35.839597+0000","last_peered":"2023-10-14T12:33:35.839597+0000","last_clean":"2023-10-14T12:33:35.839597+0000","last_became_active":"2023-10-14T12:33:31.828803+0000","last_became_peered":"2023-10-14T12:33:31.828803+0000","last_unstale":"2023-10-14T12:33:35.839597+0000","last_undegraded":"2023-10-14T12:33:35.839597+0000","last_fullsized":"2023-10-14T12:33:35.839597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:34.169023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844063+0000","last_change":"2023-10-14T12:33:31.817287+0000","last_active":"2023-10-14T12:33:35.844063+0000","last_peered":"2023-10-14T12:33:35.844063+0000","last_clean":"2023-10-14T12:33:35.844063+0000","last_became_active":"2023-10-14T12:33:31.817007+0000","last_became_peered":"2023-10-14T12:33:31.817007+0000","last_unstale":"2023-10-14T12:33:35.844063+0000","last_undegraded":"2023-10-14T12:33:35.844063+0000","last_fullsized":"2023-10-14T12:33:35.844063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852024+0000","last_change":"2023-10-14T12:33:31.818967+0000","last_active":"2023-10-14T12:33:35.852024+0000","last_peered":"2023-10-14T12:33:35.852024+0000","last_clean":"2023-10-14T12:33:35.852024+0000","last_became_active":"2023-10-14T12:33:31.818735+0000","last_became_peered":"2023-10-14T12:33:31.818735+0000","last_unstale":"2023-10-14T12:33:35.852024+0000","last_undegraded":"2023-10-14T12:33:35.852024+0000","last_fullsized":"2023-10-14T12:33:35.852024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:42.240740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854372+0000","last_change":"2023-10-14T12:33:31.834837+0000","last_active":"2023-10-14T12:33:35.854372+0000","last_peered":"2023-10-14T12:33:35.854372+0000","last_clean":"2023-10-14T12:33:35.854372+0000","last_became_active":"2023-10-14T12:33:31.834576+0000","last_became_peered":"2023-10-14T12:33:31.834576+0000","last_unstale":"2023-10-14T12:33:35.854372+0000","last_undegraded":"2023-10-14T12:33:35.854372+0000","last_fullsized":"2023-10-14T12:33:35.854372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847198+0000","last_change":"2023-10-14T12:33:31.865491+0000","last_active":"2023-10-14T12:33:35.847198+0000","last_peered":"2023-10-14T12:33:35.847198+0000","last_clean":"2023-10-14T12:33:35.847198+0000","last_became_active":"2023-10-14T12:33:31.865142+0000","last_became_peered":"2023-10-14T12:33:31.865142+0000","last_unstale":"2023-10-14T12:33:35.847198+0000","last_undegraded":"2023-10-14T12:33:35.847198+0000","last_fullsized":"2023-10-14T12:33:35.847198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848563+0000","last_change":"2023-10-14T12:33:31.861934+0000","last_active":"2023-10-14T12:33:35.848563+0000","last_peered":"2023-10-14T12:33:35.848563+0000","last_clean":"2023-10-14T12:33:35.848563+0000","last_became_active":"2023-10-14T12:33:31.861682+0000","last_became_peered":"2023-10-14T12:33:31.861682+0000","last_unstale":"2023-10-14T12:33:35.848563+0000","last_undegraded":"2023-10-14T12:33:35.848563+0000","last_fullsized":"2023-10-14T12:33:35.848563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:10.562723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.855911+0000","last_change":"2023-10-14T12:33:31.819647+0000","last_active":"2023-10-14T12:33:35.855911+0000","last_peered":"2023-10-14T12:33:35.855911+0000","last_clean":"2023-10-14T12:33:35.855911+0000","last_became_active":"2023-10-14T12:33:31.817659+0000","last_became_peered":"2023-10-14T12:33:31.817659+0000","last_unstale":"2023-10-14T12:33:35.855911+0000","last_undegraded":"2023-10-14T12:33:35.855911+0000","last_fullsized":"2023-10-14T12:33:35.855911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:54.849594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839113+0000","last_change":"2023-10-14T12:33:31.823287+0000","last_active":"2023-10-14T12:33:35.839113+0000","last_peered":"2023-10-14T12:33:35.839113+0000","last_clean":"2023-10-14T12:33:35.839113+0000","last_became_active":"2023-10-14T12:33:31.823062+0000","last_became_peered":"2023-10-14T12:33:31.823062+0000","last_unstale":"2023-10-14T12:33:35.839113+0000","last_undegraded":"2023-10-14T12:33:35.839113+0000","last_fullsized":"2023-10-14T12:33:35.839113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027435+0000","last_change":"2023-10-14T12:33:35.856495+0000","last_active":"2023-10-14T12:33:38.027435+0000","last_peered":"2023-10-14T12:33:38.027435+0000","last_clean":"2023-10-14T12:33:38.027435+0000","last_became_active":"2023-10-14T12:33:35.856098+0000","last_became_peered":"2023-10-14T12:33:35.856098+0000","last_unstale":"2023-10-14T12:33:38.027435+0000","last_undegraded":"2023-10-14T12:33:38.027435+0000","last_fullsized":"2023-10-14T12:33:38.027435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:19.985088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852656+0000","last_change":"2023-10-14T12:33:30.830266+0000","last_active":"2023-10-14T12:33:35.852656+0000","last_peered":"2023-10-14T12:33:35.852656+0000","last_clean":"2023-10-14T12:33:35.852656+0000","last_became_active":"2023-10-14T12:33:30.829974+0000","last_became_peered":"2023-10-14T12:33:30.829974+0000","last_unstale":"2023-10-14T12:33:35.852656+0000","last_undegraded":"2023-10-14T12:33:35.852656+0000","last_fullsized":"2023-10-14T12:33:35.852656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843869+0000","last_change":"2023-10-14T12:33:31.823407+0000","last_active":"2023-10-14T12:33:35.843869+0000","last_peered":"2023-10-14T12:33:35.843869+0000","last_clean":"2023-10-14T12:33:35.843869+0000","last_became_active":"2023-10-14T12:33:31.823134+0000","last_became_peered":"2023-10-14T12:33:31.823134+0000","last_unstale":"2023-10-14T12:33:35.843869+0000","last_undegraded":"2023-10-14T12:33:35.843869+0000","last_fullsized":"2023-10-14T12:33:35.843869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846110+0000","last_change":"2023-10-14T12:33:35.860480+0000","last_active":"2023-10-14T12:33:36.846110+0000","last_peered":"2023-10-14T12:33:36.846110+0000","last_clean":"2023-10-14T12:33:36.846110+0000","last_became_active":"2023-10-14T12:33:35.860054+0000","last_became_peered":"2023-10-14T12:33:35.860054+0000","last_unstale":"2023-10-14T12:33:36.846110+0000","last_undegraded":"2023-10-14T12:33:36.846110+0000","last_fullsized":"2023-10-14T12:33:36.846110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:46.147663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843810+0000","last_change":"2023-10-14T12:33:30.828686+0000","last_active":"2023-10-14T12:33:35.843810+0000","last_peered":"2023-10-14T12:33:35.843810+0000","last_clean":"2023-10-14T12:33:35.843810+0000","last_became_active":"2023-10-14T12:33:30.828358+0000","last_became_peered":"2023-10-14T12:33:30.828358+0000","last_unstale":"2023-10-14T12:33:35.843810+0000","last_undegraded":"2023-10-14T12:33:35.843810+0000","last_fullsized":"2023-10-14T12:33:35.843810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852396+0000","last_change":"2023-10-14T12:33:31.863657+0000","last_active":"2023-10-14T12:33:35.852396+0000","last_peered":"2023-10-14T12:33:35.852396+0000","last_clean":"2023-10-14T12:33:35.852396+0000","last_became_active":"2023-10-14T12:33:31.863270+0000","last_became_peered":"2023-10-14T12:33:31.863270+0000","last_unstale":"2023-10-14T12:33:35.852396+0000","last_undegraded":"2023-10-14T12:33:35.852396+0000","last_fullsized":"2023-10-14T12:33:35.852396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846369+0000","last_change":"2023-10-14T12:33:35.860669+0000","last_active":"2023-10-14T12:33:36.846369+0000","last_peered":"2023-10-14T12:33:36.846369+0000","last_clean":"2023-10-14T12:33:36.846369+0000","last_became_active":"2023-10-14T12:33:35.860172+0000","last_became_peered":"2023-10-14T12:33:35.860172+0000","last_unstale":"2023-10-14T12:33:36.846369+0000","last_undegraded":"2023-10-14T12:33:36.846369+0000","last_fullsized":"2023-10-14T12:33:36.846369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:34.560475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838805+0000","last_change":"2023-10-14T12:33:30.823902+0000","last_active":"2023-10-14T12:33:35.838805+0000","last_peered":"2023-10-14T12:33:35.838805+0000","last_clean":"2023-10-14T12:33:35.838805+0000","last_became_active":"2023-10-14T12:33:30.823644+0000","last_became_peered":"2023-10-14T12:33:30.823644+0000","last_unstale":"2023-10-14T12:33:35.838805+0000","last_undegraded":"2023-10-14T12:33:35.838805+0000","last_fullsized":"2023-10-14T12:33:35.838805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:29.522892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847636+0000","last_change":"2023-10-14T12:33:31.865659+0000","last_active":"2023-10-14T12:33:35.847636+0000","last_peered":"2023-10-14T12:33:35.847636+0000","last_clean":"2023-10-14T12:33:35.847636+0000","last_became_active":"2023-10-14T12:33:31.865277+0000","last_became_peered":"2023-10-14T12:33:31.865277+0000","last_unstale":"2023-10-14T12:33:35.847636+0000","last_undegraded":"2023-10-14T12:33:35.847636+0000","last_fullsized":"2023-10-14T12:33:35.847636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:15.636750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846392+0000","last_change":"2023-10-14T12:33:35.854228+0000","last_active":"2023-10-14T12:33:36.846392+0000","last_peered":"2023-10-14T12:33:36.846392+0000","last_clean":"2023-10-14T12:33:36.846392+0000","last_became_active":"2023-10-14T12:33:35.853491+0000","last_became_peered":"2023-10-14T12:33:35.853491+0000","last_unstale":"2023-10-14T12:33:36.846392+0000","last_undegraded":"2023-10-14T12:33:36.846392+0000","last_fullsized":"2023-10-14T12:33:36.846392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:41.319662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838457+0000","last_change":"2023-10-14T12:33:30.829300+0000","last_active":"2023-10-14T12:33:35.838457+0000","last_peered":"2023-10-14T12:33:35.838457+0000","last_clean":"2023-10-14T12:33:35.838457+0000","last_became_active":"2023-10-14T12:33:30.829047+0000","last_became_peered":"2023-10-14T12:33:30.829047+0000","last_unstale":"2023-10-14T12:33:35.838457+0000","last_undegraded":"2023-10-14T12:33:35.838457+0000","last_fullsized":"2023-10-14T12:33:35.838457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:41.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848050+0000","last_change":"2023-10-14T12:33:31.866122+0000","last_active":"2023-10-14T12:33:35.848050+0000","last_peered":"2023-10-14T12:33:35.848050+0000","last_clean":"2023-10-14T12:33:35.848050+0000","last_became_active":"2023-10-14T12:33:31.865828+0000","last_became_peered":"2023-10-14T12:33:31.865828+0000","last_unstale":"2023-10-14T12:33:35.848050+0000","last_undegraded":"2023-10-14T12:33:35.848050+0000","last_fullsized":"2023-10-14T12:33:35.848050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:13.669993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027681+0000","last_change":"2023-10-14T12:33:35.866746+0000","last_active":"2023-10-14T12:33:38.027681+0000","last_peered":"2023-10-14T12:33:38.027681+0000","last_clean":"2023-10-14T12:33:38.027681+0000","last_became_active":"2023-10-14T12:33:35.866256+0000","last_became_peered":"2023-10-14T12:33:35.866256+0000","last_unstale":"2023-10-14T12:33:38.027681+0000","last_undegraded":"2023-10-14T12:33:38.027681+0000","last_fullsized":"2023-10-14T12:33:38.027681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:45:51.637024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844274+0000","last_change":"2023-10-14T12:33:30.816017+0000","last_active":"2023-10-14T12:33:35.844274+0000","last_peered":"2023-10-14T12:33:35.844274+0000","last_clean":"2023-10-14T12:33:35.844274+0000","last_became_active":"2023-10-14T12:33:30.815728+0000","last_became_peered":"2023-10-14T12:33:30.815728+0000","last_unstale":"2023-10-14T12:33:35.844274+0000","last_undegraded":"2023-10-14T12:33:35.844274+0000","last_fullsized":"2023-10-14T12:33:35.844274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:23.740058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838523+0000","last_change":"2023-10-14T12:33:31.830404+0000","last_active":"2023-10-14T12:33:35.838523+0000","last_peered":"2023-10-14T12:33:35.838523+0000","last_clean":"2023-10-14T12:33:35.838523+0000","last_became_active":"2023-10-14T12:33:31.830125+0000","last_became_peered":"2023-10-14T12:33:31.830125+0000","last_unstale":"2023-10-14T12:33:35.838523+0000","last_undegraded":"2023-10-14T12:33:35.838523+0000","last_fullsized":"2023-10-14T12:33:35.838523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:13.312142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.318744+0000","last_change":"2023-10-14T12:33:35.865486+0000","last_active":"2023-10-14T12:33:37.318744+0000","last_peered":"2023-10-14T12:33:37.318744+0000","last_clean":"2023-10-14T12:33:37.318744+0000","last_became_active":"2023-10-14T12:33:35.865104+0000","last_became_peered":"2023-10-14T12:33:35.865104+0000","last_unstale":"2023-10-14T12:33:37.318744+0000","last_undegraded":"2023-10-14T12:33:37.318744+0000","last_fullsized":"2023-10-14T12:33:37.318744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:46.272679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846748+0000","last_change":"2023-10-14T12:33:30.818159+0000","last_active":"2023-10-14T12:33:35.846748+0000","last_peered":"2023-10-14T12:33:35.846748+0000","last_clean":"2023-10-14T12:33:35.846748+0000","last_became_active":"2023-10-14T12:33:30.817845+0000","last_became_peered":"2023-10-14T12:33:30.817845+0000","last_unstale":"2023-10-14T12:33:35.846748+0000","last_undegraded":"2023-10-14T12:33:35.846748+0000","last_fullsized":"2023-10-14T12:33:35.846748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851619+0000","last_change":"2023-10-14T12:33:31.833662+0000","last_active":"2023-10-14T12:33:35.851619+0000","last_peered":"2023-10-14T12:33:35.851619+0000","last_clean":"2023-10-14T12:33:35.851619+0000","last_became_active":"2023-10-14T12:33:31.833398+0000","last_became_peered":"2023-10-14T12:33:31.833398+0000","last_unstale":"2023-10-14T12:33:35.851619+0000","last_undegraded":"2023-10-14T12:33:35.851619+0000","last_fullsized":"2023-10-14T12:33:35.851619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.841255+0000","last_change":"2023-10-14T12:33:35.866463+0000","last_active":"2023-10-14T12:33:36.841255+0000","last_peered":"2023-10-14T12:33:36.841255+0000","last_clean":"2023-10-14T12:33:36.841255+0000","last_became_active":"2023-10-14T12:33:35.866062+0000","last_became_peered":"2023-10-14T12:33:35.866062+0000","last_unstale":"2023-10-14T12:33:36.841255+0000","last_undegraded":"2023-10-14T12:33:36.841255+0000","last_fullsized":"2023-10-14T12:33:36.841255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847361+0000","last_change":"2023-10-14T12:33:30.821259+0000","last_active":"2023-10-14T12:33:35.847361+0000","last_peered":"2023-10-14T12:33:35.847361+0000","last_clean":"2023-10-14T12:33:35.847361+0000","last_became_active":"2023-10-14T12:33:30.820962+0000","last_became_peered":"2023-10-14T12:33:30.820962+0000","last_unstale":"2023-10-14T12:33:35.847361+0000","last_undegraded":"2023-10-14T12:33:35.847361+0000","last_fullsized":"2023-10-14T12:33:35.847361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844696+0000","last_change":"2023-10-14T12:33:31.821784+0000","last_active":"2023-10-14T12:33:35.844696+0000","last_peered":"2023-10-14T12:33:35.844696+0000","last_clean":"2023-10-14T12:33:35.844696+0000","last_became_active":"2023-10-14T12:33:31.821472+0000","last_became_peered":"2023-10-14T12:33:31.821472+0000","last_unstale":"2023-10-14T12:33:35.844696+0000","last_undegraded":"2023-10-14T12:33:35.844696+0000","last_fullsized":"2023-10-14T12:33:35.844696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025944+0000","last_change":"2023-10-14T12:33:35.861224+0000","last_active":"2023-10-14T12:33:38.025944+0000","last_peered":"2023-10-14T12:33:38.025944+0000","last_clean":"2023-10-14T12:33:38.025944+0000","last_became_active":"2023-10-14T12:33:35.860816+0000","last_became_peered":"2023-10-14T12:33:35.860816+0000","last_unstale":"2023-10-14T12:33:38.025944+0000","last_undegraded":"2023-10-14T12:33:38.025944+0000","last_fullsized":"2023-10-14T12:33:38.025944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:23.073737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847265+0000","last_change":"2023-10-14T12:33:30.826762+0000","last_active":"2023-10-14T12:33:35.847265+0000","last_peered":"2023-10-14T12:33:35.847265+0000","last_clean":"2023-10-14T12:33:35.847265+0000","last_became_active":"2023-10-14T12:33:30.826477+0000","last_became_peered":"2023-10-14T12:33:30.826477+0000","last_unstale":"2023-10-14T12:33:35.847265+0000","last_undegraded":"2023-10-14T12:33:35.847265+0000","last_fullsized":"2023-10-14T12:33:35.847265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854580+0000","last_change":"2023-10-14T12:33:31.817507+0000","last_active":"2023-10-14T12:33:35.854580+0000","last_peered":"2023-10-14T12:33:35.854580+0000","last_clean":"2023-10-14T12:33:35.854580+0000","last_became_active":"2023-10-14T12:33:31.817121+0000","last_became_peered":"2023-10-14T12:33:31.817121+0000","last_unstale":"2023-10-14T12:33:35.854580+0000","last_undegraded":"2023-10-14T12:33:35.854580+0000","last_fullsized":"2023-10-14T12:33:35.854580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027281+0000","last_change":"2023-10-14T12:33:35.856441+0000","last_active":"2023-10-14T12:33:38.027281+0000","last_peered":"2023-10-14T12:33:38.027281+0000","last_clean":"2023-10-14T12:33:38.027281+0000","last_became_active":"2023-10-14T12:33:35.856034+0000","last_became_peered":"2023-10-14T12:33:35.856034+0000","last_unstale":"2023-10-14T12:33:38.027281+0000","last_undegraded":"2023-10-14T12:33:38.027281+0000","last_fullsized":"2023-10-14T12:33:38.027281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:56.042282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846794+0000","last_change":"2023-10-14T12:33:30.827702+0000","last_active":"2023-10-14T12:33:35.846794+0000","last_peered":"2023-10-14T12:33:35.846794+0000","last_clean":"2023-10-14T12:33:35.846794+0000","last_became_active":"2023-10-14T12:33:30.827300+0000","last_became_peered":"2023-10-14T12:33:30.827300+0000","last_unstale":"2023-10-14T12:33:35.846794+0000","last_undegraded":"2023-10-14T12:33:35.846794+0000","last_fullsized":"2023-10-14T12:33:35.846794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848452+0000","last_change":"2023-10-14T12:33:31.865300+0000","last_active":"2023-10-14T12:33:35.848452+0000","last_peered":"2023-10-14T12:33:35.848452+0000","last_clean":"2023-10-14T12:33:35.848452+0000","last_became_active":"2023-10-14T12:33:31.865011+0000","last_became_peered":"2023-10-14T12:33:31.865011+0000","last_unstale":"2023-10-14T12:33:35.848452+0000","last_undegraded":"2023-10-14T12:33:35.848452+0000","last_fullsized":"2023-10-14T12:33:35.848452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:21.583926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027294+0000","last_change":"2023-10-14T12:33:35.862519+0000","last_active":"2023-10-14T12:33:38.027294+0000","last_peered":"2023-10-14T12:33:38.027294+0000","last_clean":"2023-10-14T12:33:38.027294+0000","last_became_active":"2023-10-14T12:33:35.861926+0000","last_became_peered":"2023-10-14T12:33:35.861926+0000","last_unstale":"2023-10-14T12:33:38.027294+0000","last_undegraded":"2023-10-14T12:33:38.027294+0000","last_fullsized":"2023-10-14T12:33:38.027294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:27.584701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848363+0000","last_change":"2023-10-14T12:33:30.826679+0000","last_active":"2023-10-14T12:33:35.848363+0000","last_peered":"2023-10-14T12:33:35.848363+0000","last_clean":"2023-10-14T12:33:35.848363+0000","last_became_active":"2023-10-14T12:33:30.826407+0000","last_became_peered":"2023-10-14T12:33:30.826407+0000","last_unstale":"2023-10-14T12:33:35.848363+0000","last_undegraded":"2023-10-14T12:33:35.848363+0000","last_fullsized":"2023-10-14T12:33:35.848363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:48.937270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852489+0000","last_change":"2023-10-14T12:33:31.866686+0000","last_active":"2023-10-14T12:33:35.852489+0000","last_peered":"2023-10-14T12:33:35.852489+0000","last_clean":"2023-10-14T12:33:35.852489+0000","last_became_active":"2023-10-14T12:33:31.866296+0000","last_became_peered":"2023-10-14T12:33:31.866296+0000","last_unstale":"2023-10-14T12:33:35.852489+0000","last_undegraded":"2023-10-14T12:33:35.852489+0000","last_fullsized":"2023-10-14T12:33:35.852489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846622+0000","last_change":"2023-10-14T12:33:35.860504+0000","last_active":"2023-10-14T12:33:36.846622+0000","last_peered":"2023-10-14T12:33:36.846622+0000","last_clean":"2023-10-14T12:33:36.846622+0000","last_became_active":"2023-10-14T12:33:35.860105+0000","last_became_peered":"2023-10-14T12:33:35.860105+0000","last_unstale":"2023-10-14T12:33:36.846622+0000","last_undegraded":"2023-10-14T12:33:36.846622+0000","last_fullsized":"2023-10-14T12:33:36.846622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:29.627124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854796+0000","last_change":"2023-10-14T12:33:30.828734+0000","last_active":"2023-10-14T12:33:35.854796+0000","last_peered":"2023-10-14T12:33:35.854796+0000","last_clean":"2023-10-14T12:33:35.854796+0000","last_became_active":"2023-10-14T12:33:30.827180+0000","last_became_peered":"2023-10-14T12:33:30.827180+0000","last_unstale":"2023-10-14T12:33:35.854796+0000","last_undegraded":"2023-10-14T12:33:35.854796+0000","last_fullsized":"2023-10-14T12:33:35.854796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:17.918071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839536+0000","last_change":"2023-10-14T12:33:31.829359+0000","last_active":"2023-10-14T12:33:35.839536+0000","last_peered":"2023-10-14T12:33:35.839536+0000","last_clean":"2023-10-14T12:33:35.839536+0000","last_became_active":"2023-10-14T12:33:31.828972+0000","last_became_peered":"2023-10-14T12:33:31.828972+0000","last_unstale":"2023-10-14T12:33:35.839536+0000","last_undegraded":"2023-10-14T12:33:35.839536+0000","last_fullsized":"2023-10-14T12:33:35.839536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:35.674331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025766+0000","last_change":"2023-10-14T12:33:35.857105+0000","last_active":"2023-10-14T12:33:38.025766+0000","last_peered":"2023-10-14T12:33:38.025766+0000","last_clean":"2023-10-14T12:33:38.025766+0000","last_became_active":"2023-10-14T12:33:35.856756+0000","last_became_peered":"2023-10-14T12:33:35.856756+0000","last_unstale":"2023-10-14T12:33:38.025766+0000","last_undegraded":"2023-10-14T12:33:38.025766+0000","last_fullsized":"2023-10-14T12:33:38.025766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:41.136443+0000","last_change":"2023-10-14T12:33:30.825111+0000","last_active":"2023-10-14T12:33:41.136443+0000","last_peered":"2023-10-14T12:33:41.136443+0000","last_clean":"2023-10-14T12:33:41.136443+0000","last_became_active":"2023-10-14T12:33:30.824768+0000","last_became_peered":"2023-10-14T12:33:30.824768+0000","last_unstale":"2023-10-14T12:33:41.136443+0000","last_undegraded":"2023-10-14T12:33:41.136443+0000","last_fullsized":"2023-10-14T12:33:41.136443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:09.427953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839014+0000","last_change":"2023-10-14T12:33:31.822451+0000","last_active":"2023-10-14T12:33:35.839014+0000","last_peered":"2023-10-14T12:33:35.839014+0000","last_clean":"2023-10-14T12:33:35.839014+0000","last_became_active":"2023-10-14T12:33:31.822131+0000","last_became_peered":"2023-10-14T12:33:31.822131+0000","last_unstale":"2023-10-14T12:33:35.839014+0000","last_undegraded":"2023-10-14T12:33:35.839014+0000","last_fullsized":"2023-10-14T12:33:35.839014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.319564+0000","last_change":"2023-10-14T12:33:35.864107+0000","last_active":"2023-10-14T12:33:37.319564+0000","last_peered":"2023-10-14T12:33:37.319564+0000","last_clean":"2023-10-14T12:33:37.319564+0000","last_became_active":"2023-10-14T12:33:35.863602+0000","last_became_peered":"2023-10-14T12:33:35.863602+0000","last_unstale":"2023-10-14T12:33:37.319564+0000","last_undegraded":"2023-10-14T12:33:37.319564+0000","last_fullsized":"2023-10-14T12:33:37.319564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:27.584701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851934+0000","last_change":"2023-10-14T12:33:30.830335+0000","last_active":"2023-10-14T12:33:35.851934+0000","last_peered":"2023-10-14T12:33:35.851934+0000","last_clean":"2023-10-14T12:33:35.851934+0000","last_became_active":"2023-10-14T12:33:30.829756+0000","last_became_peered":"2023-10-14T12:33:30.829756+0000","last_unstale":"2023-10-14T12:33:35.851934+0000","last_undegraded":"2023-10-14T12:33:35.851934+0000","last_fullsized":"2023-10-14T12:33:35.851934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:49.417513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852109+0000","last_change":"2023-10-14T12:33:31.822308+0000","last_active":"2023-10-14T12:33:35.852109+0000","last_peered":"2023-10-14T12:33:35.852109+0000","last_clean":"2023-10-14T12:33:35.852109+0000","last_became_active":"2023-10-14T12:33:31.822055+0000","last_became_peered":"2023-10-14T12:33:31.822055+0000","last_unstale":"2023-10-14T12:33:35.852109+0000","last_undegraded":"2023-10-14T12:33:35.852109+0000","last_fullsized":"2023-10-14T12:33:35.852109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:10.433597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027505+0000","last_change":"2023-10-14T12:33:35.869237+0000","last_active":"2023-10-14T12:33:38.027505+0000","last_peered":"2023-10-14T12:33:38.027505+0000","last_clean":"2023-10-14T12:33:38.027505+0000","last_became_active":"2023-10-14T12:33:35.866485+0000","last_became_peered":"2023-10-14T12:33:35.866485+0000","last_unstale":"2023-10-14T12:33:38.027505+0000","last_undegraded":"2023-10-14T12:33:38.027505+0000","last_fullsized":"2023-10-14T12:33:38.027505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:51:59.414054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847188+0000","last_change":"2023-10-14T12:33:30.826101+0000","last_active":"2023-10-14T12:33:35.847188+0000","last_peered":"2023-10-14T12:33:35.847188+0000","last_clean":"2023-10-14T12:33:35.847188+0000","last_became_active":"2023-10-14T12:33:30.825904+0000","last_became_peered":"2023-10-14T12:33:30.825904+0000","last_unstale":"2023-10-14T12:33:35.847188+0000","last_undegraded":"2023-10-14T12:33:35.847188+0000","last_fullsized":"2023-10-14T12:33:35.847188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:34.109444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839117+0000","last_change":"2023-10-14T12:33:31.829811+0000","last_active":"2023-10-14T12:33:35.839117+0000","last_peered":"2023-10-14T12:33:35.839117+0000","last_clean":"2023-10-14T12:33:35.839117+0000","last_became_active":"2023-10-14T12:33:31.829557+0000","last_became_peered":"2023-10-14T12:33:31.829557+0000","last_unstale":"2023-10-14T12:33:35.839117+0000","last_undegraded":"2023-10-14T12:33:35.839117+0000","last_fullsized":"2023-10-14T12:33:35.839117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:21.583926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027964+0000","last_change":"2023-10-14T12:33:35.866238+0000","last_active":"2023-10-14T12:33:38.027964+0000","last_peered":"2023-10-14T12:33:38.027964+0000","last_clean":"2023-10-14T12:33:38.027964+0000","last_became_active":"2023-10-14T12:33:35.865766+0000","last_became_peered":"2023-10-14T12:33:35.865766+0000","last_unstale":"2023-10-14T12:33:38.027964+0000","last_undegraded":"2023-10-14T12:33:38.027964+0000","last_fullsized":"2023-10-14T12:33:38.027964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:29:39.610994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846622+0000","last_change":"2023-10-14T12:33:30.818254+0000","last_active":"2023-10-14T12:33:35.846622+0000","last_peered":"2023-10-14T12:33:35.846622+0000","last_clean":"2023-10-14T12:33:35.846622+0000","last_became_active":"2023-10-14T12:33:30.817968+0000","last_became_peered":"2023-10-14T12:33:30.817968+0000","last_unstale":"2023-10-14T12:33:35.846622+0000","last_undegraded":"2023-10-14T12:33:35.846622+0000","last_fullsized":"2023-10-14T12:33:35.846622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:34.668687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847416+0000","last_change":"2023-10-14T12:33:31.822035+0000","last_active":"2023-10-14T12:33:35.847416+0000","last_peered":"2023-10-14T12:33:35.847416+0000","last_clean":"2023-10-14T12:33:35.847416+0000","last_became_active":"2023-10-14T12:33:31.821751+0000","last_became_peered":"2023-10-14T12:33:31.821751+0000","last_unstale":"2023-10-14T12:33:35.847416+0000","last_undegraded":"2023-10-14T12:33:35.847416+0000","last_fullsized":"2023-10-14T12:33:35.847416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025739+0000","last_change":"2023-10-14T12:33:35.864410+0000","last_active":"2023-10-14T12:33:38.025739+0000","last_peered":"2023-10-14T12:33:38.025739+0000","last_clean":"2023-10-14T12:33:38.025739+0000","last_became_active":"2023-10-14T12:33:35.863490+0000","last_became_peered":"2023-10-14T12:33:35.863490+0000","last_unstale":"2023-10-14T12:33:38.025739+0000","last_undegraded":"2023-10-14T12:33:38.025739+0000","last_fullsized":"2023-10-14T12:33:38.025739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854376+0000","last_change":"2023-10-14T12:33:30.825658+0000","last_active":"2023-10-14T12:33:35.854376+0000","last_peered":"2023-10-14T12:33:35.854376+0000","last_clean":"2023-10-14T12:33:35.854376+0000","last_became_active":"2023-10-14T12:33:30.825377+0000","last_became_peered":"2023-10-14T12:33:30.825377+0000","last_unstale":"2023-10-14T12:33:35.854376+0000","last_undegraded":"2023-10-14T12:33:35.854376+0000","last_fullsized":"2023-10-14T12:33:35.854376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:45.725924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839717+0000","last_change":"2023-10-14T12:33:31.829114+0000","last_active":"2023-10-14T12:33:35.839717+0000","last_peered":"2023-10-14T12:33:35.839717+0000","last_clean":"2023-10-14T12:33:35.839717+0000","last_became_active":"2023-10-14T12:33:31.828836+0000","last_became_peered":"2023-10-14T12:33:31.828836+0000","last_unstale":"2023-10-14T12:33:35.839717+0000","last_undegraded":"2023-10-14T12:33:35.839717+0000","last_fullsized":"2023-10-14T12:33:35.839717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846100+0000","last_change":"2023-10-14T12:33:35.861113+0000","last_active":"2023-10-14T12:33:36.846100+0000","last_peered":"2023-10-14T12:33:36.846100+0000","last_clean":"2023-10-14T12:33:36.846100+0000","last_became_active":"2023-10-14T12:33:35.860576+0000","last_became_peered":"2023-10-14T12:33:35.860576+0000","last_unstale":"2023-10-14T12:33:36.846100+0000","last_undegraded":"2023-10-14T12:33:36.846100+0000","last_fullsized":"2023-10-14T12:33:36.846100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:01.926300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838546+0000","last_change":"2023-10-14T12:33:30.831073+0000","last_active":"2023-10-14T12:33:35.838546+0000","last_peered":"2023-10-14T12:33:35.838546+0000","last_clean":"2023-10-14T12:33:35.838546+0000","last_became_active":"2023-10-14T12:33:30.830742+0000","last_became_peered":"2023-10-14T12:33:30.830742+0000","last_unstale":"2023-10-14T12:33:35.838546+0000","last_undegraded":"2023-10-14T12:33:35.838546+0000","last_fullsized":"2023-10-14T12:33:35.838546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:45.725924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839426+0000","last_change":"2023-10-14T12:33:31.827984+0000","last_active":"2023-10-14T12:33:35.839426+0000","last_peered":"2023-10-14T12:33:35.839426+0000","last_clean":"2023-10-14T12:33:35.839426+0000","last_became_active":"2023-10-14T12:33:31.827707+0000","last_became_peered":"2023-10-14T12:33:31.827707+0000","last_unstale":"2023-10-14T12:33:35.839426+0000","last_undegraded":"2023-10-14T12:33:35.839426+0000","last_fullsized":"2023-10-14T12:33:35.839426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:15.636750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025631+0000","last_change":"2023-10-14T12:33:35.859968+0000","last_active":"2023-10-14T12:33:38.025631+0000","last_peered":"2023-10-14T12:33:38.025631+0000","last_clean":"2023-10-14T12:33:38.025631+0000","last_became_active":"2023-10-14T12:33:35.859542+0000","last_became_peered":"2023-10-14T12:33:35.859542+0000","last_unstale":"2023-10-14T12:33:38.025631+0000","last_undegraded":"2023-10-14T12:33:38.025631+0000","last_fullsized":"2023-10-14T12:33:38.025631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:28.879987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854731+0000","last_change":"2023-10-14T12:33:30.829611+0000","last_active":"2023-10-14T12:33:35.854731+0000","last_peered":"2023-10-14T12:33:35.854731+0000","last_clean":"2023-10-14T12:33:35.854731+0000","last_became_active":"2023-10-14T12:33:30.829317+0000","last_became_peered":"2023-10-14T12:33:30.829317+0000","last_unstale":"2023-10-14T12:33:35.854731+0000","last_undegraded":"2023-10-14T12:33:35.854731+0000","last_fullsized":"2023-10-14T12:33:35.854731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847512+0000","last_change":"2023-10-14T12:33:31.867826+0000","last_active":"2023-10-14T12:33:35.847512+0000","last_peered":"2023-10-14T12:33:35.847512+0000","last_clean":"2023-10-14T12:33:35.847512+0000","last_became_active":"2023-10-14T12:33:31.867531+0000","last_became_peered":"2023-10-14T12:33:31.867531+0000","last_unstale":"2023-10-14T12:33:35.847512+0000","last_undegraded":"2023-10-14T12:33:35.847512+0000","last_fullsized":"2023-10-14T12:33:35.847512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:19.041798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026385+0000","last_change":"2023-10-14T12:33:35.860655+0000","last_active":"2023-10-14T12:33:38.026385+0000","last_peered":"2023-10-14T12:33:38.026385+0000","last_clean":"2023-10-14T12:33:38.026385+0000","last_became_active":"2023-10-14T12:33:35.859946+0000","last_became_peered":"2023-10-14T12:33:35.859946+0000","last_unstale":"2023-10-14T12:33:38.026385+0000","last_undegraded":"2023-10-14T12:33:38.026385+0000","last_fullsized":"2023-10-14T12:33:38.026385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:17.701932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847196+0000","last_change":"2023-10-14T12:33:30.828530+0000","last_active":"2023-10-14T12:33:35.847196+0000","last_peered":"2023-10-14T12:33:35.847196+0000","last_clean":"2023-10-14T12:33:35.847196+0000","last_became_active":"2023-10-14T12:33:30.828070+0000","last_became_peered":"2023-10-14T12:33:30.828070+0000","last_unstale":"2023-10-14T12:33:35.847196+0000","last_undegraded":"2023-10-14T12:33:35.847196+0000","last_fullsized":"2023-10-14T12:33:35.847196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:29.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.841114+0000","last_change":"2023-10-14T12:33:31.828949+0000","last_active":"2023-10-14T12:33:35.841114+0000","last_peered":"2023-10-14T12:33:35.841114+0000","last_clean":"2023-10-14T12:33:35.841114+0000","last_became_active":"2023-10-14T12:33:31.828658+0000","last_became_peered":"2023-10-14T12:33:31.828658+0000","last_unstale":"2023-10-14T12:33:35.841114+0000","last_undegraded":"2023-10-14T12:33:35.841114+0000","last_fullsized":"2023-10-14T12:33:35.841114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:24.745702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026150+0000","last_change":"2023-10-14T12:33:35.860287+0000","last_active":"2023-10-14T12:33:38.026150+0000","last_peered":"2023-10-14T12:33:38.026150+0000","last_clean":"2023-10-14T12:33:38.026150+0000","last_became_active":"2023-10-14T12:33:35.859467+0000","last_became_peered":"2023-10-14T12:33:35.859467+0000","last_unstale":"2023-10-14T12:33:38.026150+0000","last_undegraded":"2023-10-14T12:33:38.026150+0000","last_fullsized":"2023-10-14T12:33:38.026150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854284+0000","last_change":"2023-10-14T12:33:31.820322+0000","last_active":"2023-10-14T12:33:35.854284+0000","last_peered":"2023-10-14T12:33:35.854284+0000","last_clean":"2023-10-14T12:33:35.854284+0000","last_became_active":"2023-10-14T12:33:31.820087+0000","last_became_peered":"2023-10-14T12:33:31.820087+0000","last_unstale":"2023-10-14T12:33:35.854284+0000","last_undegraded":"2023-10-14T12:33:35.854284+0000","last_fullsized":"2023-10-14T12:33:35.854284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:45.477157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854363+0000","last_change":"2023-10-14T12:33:30.821383+0000","last_active":"2023-10-14T12:33:35.854363+0000","last_peered":"2023-10-14T12:33:35.854363+0000","last_clean":"2023-10-14T12:33:35.854363+0000","last_became_active":"2023-10-14T12:33:30.821096+0000","last_became_peered":"2023-10-14T12:33:30.821096+0000","last_unstale":"2023-10-14T12:33:35.854363+0000","last_undegraded":"2023-10-14T12:33:35.854363+0000","last_fullsized":"2023-10-14T12:33:35.854363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:23.650329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.840950+0000","last_change":"2023-10-14T12:33:35.858076+0000","last_active":"2023-10-14T12:33:36.840950+0000","last_peered":"2023-10-14T12:33:36.840950+0000","last_clean":"2023-10-14T12:33:36.840950+0000","last_became_active":"2023-10-14T12:33:35.857526+0000","last_became_peered":"2023-10-14T12:33:35.857526+0000","last_unstale":"2023-10-14T12:33:36.840950+0000","last_undegraded":"2023-10-14T12:33:36.840950+0000","last_fullsized":"2023-10-14T12:33:36.840950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843234+0000","last_change":"2023-10-14T12:33:31.868186+0000","last_active":"2023-10-14T12:33:35.843234+0000","last_peered":"2023-10-14T12:33:35.843234+0000","last_clean":"2023-10-14T12:33:35.843234+0000","last_became_active":"2023-10-14T12:33:31.867909+0000","last_became_peered":"2023-10-14T12:33:31.867909+0000","last_unstale":"2023-10-14T12:33:35.843234+0000","last_undegraded":"2023-10-14T12:33:35.843234+0000","last_fullsized":"2023-10-14T12:33:35.843234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847138+0000","last_change":"2023-10-14T12:33:30.828058+0000","last_active":"2023-10-14T12:33:35.847138+0000","last_peered":"2023-10-14T12:33:35.847138+0000","last_clean":"2023-10-14T12:33:35.847138+0000","last_became_active":"2023-10-14T12:33:30.827816+0000","last_became_peered":"2023-10-14T12:33:30.827816+0000","last_unstale":"2023-10-14T12:33:35.847138+0000","last_undegraded":"2023-10-14T12:33:35.847138+0000","last_fullsized":"2023-10-14T12:33:35.847138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:23.650329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839385+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:33:35.839385+0000","last_peered":"2023-10-14T12:33:35.839385+0000","last_clean":"2023-10-14T12:33:35.839385+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:33:35.839385+0000","last_undegraded":"2023-10-14T12:33:35.839385+0000","last_fullsized":"2023-10-14T12:33:35.839385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025827+0000","last_change":"2023-10-14T12:33:35.864687+0000","last_active":"2023-10-14T12:33:38.025827+0000","last_peered":"2023-10-14T12:33:38.025827+0000","last_clean":"2023-10-14T12:33:38.025827+0000","last_became_active":"2023-10-14T12:33:35.864048+0000","last_became_peered":"2023-10-14T12:33:35.864048+0000","last_unstale":"2023-10-14T12:33:38.025827+0000","last_undegraded":"2023-10-14T12:33:38.025827+0000","last_fullsized":"2023-10-14T12:33:38.025827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:17.701932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.849606+0000","last_change":"2023-10-14T12:33:31.833047+0000","last_active":"2023-10-14T12:33:35.849606+0000","last_peered":"2023-10-14T12:33:35.849606+0000","last_clean":"2023-10-14T12:33:35.849606+0000","last_became_active":"2023-10-14T12:33:31.832727+0000","last_became_peered":"2023-10-14T12:33:31.832727+0000","last_unstale":"2023-10-14T12:33:35.849606+0000","last_undegraded":"2023-10-14T12:33:35.849606+0000","last_fullsized":"2023-10-14T12:33:35.849606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839488+0000","last_change":"2023-10-14T12:33:30.825584+0000","last_active":"2023-10-14T12:33:35.839488+0000","last_peered":"2023-10-14T12:33:35.839488+0000","last_clean":"2023-10-14T12:33:35.839488+0000","last_became_active":"2023-10-14T12:33:30.825306+0000","last_became_peered":"2023-10-14T12:33:30.825306+0000","last_unstale":"2023-10-14T12:33:35.839488+0000","last_undegraded":"2023-10-14T12:33:35.839488+0000","last_fullsized":"2023-10-14T12:33:35.839488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025810+0000","last_change":"2023-10-14T12:33:35.869042+0000","last_active":"2023-10-14T12:33:38.025810+0000","last_peered":"2023-10-14T12:33:38.025810+0000","last_clean":"2023-10-14T12:33:38.025810+0000","last_became_active":"2023-10-14T12:33:35.866286+0000","last_became_peered":"2023-10-14T12:33:35.866286+0000","last_unstale":"2023-10-14T12:33:38.025810+0000","last_undegraded":"2023-10-14T12:33:38.025810+0000","last_fullsized":"2023-10-14T12:33:38.025810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838691+0000","last_change":"2023-10-14T12:33:30.830475+0000","last_active":"2023-10-14T12:33:35.838691+0000","last_peered":"2023-10-14T12:33:35.838691+0000","last_clean":"2023-10-14T12:33:35.838691+0000","last_became_active":"2023-10-14T12:33:30.830146+0000","last_became_peered":"2023-10-14T12:33:30.830146+0000","last_unstale":"2023-10-14T12:33:35.838691+0000","last_undegraded":"2023-10-14T12:33:35.838691+0000","last_fullsized":"2023-10-14T12:33:35.838691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:41.110080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854835+0000","last_change":"2023-10-14T12:33:31.820598+0000","last_active":"2023-10-14T12:33:35.854835+0000","last_peered":"2023-10-14T12:33:35.854835+0000","last_clean":"2023-10-14T12:33:35.854835+0000","last_became_active":"2023-10-14T12:33:31.820407+0000","last_became_peered":"2023-10-14T12:33:31.820407+0000","last_unstale":"2023-10-14T12:33:35.854835+0000","last_undegraded":"2023-10-14T12:33:35.854835+0000","last_fullsized":"2023-10-14T12:33:35.854835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027136+0000","last_change":"2023-10-14T12:33:35.862298+0000","last_active":"2023-10-14T12:33:38.027136+0000","last_peered":"2023-10-14T12:33:38.027136+0000","last_clean":"2023-10-14T12:33:38.027136+0000","last_became_active":"2023-10-14T12:33:35.861343+0000","last_became_peered":"2023-10-14T12:33:35.861343+0000","last_unstale":"2023-10-14T12:33:38.027136+0000","last_undegraded":"2023-10-14T12:33:38.027136+0000","last_fullsized":"2023-10-14T12:33:38.027136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:08:15.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854868+0000","last_change":"2023-10-14T12:33:30.822607+0000","last_active":"2023-10-14T12:33:35.854868+0000","last_peered":"2023-10-14T12:33:35.854868+0000","last_clean":"2023-10-14T12:33:35.854868+0000","last_became_active":"2023-10-14T12:33:30.822335+0000","last_became_peered":"2023-10-14T12:33:30.822335+0000","last_unstale":"2023-10-14T12:33:35.854868+0000","last_undegraded":"2023-10-14T12:33:35.854868+0000","last_fullsized":"2023-10-14T12:33:35.854868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.842317+0000","last_change":"2023-10-14T12:33:31.819508+0000","last_active":"2023-10-14T12:33:35.842317+0000","last_peered":"2023-10-14T12:33:35.842317+0000","last_clean":"2023-10-14T12:33:35.842317+0000","last_became_active":"2023-10-14T12:33:31.819245+0000","last_became_peered":"2023-10-14T12:33:31.819245+0000","last_unstale":"2023-10-14T12:33:35.842317+0000","last_undegraded":"2023-10-14T12:33:35.842317+0000","last_fullsized":"2023-10-14T12:33:35.842317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846081+0000","last_change":"2023-10-14T12:33:35.852496+0000","last_active":"2023-10-14T12:33:36.846081+0000","last_peered":"2023-10-14T12:33:36.846081+0000","last_clean":"2023-10-14T12:33:36.846081+0000","last_became_active":"2023-10-14T12:33:35.852067+0000","last_became_peered":"2023-10-14T12:33:35.852067+0000","last_unstale":"2023-10-14T12:33:36.846081+0000","last_undegraded":"2023-10-14T12:33:36.846081+0000","last_fullsized":"2023-10-14T12:33:36.846081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:22.810399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846693+0000","last_change":"2023-10-14T12:33:30.823983+0000","last_active":"2023-10-14T12:33:35.846693+0000","last_peered":"2023-10-14T12:33:35.846693+0000","last_clean":"2023-10-14T12:33:35.846693+0000","last_became_active":"2023-10-14T12:33:30.823708+0000","last_became_peered":"2023-10-14T12:33:30.823708+0000","last_unstale":"2023-10-14T12:33:35.846693+0000","last_undegraded":"2023-10-14T12:33:35.846693+0000","last_fullsized":"2023-10-14T12:33:35.846693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:21.825878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852271+0000","last_change":"2023-10-14T12:33:31.818663+0000","last_active":"2023-10-14T12:33:35.852271+0000","last_peered":"2023-10-14T12:33:35.852271+0000","last_clean":"2023-10-14T12:33:35.852271+0000","last_became_active":"2023-10-14T12:33:31.818315+0000","last_became_peered":"2023-10-14T12:33:31.818315+0000","last_unstale":"2023-10-14T12:33:35.852271+0000","last_undegraded":"2023-10-14T12:33:35.852271+0000","last_fullsized":"2023-10-14T12:33:35.852271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846628+0000","last_change":"2023-10-14T12:33:35.861468+0000","last_active":"2023-10-14T12:33:36.846628+0000","last_peered":"2023-10-14T12:33:36.846628+0000","last_clean":"2023-10-14T12:33:36.846628+0000","last_became_active":"2023-10-14T12:33:35.861024+0000","last_became_peered":"2023-10-14T12:33:35.861024+0000","last_unstale":"2023-10-14T12:33:36.846628+0000","last_undegraded":"2023-10-14T12:33:36.846628+0000","last_fullsized":"2023-10-14T12:33:36.846628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:32.157229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838156+0000","last_change":"2023-10-14T12:33:30.828550+0000","last_active":"2023-10-14T12:33:35.838156+0000","last_peered":"2023-10-14T12:33:35.838156+0000","last_clean":"2023-10-14T12:33:35.838156+0000","last_became_active":"2023-10-14T12:33:30.828270+0000","last_became_peered":"2023-10-14T12:33:30.828270+0000","last_unstale":"2023-10-14T12:33:35.838156+0000","last_undegraded":"2023-10-14T12:33:35.838156+0000","last_fullsized":"2023-10-14T12:33:35.838156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:49.417513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.840140+0000","last_change":"2023-10-14T12:33:31.827714+0000","last_active":"2023-10-14T12:33:35.840140+0000","last_peered":"2023-10-14T12:33:35.840140+0000","last_clean":"2023-10-14T12:33:35.840140+0000","last_became_active":"2023-10-14T12:33:31.827425+0000","last_became_peered":"2023-10-14T12:33:31.827425+0000","last_unstale":"2023-10-14T12:33:35.840140+0000","last_undegraded":"2023-10-14T12:33:35.840140+0000","last_fullsized":"2023-10-14T12:33:35.840140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:22.831522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026298+0000","last_change":"2023-10-14T12:33:35.862529+0000","last_active":"2023-10-14T12:33:38.026298+0000","last_peered":"2023-10-14T12:33:38.026298+0000","last_clean":"2023-10-14T12:33:38.026298+0000","last_became_active":"2023-10-14T12:33:35.862060+0000","last_became_peered":"2023-10-14T12:33:35.862060+0000","last_unstale":"2023-10-14T12:33:38.026298+0000","last_undegraded":"2023-10-14T12:33:38.026298+0000","last_fullsized":"2023-10-14T12:33:38.026298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854468+0000","last_change":"2023-10-14T12:33:30.820328+0000","last_active":"2023-10-14T12:33:35.854468+0000","last_peered":"2023-10-14T12:33:35.854468+0000","last_clean":"2023-10-14T12:33:35.854468+0000","last_became_active":"2023-10-14T12:33:30.820025+0000","last_became_peered":"2023-10-14T12:33:30.820025+0000","last_unstale":"2023-10-14T12:33:35.854468+0000","last_undegraded":"2023-10-14T12:33:35.854468+0000","last_fullsized":"2023-10-14T12:33:35.854468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:41.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844808+0000","last_change":"2023-10-14T12:33:31.818199+0000","last_active":"2023-10-14T12:33:35.844808+0000","last_peered":"2023-10-14T12:33:35.844808+0000","last_clean":"2023-10-14T12:33:35.844808+0000","last_became_active":"2023-10-14T12:33:31.817925+0000","last_became_peered":"2023-10-14T12:33:31.817925+0000","last_unstale":"2023-10-14T12:33:35.844808+0000","last_undegraded":"2023-10-14T12:33:35.844808+0000","last_fullsized":"2023-10-14T12:33:35.844808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846730+0000","last_change":"2023-10-14T12:33:35.861719+0000","last_active":"2023-10-14T12:33:36.846730+0000","last_peered":"2023-10-14T12:33:36.846730+0000","last_clean":"2023-10-14T12:33:36.846730+0000","last_became_active":"2023-10-14T12:33:35.861312+0000","last_became_peered":"2023-10-14T12:33:35.861312+0000","last_unstale":"2023-10-14T12:33:36.846730+0000","last_undegraded":"2023-10-14T12:33:36.846730+0000","last_fullsized":"2023-10-14T12:33:36.846730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:28.879987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.856801+0000","last_change":"2023-10-14T12:33:30.825142+0000","last_active":"2023-10-14T12:33:35.856801+0000","last_peered":"2023-10-14T12:33:35.856801+0000","last_clean":"2023-10-14T12:33:35.856801+0000","last_became_active":"2023-10-14T12:33:30.824853+0000","last_became_peered":"2023-10-14T12:33:30.824853+0000","last_unstale":"2023-10-14T12:33:35.856801+0000","last_undegraded":"2023-10-14T12:33:35.856801+0000","last_fullsized":"2023-10-14T12:33:35.856801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844382+0000","last_change":"2023-10-14T12:33:31.821965+0000","last_active":"2023-10-14T12:33:35.844382+0000","last_peered":"2023-10-14T12:33:35.844382+0000","last_clean":"2023-10-14T12:33:35.844382+0000","last_became_active":"2023-10-14T12:33:31.821689+0000","last_became_peered":"2023-10-14T12:33:31.821689+0000","last_unstale":"2023-10-14T12:33:35.844382+0000","last_undegraded":"2023-10-14T12:33:35.844382+0000","last_fullsized":"2023-10-14T12:33:35.844382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846686+0000","last_change":"2023-10-14T12:33:35.864185+0000","last_active":"2023-10-14T12:33:36.846686+0000","last_peered":"2023-10-14T12:33:36.846686+0000","last_clean":"2023-10-14T12:33:36.846686+0000","last_became_active":"2023-10-14T12:33:35.863769+0000","last_became_peered":"2023-10-14T12:33:35.863769+0000","last_unstale":"2023-10-14T12:33:36.846686+0000","last_undegraded":"2023-10-14T12:33:36.846686+0000","last_fullsized":"2023-10-14T12:33:36.846686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:32.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839226+0000","last_change":"2023-10-14T12:33:30.823464+0000","last_active":"2023-10-14T12:33:35.839226+0000","last_peered":"2023-10-14T12:33:35.839226+0000","last_clean":"2023-10-14T12:33:35.839226+0000","last_became_active":"2023-10-14T12:33:30.823177+0000","last_became_peered":"2023-10-14T12:33:30.823177+0000","last_unstale":"2023-10-14T12:33:35.839226+0000","last_undegraded":"2023-10-14T12:33:35.839226+0000","last_fullsized":"2023-10-14T12:33:35.839226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:29.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846843+0000","last_change":"2023-10-14T12:33:31.828060+0000","last_active":"2023-10-14T12:33:35.846843+0000","last_peered":"2023-10-14T12:33:35.846843+0000","last_clean":"2023-10-14T12:33:35.846843+0000","last_became_active":"2023-10-14T12:33:31.827687+0000","last_became_peered":"2023-10-14T12:33:31.827687+0000","last_unstale":"2023-10-14T12:33:35.846843+0000","last_undegraded":"2023-10-14T12:33:35.846843+0000","last_fullsized":"2023-10-14T12:33:35.846843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.840897+0000","last_change":"2023-10-14T12:33:35.865932+0000","last_active":"2023-10-14T12:33:36.840897+0000","last_peered":"2023-10-14T12:33:36.840897+0000","last_clean":"2023-10-14T12:33:36.840897+0000","last_became_active":"2023-10-14T12:33:35.865529+0000","last_became_peered":"2023-10-14T12:33:35.865529+0000","last_unstale":"2023-10-14T12:33:36.840897+0000","last_undegraded":"2023-10-14T12:33:36.840897+0000","last_fullsized":"2023-10-14T12:33:36.840897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.856213+0000","last_change":"2023-10-14T12:33:30.828503+0000","last_active":"2023-10-14T12:33:35.856213+0000","last_peered":"2023-10-14T12:33:35.856213+0000","last_clean":"2023-10-14T12:33:35.856213+0000","last_became_active":"2023-10-14T12:33:30.828211+0000","last_became_peered":"2023-10-14T12:33:30.828211+0000","last_unstale":"2023-10-14T12:33:35.856213+0000","last_undegraded":"2023-10-14T12:33:35.856213+0000","last_fullsized":"2023-10-14T12:33:35.856213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:21.825878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838912+0000","last_change":"2023-10-14T12:33:31.866962+0000","last_active":"2023-10-14T12:33:35.838912+0000","last_peered":"2023-10-14T12:33:35.838912+0000","last_clean":"2023-10-14T12:33:35.838912+0000","last_became_active":"2023-10-14T12:33:31.866696+0000","last_became_peered":"2023-10-14T12:33:31.866696+0000","last_unstale":"2023-10-14T12:33:35.838912+0000","last_undegraded":"2023-10-14T12:33:35.838912+0000","last_fullsized":"2023-10-14T12:33:35.838912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:10.562723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025680+0000","last_change":"2023-10-14T12:33:35.866856+0000","last_active":"2023-10-14T12:33:38.025680+0000","last_peered":"2023-10-14T12:33:38.025680+0000","last_clean":"2023-10-14T12:33:38.025680+0000","last_became_active":"2023-10-14T12:33:35.865775+0000","last_became_peered":"2023-10-14T12:33:35.865775+0000","last_unstale":"2023-10-14T12:33:38.025680+0000","last_undegraded":"2023-10-14T12:33:38.025680+0000","last_fullsized":"2023-10-14T12:33:38.025680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854778+0000","last_change":"2023-10-14T12:33:30.824177+0000","last_active":"2023-10-14T12:33:35.854778+0000","last_peered":"2023-10-14T12:33:35.854778+0000","last_clean":"2023-10-14T12:33:35.854778+0000","last_became_active":"2023-10-14T12:33:30.823858+0000","last_became_peered":"2023-10-14T12:33:30.823858+0000","last_unstale":"2023-10-14T12:33:35.854778+0000","last_undegraded":"2023-10-14T12:33:35.854778+0000","last_fullsized":"2023-10-14T12:33:35.854778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:09.427953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847722+0000","last_change":"2023-10-14T12:33:31.867990+0000","last_active":"2023-10-14T12:33:35.847722+0000","last_peered":"2023-10-14T12:33:35.847722+0000","last_clean":"2023-10-14T12:33:35.847722+0000","last_became_active":"2023-10-14T12:33:31.867711+0000","last_became_peered":"2023-10-14T12:33:31.867711+0000","last_unstale":"2023-10-14T12:33:35.847722+0000","last_undegraded":"2023-10-14T12:33:35.847722+0000","last_fullsized":"2023-10-14T12:33:35.847722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.319023+0000","last_change":"2023-10-14T12:33:35.852643+0000","last_active":"2023-10-14T12:33:37.319023+0000","last_peered":"2023-10-14T12:33:37.319023+0000","last_clean":"2023-10-14T12:33:37.319023+0000","last_became_active":"2023-10-14T12:33:35.852237+0000","last_became_peered":"2023-10-14T12:33:35.852237+0000","last_unstale":"2023-10-14T12:33:37.319023+0000","last_undegraded":"2023-10-14T12:33:37.319023+0000","last_fullsized":"2023-10-14T12:33:37.319023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:56.042282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.855802+0000","last_change":"2023-10-14T12:33:30.819872+0000","last_active":"2023-10-14T12:33:35.855802+0000","last_peered":"2023-10-14T12:33:35.855802+0000","last_clean":"2023-10-14T12:33:35.855802+0000","last_became_active":"2023-10-14T12:33:30.819553+0000","last_became_peered":"2023-10-14T12:33:30.819553+0000","last_unstale":"2023-10-14T12:33:35.855802+0000","last_undegraded":"2023-10-14T12:33:35.855802+0000","last_fullsized":"2023-10-14T12:33:35.855802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:23.740058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838889+0000","last_change":"2023-10-14T12:33:31.833122+0000","last_active":"2023-10-14T12:33:35.838889+0000","last_peered":"2023-10-14T12:33:35.838889+0000","last_clean":"2023-10-14T12:33:35.838889+0000","last_became_active":"2023-10-14T12:33:31.832825+0000","last_became_peered":"2023-10-14T12:33:31.832825+0000","last_unstale":"2023-10-14T12:33:35.838889+0000","last_undegraded":"2023-10-14T12:33:35.838889+0000","last_fullsized":"2023-10-14T12:33:35.838889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:13.669993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847506+0000","last_change":"2023-10-14T12:33:31.822399+0000","last_active":"2023-10-14T12:33:35.847506+0000","last_peered":"2023-10-14T12:33:35.847506+0000","last_clean":"2023-10-14T12:33:35.847506+0000","last_became_active":"2023-10-14T12:33:31.822073+0000","last_became_peered":"2023-10-14T12:33:31.822073+0000","last_unstale":"2023-10-14T12:33:35.847506+0000","last_undegraded":"2023-10-14T12:33:35.847506+0000","last_fullsized":"2023-10-14T12:33:35.847506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854508+0000","last_change":"2023-10-14T12:33:31.859894+0000","last_active":"2023-10-14T12:33:35.854508+0000","last_peered":"2023-10-14T12:33:35.854508+0000","last_clean":"2023-10-14T12:33:35.854508+0000","last_became_active":"2023-10-14T12:33:31.859679+0000","last_became_peered":"2023-10-14T12:33:31.859679+0000","last_unstale":"2023-10-14T12:33:35.854508+0000","last_undegraded":"2023-10-14T12:33:35.854508+0000","last_fullsized":"2023-10-14T12:33:35.854508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:34.169023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847296+0000","last_change":"2023-10-14T12:33:31.867239+0000","last_active":"2023-10-14T12:33:35.847296+0000","last_peered":"2023-10-14T12:33:35.847296+0000","last_clean":"2023-10-14T12:33:35.847296+0000","last_became_active":"2023-10-14T12:33:31.866961+0000","last_became_peered":"2023-10-14T12:33:31.866961+0000","last_unstale":"2023-10-14T12:33:35.847296+0000","last_undegraded":"2023-10-14T12:33:35.847296+0000","last_fullsized":"2023-10-14T12:33:35.847296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851705+0000","last_change":"2023-10-14T12:33:31.822450+0000","last_active":"2023-10-14T12:33:35.851705+0000","last_peered":"2023-10-14T12:33:35.851705+0000","last_clean":"2023-10-14T12:33:35.851705+0000","last_became_active":"2023-10-14T12:33:31.822248+0000","last_became_peered":"2023-10-14T12:33:31.822248+0000","last_unstale":"2023-10-14T12:33:35.851705+0000","last_undegraded":"2023-10-14T12:33:35.851705+0000","last_fullsized":"2023-10-14T12:33:35.851705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844108+0000","last_change":"2023-10-14T12:33:31.829535+0000","last_active":"2023-10-14T12:33:35.844108+0000","last_peered":"2023-10-14T12:33:35.844108+0000","last_clean":"2023-10-14T12:33:35.844108+0000","last_became_active":"2023-10-14T12:33:31.829266+0000","last_became_peered":"2023-10-14T12:33:31.829266+0000","last_unstale":"2023-10-14T12:33:35.844108+0000","last_undegraded":"2023-10-14T12:33:35.844108+0000","last_fullsized":"2023-10-14T12:33:35.844108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854698+0000","last_change":"2023-10-14T12:33:31.817303+0000","last_active":"2023-10-14T12:33:35.854698+0000","last_peered":"2023-10-14T12:33:35.854698+0000","last_clean":"2023-10-14T12:33:35.854698+0000","last_became_active":"2023-10-14T12:33:31.817008+0000","last_became_peered":"2023-10-14T12:33:31.817008+0000","last_unstale":"2023-10-14T12:33:35.854698+0000","last_undegraded":"2023-10-14T12:33:35.854698+0000","last_fullsized":"2023-10-14T12:33:35.854698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846113+0000","last_change":"2023-10-14T12:33:31.821532+0000","last_active":"2023-10-14T12:33:35.846113+0000","last_peered":"2023-10-14T12:33:35.846113+0000","last_clean":"2023-10-14T12:33:35.846113+0000","last_became_active":"2023-10-14T12:33:31.821205+0000","last_became_peered":"2023-10-14T12:33:31.821205+0000","last_unstale":"2023-10-14T12:33:35.846113+0000","last_undegraded":"2023-10-14T12:33:35.846113+0000","last_fullsized":"2023-10-14T12:33:35.846113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.842791+0000","last_change":"2023-10-14T12:33:31.832580+0000","last_active":"2023-10-14T12:33:35.842791+0000","last_peered":"2023-10-14T12:33:35.842791+0000","last_clean":"2023-10-14T12:33:35.842791+0000","last_became_active":"2023-10-14T12:33:31.832277+0000","last_became_peered":"2023-10-14T12:33:31.832277+0000","last_unstale":"2023-10-14T12:33:35.842791+0000","last_undegraded":"2023-10-14T12:33:35.842791+0000","last_fullsized":"2023-10-14T12:33:35.842791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848235+0000","last_change":"2023-10-14T12:33:31.865900+0000","last_active":"2023-10-14T12:33:35.848235+0000","last_peered":"2023-10-14T12:33:35.848235+0000","last_clean":"2023-10-14T12:33:35.848235+0000","last_became_active":"2023-10-14T12:33:31.865207+0000","last_became_peered":"2023-10-14T12:33:31.865207+0000","last_unstale":"2023-10-14T12:33:35.848235+0000","last_undegraded":"2023-10-14T12:33:35.848235+0000","last_fullsized":"2023-10-14T12:33:35.848235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847269+0000","last_change":"2023-10-14T12:33:31.832616+0000","last_active":"2023-10-14T12:33:35.847269+0000","last_peered":"2023-10-14T12:33:35.847269+0000","last_clean":"2023-10-14T12:33:35.847269+0000","last_became_active":"2023-10-14T12:33:31.832363+0000","last_became_peered":"2023-10-14T12:33:31.832363+0000","last_unstale":"2023-10-14T12:33:35.847269+0000","last_undegraded":"2023-10-14T12:33:35.847269+0000","last_fullsized":"2023-10-14T12:33:35.847269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847336+0000","last_change":"2023-10-14T12:33:31.866907+0000","last_active":"2023-10-14T12:33:35.847336+0000","last_peered":"2023-10-14T12:33:35.847336+0000","last_clean":"2023-10-14T12:33:35.847336+0000","last_became_active":"2023-10-14T12:33:31.866600+0000","last_became_peered":"2023-10-14T12:33:31.866600+0000","last_unstale":"2023-10-14T12:33:35.847336+0000","last_undegraded":"2023-10-14T12:33:35.847336+0000","last_fullsized":"2023-10-14T12:33:35.847336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851789+0000","last_change":"2023-10-14T12:33:31.822750+0000","last_active":"2023-10-14T12:33:35.851789+0000","last_peered":"2023-10-14T12:33:35.851789+0000","last_clean":"2023-10-14T12:33:35.851789+0000","last_became_active":"2023-10-14T12:33:31.822413+0000","last_became_peered":"2023-10-14T12:33:31.822413+0000","last_unstale":"2023-10-14T12:33:35.851789+0000","last_undegraded":"2023-10-14T12:33:35.851789+0000","last_fullsized":"2023-10-14T12:33:35.851789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:18.923716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847017+0000","last_change":"2023-10-14T12:33:31.831194+0000","last_active":"2023-10-14T12:33:35.847017+0000","last_peered":"2023-10-14T12:33:35.847017+0000","last_clean":"2023-10-14T12:33:35.847017+0000","last_became_active":"2023-10-14T12:33:31.830888+0000","last_became_peered":"2023-10-14T12:33:31.830888+0000","last_unstale":"2023-10-14T12:33:35.847017+0000","last_undegraded":"2023-10-14T12:33:35.847017+0000","last_fullsized":"2023-10-14T12:33:35.847017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:33:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T12:33:49.995 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T12:33:49.995 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T12:33:49.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T12:33:49.996 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T12:33:50.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.145+0000 7fee20923700 1 Processor -- start 2023-10-14T12:33:50.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.145+0000 7fee20923700 1 -- start start 2023-10-14T12:33:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee20923700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee1c152470 0x7fee1c0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee20923700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee1c0cb8d0 0x7fee1c0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee20923700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0b3240 0x7fee1c0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee20923700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c0b36d0 con 0x7fee1c0cb8d0 2023-10-14T12:33:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee20923700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c071200 con 0x7fee1c152470 2023-10-14T12:33:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee20923700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c070d70 con 0x7fee1c0b3240 2023-10-14T12:33:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee19d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee1c0cb8d0 0x7fee1c0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee19d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fee1c0cb8d0 0x7fee1c0b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46684/0 (socket says 172.21.15.72:46684) 2023-10-14T12:33:50.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee19d9b700 1 -- 172.21.15.72:0/576122462 learned_addr learned my addr 172.21.15.72:0/576122462 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:50.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee1a59c700 1 --2- 172.21.15.72:0/576122462 >> v2:172.21.15.123:3300/0 conn(0x7fee1c152470 0x7fee1c0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee19d9b700 1 -- 172.21.15.72:0/576122462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0b3240 msgr2=0x7fee1c0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:50.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee1ad9d700 1 --2- 172.21.15.72:0/576122462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0b3240 0x7fee1c0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee19d9b700 1 --2- 172.21.15.72:0/576122462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0b3240 0x7fee1c0b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee19d9b700 1 -- 172.21.15.72:0/576122462 >> v2:172.21.15.123:3300/0 conn(0x7fee1c152470 msgr2=0x7fee1c0cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:50.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee19d9b700 1 --2- 172.21.15.72:0/576122462 >> v2:172.21.15.123:3300/0 conn(0x7fee1c152470 0x7fee1c0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.146+0000 7fee19d9b700 1 -- 172.21.15.72:0/576122462 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c0cbd80 con 0x7fee1c0cb8d0 2023-10-14T12:33:50.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee19d9b700 1 --2- 172.21.15.72:0/576122462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c0cb8d0 0x7fee1c0b2d00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee1c071460 tx=0x7fee0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a01145f51c159b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:50.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee1959a700 1 -- 172.21.15.72:0/576122462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00b870 con 0x7fee1c0cb8d0 2023-10-14T12:33:50.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee1959a700 1 -- 172.21.15.72:0/576122462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c00b9d0 con 0x7fee1c0cb8d0 2023-10-14T12:33:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee1959a700 1 -- 172.21.15.72:0/576122462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00bd60 con 0x7fee1c0cb8d0 2023-10-14T12:33:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee20923700 1 -- 172.21.15.72:0/576122462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c0cb8d0 msgr2=0x7fee1c0b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee20923700 1 --2- 172.21.15.72:0/576122462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c0cb8d0 0x7fee1c0b2d00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fee1c071460 tx=0x7fee0c009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee20923700 1 -- 172.21.15.72:0/576122462 shutdown_connections 2023-10-14T12:33:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee20923700 1 --2- 172.21.15.72:0/576122462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0b3240 0x7fee1c0b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee20923700 1 --2- 172.21.15.72:0/576122462 >> v2:172.21.15.123:3300/0 conn(0x7fee1c152470 0x7fee1c0cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee20923700 1 --2- 172.21.15.72:0/576122462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c0cb8d0 0x7fee1c0b2d00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee20923700 1 -- 172.21.15.72:0/576122462 >> 172.21.15.72:0/576122462 conn(0x7fee1c0cdd00 msgr2=0x7fee1c0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:50.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee20923700 1 -- 172.21.15.72:0/576122462 shutdown_connections 2023-10-14T12:33:50.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.147+0000 7fee20923700 1 -- 172.21.15.72:0/576122462 wait complete. 2023-10-14T12:33:50.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.149+0000 7fee20923700 1 Processor -- start 2023-10-14T12:33:50.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.149+0000 7fee20923700 1 -- start start 2023-10-14T12:33:50.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.149+0000 7fee20923700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1c0b3240 0x7fee1c158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.149+0000 7fee20923700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0cb8d0 0x7fee1c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.149+0000 7fee20923700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c152470 0x7fee1c14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.149+0000 7fee20923700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0cb420 con 0x7fee1c152470 2023-10-14T12:33:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.149+0000 7fee20923700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0cac30 con 0x7fee1c0b3240 2023-10-14T12:33:50.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.149+0000 7fee20923700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0c8860 con 0x7fee1c0cb8d0 2023-10-14T12:33:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c152470 0x7fee1c14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c152470 0x7fee1c14ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46692/0 (socket says 172.21.15.72:46692) 2023-10-14T12:33:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1ad9d700 1 -- 172.21.15.72:0/2077159073 learned_addr learned my addr 172.21.15.72:0/2077159073 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee19d9b700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0cb8d0 0x7fee1c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1a59c700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1c0b3240 0x7fee1c158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1ad9d700 1 -- 172.21.15.72:0/2077159073 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0cb8d0 msgr2=0x7fee1c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1ad9d700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0cb8d0 0x7fee1c0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1ad9d700 1 -- 172.21.15.72:0/2077159073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1c0b3240 msgr2=0x7fee1c158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1ad9d700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1c0b3240 0x7fee1c158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1ad9d700 1 -- 172.21.15.72:0/2077159073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c009550 con 0x7fee1c152470 2023-10-14T12:33:50.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1a59c700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1c0b3240 0x7fee1c158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:50.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee1ad9d700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c152470 0x7fee1c14ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee1400cb80 tx=0x7fee1400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:50.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee0affd700 1 -- 172.21.15.72:0/2077159073 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400a820 con 0x7fee1c152470 2023-10-14T12:33:50.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee0affd700 1 -- 172.21.15.72:0/2077159073 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1400a980 con 0x7fee1c152470 2023-10-14T12:33:50.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c0cae60 con 0x7fee1c152470 2023-10-14T12:33:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee0affd700 1 -- 172.21.15.72:0/2077159073 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1400ad30 con 0x7fee1c152470 2023-10-14T12:33:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.150+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c0c84f0 con 0x7fee1c152470 2023-10-14T12:33:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.151+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c0c8350 con 0x7fee1c152470 2023-10-14T12:33:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.152+0000 7fee0affd700 1 -- 172.21.15.72:0/2077159073 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fee14011410 con 0x7fee1c152470 2023-10-14T12:33:50.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.152+0000 7fee0affd700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedfc06af00 0x7fedfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.152+0000 7fee1a59c700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedfc06af00 0x7fedfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.152+0000 7fee0affd700 1 -- 172.21.15.72:0/2077159073 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee14089470 con 0x7fee1c152470 2023-10-14T12:33:50.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.152+0000 7fee1a59c700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedfc06af00 0x7fedfc06d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee1000aa50 tx=0x7fee10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:50.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.156+0000 7fee0affd700 1 -- 172.21.15.72:0/2077159073 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fee1c0c8350 con 0x7fee1c152470 2023-10-14T12:33:50.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.400+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fee1c0c8350 con 0x7fee1c152470 2023-10-14T12:33:50.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.403+0000 7fee0affd700 1 -- 172.21.15.72:0/2077159073 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171030 (secure 0 0 0) 0x7fee1c0c8350 con 0x7fee1c152470 2023-10-14T12:33:50.407 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedfc06af00 msgr2=0x7fedfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedfc06af00 0x7fedfc06d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee1000aa50 tx=0x7fee10008040 comp rx=0 tx=0).stop 2023-10-14T12:33:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c152470 msgr2=0x7fee1c14ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c152470 0x7fee1c14ec40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee1400cb80 tx=0x7fee1400ce90 comp rx=0 tx=0).stop 2023-10-14T12:33:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 shutdown_connections 2023-10-14T12:33:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedfc06af00 0x7fedfc06d3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee1c152470 0x7fee1c14ec40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee1c0b3240 0x7fee1c158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 --2- 172.21.15.72:0/2077159073 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fee1c0cb8d0 0x7fee1c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 >> 172.21.15.72:0/2077159073 conn(0x7fee1c0cdd00 msgr2=0x7fee1c151740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 shutdown_connections 2023-10-14T12:33:50.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.406+0000 7fee20923700 1 -- 172.21.15.72:0/2077159073 wait complete. 2023-10-14T12:33:50.419 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2999014877},{"type":"v1","addr":"172.21.15.72:6833","nonce":2999014877}]},"active_addr":"172.21.15.72:6833/2999014877","active_change":"2023-10-14T12:33:19.372366+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4101,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1777160003}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2551917861}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1969959313}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1858373956}]}]} 2023-10-14T12:33:50.423 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T12:33:50.423 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T12:33:50.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:50.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.543+0000 7f7a77cd9700 1 Processor -- start 2023-10-14T12:33:50.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.543+0000 7f7a77cd9700 1 -- start start 2023-10-14T12:33:50.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a77cd9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7a7006d040 0x7f7a700d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a77cd9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d420 0x7f7a7015e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a77cd9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7015ec30 con 0x7f7a700cdc90 2023-10-14T12:33:50.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a77cd9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7006cb80 con 0x7f7a7006d040 2023-10-14T12:33:50.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a77cd9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7006ce20 con 0x7f7a7006d420 2023-10-14T12:33:50.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a75274700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d420 0x7f7a7015e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a75a75700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7a7006d040 0x7f7a700d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a75274700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d420 0x7f7a7015e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:42348/0 (socket says 172.21.15.72:42348) 2023-10-14T12:33:50.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a75274700 1 -- 172.21.15.72:0/3661463466 learned_addr learned my addr 172.21.15.72:0/3661463466 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:50.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a76276700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7a700cdc90 0x7f7a700ce0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51196/0 (socket says 172.21.15.72:51196) 2023-10-14T12:33:50.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a75274700 1 -- 172.21.15.72:0/3661463466 >> v2:172.21.15.123:3300/0 conn(0x7f7a7006d040 msgr2=0x7f7a700d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:50.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a75274700 1 --2- 172.21.15.72:0/3661463466 >> v2:172.21.15.123:3300/0 conn(0x7f7a7006d040 0x7f7a700d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a75274700 1 -- 172.21.15.72:0/3661463466 >> v1:172.21.15.123:6789/0 conn(0x7f7a700cdc90 legacy=0x7f7a700ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.544+0000 7f7a75274700 1 -- 172.21.15.72:0/3661463466 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700d1420 con 0x7f7a7006d420 2023-10-14T12:33:50.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a75274700 1 --2- 172.21.15.72:0/3661463466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d420 0x7f7a7015e6f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098f0 tx=0x7f7a60009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd4d564e8b9b4a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:50.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a74a73700 1 -- 172.21.15.72:0/3661463466 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a60011830 con 0x7f7a7006d420 2023-10-14T12:33:50.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a74a73700 1 -- 172.21.15.72:0/3661463466 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a60011990 con 0x7f7a7006d420 2023-10-14T12:33:50.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a74a73700 1 -- 172.21.15.72:0/3661463466 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a60011d20 con 0x7f7a7006d420 2023-10-14T12:33:50.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a77cd9700 1 -- 172.21.15.72:0/3661463466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d420 msgr2=0x7f7a7015e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a77cd9700 1 --2- 172.21.15.72:0/3661463466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d420 0x7f7a7015e6f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a600098f0 tx=0x7f7a60009c00 comp rx=0 tx=0).stop 2023-10-14T12:33:50.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a77cd9700 1 -- 172.21.15.72:0/3661463466 shutdown_connections 2023-10-14T12:33:50.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a77cd9700 1 --2- 172.21.15.72:0/3661463466 >> v2:172.21.15.123:3300/0 conn(0x7f7a7006d040 0x7f7a700d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a77cd9700 1 --2- 172.21.15.72:0/3661463466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d420 0x7f7a7015e6f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a77cd9700 1 -- 172.21.15.72:0/3661463466 >> 172.21.15.72:0/3661463466 conn(0x7f7a7006a820 msgr2=0x7f7a7006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:50.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a77cd9700 1 -- 172.21.15.72:0/3661463466 shutdown_connections 2023-10-14T12:33:50.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.545+0000 7f7a77cd9700 1 -- 172.21.15.72:0/3661463466 wait complete. 2023-10-14T12:33:50.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.547+0000 7f7a77cd9700 1 Processor -- start 2023-10-14T12:33:50.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.547+0000 7f7a77cd9700 1 -- start start 2023-10-14T12:33:50.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.547+0000 7f7a77cd9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d040 0x7f7a70159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.547+0000 7f7a77cd9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7006d420 0x7f7a700c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.547+0000 7f7a77cd9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a700cdc90 0x7f7a700c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.547+0000 7f7a77cd9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7015a500 con 0x7f7a700cdc90 2023-10-14T12:33:50.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.547+0000 7f7a77cd9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700c7240 con 0x7f7a7006d420 2023-10-14T12:33:50.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.547+0000 7f7a77cd9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700c6630 con 0x7f7a7006d040 2023-10-14T12:33:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.547+0000 7f7a76276700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a700cdc90 0x7f7a700c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a76276700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a700cdc90 0x7f7a700c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46704/0 (socket says 172.21.15.72:46704) 2023-10-14T12:33:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a76276700 1 -- 172.21.15.72:0/1332759591 learned_addr learned my addr 172.21.15.72:0/1332759591 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a75274700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7006d420 0x7f7a700c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a75a75700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d040 0x7f7a70159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a76276700 1 -- 172.21.15.72:0/1332759591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d040 msgr2=0x7f7a70159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a76276700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d040 0x7f7a70159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a76276700 1 -- 172.21.15.72:0/1332759591 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7006d420 msgr2=0x7f7a700c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a76276700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7006d420 0x7f7a700c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a76276700 1 -- 172.21.15.72:0/1332759591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a60009550 con 0x7f7a700cdc90 2023-10-14T12:33:50.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a76276700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a700cdc90 0x7f7a700c8560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800cbc0 tx=0x7f7a6800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a667fc700 1 -- 172.21.15.72:0/1332759591 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800a9e0 con 0x7f7a700cdc90 2023-10-14T12:33:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a667fc700 1 -- 172.21.15.72:0/1332759591 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6800ab40 con 0x7f7a700cdc90 2023-10-14T12:33:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a700c6910 con 0x7f7a700cdc90 2023-10-14T12:33:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a667fc700 1 -- 172.21.15.72:0/1332759591 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68007070 con 0x7f7a700cdc90 2023-10-14T12:33:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.548+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a700c6ed0 con 0x7f7a700cdc90 2023-10-14T12:33:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.549+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7004ebb0 con 0x7f7a700cdc90 2023-10-14T12:33:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.549+0000 7f7a667fc700 1 -- 172.21.15.72:0/1332759591 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7a680071d0 con 0x7f7a700cdc90 2023-10-14T12:33:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.550+0000 7f7a667fc700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7a5406af00 0x7f7a5406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.550+0000 7f7a667fc700 1 -- 172.21.15.72:0/1332759591 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a680893e0 con 0x7f7a700cdc90 2023-10-14T12:33:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.550+0000 7f7a75a75700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7a5406af00 0x7f7a5406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.550+0000 7f7a75a75700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7a5406af00 0x7f7a5406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a7006b2e0 tx=0x7f7a6c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.554+0000 7f7a667fc700 1 -- 172.21.15.72:0/1332759591 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a680542e0 con 0x7f7a700cdc90 2023-10-14T12:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.746+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a700b3630 con 0x7f7a700cdc90 2023-10-14T12:33:50.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.747+0000 7f7a667fc700 1 -- 172.21.15.72:0/1332759591 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f7a68057900 con 0x7f7a700cdc90 2023-10-14T12:33:50.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:50.751 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:50.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7a5406af00 msgr2=0x7f7a5406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7a5406af00 0x7f7a5406d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a7006b2e0 tx=0x7f7a6c009210 comp rx=0 tx=0).stop 2023-10-14T12:33:50.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a700cdc90 msgr2=0x7f7a700c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a700cdc90 0x7f7a700c8560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800cbc0 tx=0x7f7a6800ced0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 shutdown_connections 2023-10-14T12:33:50.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7a5406af00 0x7f7a5406d3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a700cdc90 0x7f7a700c8560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7a7006d040 0x7f7a70159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 --2- 172.21.15.72:0/1332759591 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7006d420 0x7f7a700c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 >> 172.21.15.72:0/1332759591 conn(0x7f7a7006a820 msgr2=0x7f7a7015c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:50.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 shutdown_connections 2023-10-14T12:33:50.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.749+0000 7f7a77cd9700 1 -- 172.21.15.72:0/1332759591 wait complete. 2023-10-14T12:33:50.763 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T12:33:50.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:50.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.882+0000 7f389fc3b700 1 Processor -- start 2023-10-14T12:33:50.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.882+0000 7f389fc3b700 1 -- start start 2023-10-14T12:33:50.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389fc3b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f389806a820 0x7f38980cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389fc3b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389fc3b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980cfeb0 con 0x7f389815e7f0 2023-10-14T12:33:50.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389fc3b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38980ce410 con 0x7f389806a820 2023-10-14T12:33:50.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389fc3b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389815ec50 con 0x7f38980ca7d0 2023-10-14T12:33:50.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389e1d8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389d9d7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f389806a820 0x7f38980cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389e1d8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:42364/0 (socket says 172.21.15.72:42364) 2023-10-14T12:33:50.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389d9d7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f389806a820 0x7f38980cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:34860/0 (socket says 172.21.15.72:34860) 2023-10-14T12:33:50.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389e1d8700 1 -- 172.21.15.72:0/2536610026 learned_addr learned my addr 172.21.15.72:0/2536610026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:50.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389d1d6700 1 --1- 172.21.15.72:0/2536610026 >> v1:172.21.15.123:6789/0 conn(0x7f389815e7f0 0x7f389806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51208/0 (socket says 172.21.15.72:51208) 2023-10-14T12:33:50.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389e1d8700 1 -- 172.21.15.72:0/2536610026 >> v2:172.21.15.123:3300/0 conn(0x7f389806a820 msgr2=0x7f38980cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:50.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389e1d8700 1 --2- 172.21.15.72:0/2536610026 >> v2:172.21.15.123:3300/0 conn(0x7f389806a820 0x7f38980cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389e1d8700 1 -- 172.21.15.72:0/2536610026 >> v1:172.21.15.123:6789/0 conn(0x7f389815e7f0 legacy=0x7f389806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.883+0000 7f389e1d8700 1 -- 172.21.15.72:0/2536610026 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980af9d0 con 0x7f38980ca7d0 2023-10-14T12:33:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389e1d8700 1 --2- 172.21.15.72:0/2536610026 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898071ea0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3890009e50 tx=0x7f389000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d30ff3902c65e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389c9d5700 1 -- 172.21.15.72:0/2536610026 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389000e070 con 0x7f38980ca7d0 2023-10-14T12:33:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389c9d5700 1 -- 172.21.15.72:0/2536610026 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389000b910 con 0x7f38980ca7d0 2023-10-14T12:33:50.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389c9d5700 1 -- 172.21.15.72:0/2536610026 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389000bcc0 con 0x7f38980ca7d0 2023-10-14T12:33:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389fc3b700 1 -- 172.21.15.72:0/2536610026 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 msgr2=0x7f3898071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389fc3b700 1 --2- 172.21.15.72:0/2536610026 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898071ea0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3890009e50 tx=0x7f389000b330 comp rx=0 tx=0).stop 2023-10-14T12:33:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389fc3b700 1 -- 172.21.15.72:0/2536610026 shutdown_connections 2023-10-14T12:33:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389fc3b700 1 --2- 172.21.15.72:0/2536610026 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898071ea0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389fc3b700 1 --2- 172.21.15.72:0/2536610026 >> v2:172.21.15.123:3300/0 conn(0x7f389806a820 0x7f38980cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389fc3b700 1 -- 172.21.15.72:0/2536610026 >> 172.21.15.72:0/2536610026 conn(0x7f38980d0180 msgr2=0x7f38980d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:50.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389fc3b700 1 -- 172.21.15.72:0/2536610026 shutdown_connections 2023-10-14T12:33:50.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.884+0000 7f389fc3b700 1 -- 172.21.15.72:0/2536610026 wait complete. 2023-10-14T12:33:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.886+0000 7f389fc3b700 1 Processor -- start 2023-10-14T12:33:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.886+0000 7f389fc3b700 1 -- start start 2023-10-14T12:33:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389fc3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389806a820 0x7f38980b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389fc3b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389fc3b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815e7f0 0x7f38980c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389fc3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980b5c20 con 0x7f389806a820 2023-10-14T12:33:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389fc3b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3898157cd0 con 0x7f389815e7f0 2023-10-14T12:33:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389fc3b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980c81e0 con 0x7f38980ca7d0 2023-10-14T12:33:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389d9d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389806a820 0x7f38980b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389d9d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389806a820 0x7f38980b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46714/0 (socket says 172.21.15.72:46714) 2023-10-14T12:33:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389d9d7700 1 -- 172.21.15.72:0/3103650066 learned_addr learned my addr 172.21.15.72:0/3103650066 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389e1d8700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815e7f0 0x7f38980c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389d1d6700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389d9d7700 1 -- 172.21.15.72:0/3103650066 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 msgr2=0x7f3898157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389d9d7700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389d9d7700 1 -- 172.21.15.72:0/3103650066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815e7f0 msgr2=0x7f38980c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:50.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389d9d7700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815e7f0 0x7f38980c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:50.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.887+0000 7f389d9d7700 1 -- 172.21.15.72:0/3103650066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3890009b30 con 0x7f389806a820 2023-10-14T12:33:50.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.888+0000 7f389d9d7700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389806a820 0x7f38980b56e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f389400e9e0 tx=0x7f389400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:50.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.888+0000 7f388e7fc700 1 -- 172.21.15.72:0/3103650066 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894009710 con 0x7f389806a820 2023-10-14T12:33:50.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.888+0000 7f388e7fc700 1 -- 172.21.15.72:0/3103650066 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389400ee80 con 0x7f389806a820 2023-10-14T12:33:50.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.888+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38980c7250 con 0x7f389806a820 2023-10-14T12:33:50.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.888+0000 7f388e7fc700 1 -- 172.21.15.72:0/3103650066 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389400ca50 con 0x7f389806a820 2023-10-14T12:33:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.888+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38980c74a0 con 0x7f389806a820 2023-10-14T12:33:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.889+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389804ebb0 con 0x7f389806a820 2023-10-14T12:33:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.889+0000 7f388e7fc700 1 -- 172.21.15.72:0/3103650066 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f389400cbb0 con 0x7f389806a820 2023-10-14T12:33:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.890+0000 7f388e7fc700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f387c06af00 0x7f387c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:50.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.890+0000 7f388e7fc700 1 -- 172.21.15.72:0/3103650066 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3894089850 con 0x7f389806a820 2023-10-14T12:33:50.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.890+0000 7f389d1d6700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f387c06af00 0x7f387c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:50.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.890+0000 7f389d1d6700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f387c06af00 0x7f387c06d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3898158be0 tx=0x7f3888007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:50.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:50.894+0000 7f388e7fc700 1 -- 172.21.15.72:0/3103650066 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3894054600 con 0x7f389806a820 2023-10-14T12:33:51.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.086+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38980b6100 con 0x7f389806a820 2023-10-14T12:33:51.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.087+0000 7f388e7fc700 1 -- 172.21.15.72:0/3103650066 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f3894057c20 con 0x7f389806a820 2023-10-14T12:33:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:51.089 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:51.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f387c06af00 msgr2=0x7f387c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f387c06af00 0x7f387c06d3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3898158be0 tx=0x7f3888007f10 comp rx=0 tx=0).stop 2023-10-14T12:33:51.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389806a820 msgr2=0x7f38980b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389806a820 0x7f38980b56e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f389400e9e0 tx=0x7f389400ecf0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 shutdown_connections 2023-10-14T12:33:51.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f387c06af00 0x7f387c06d3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f389815e7f0 0x7f38980c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389806a820 0x7f38980b56e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 --2- 172.21.15.72:0/3103650066 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f38980ca7d0 0x7f3898157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 >> 172.21.15.72:0/3103650066 conn(0x7f38980d0180 msgr2=0x7f3898071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 shutdown_connections 2023-10-14T12:33:51.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.090+0000 7f389fc3b700 1 -- 172.21.15.72:0/3103650066 wait complete. 2023-10-14T12:33:51.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T12:33:51.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T12:33:51.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T12:33:51.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T12:33:51.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T12:33:51.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T12:33:51.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T12:33:51.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T12:33:51.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.312+0000 7f3d37781700 1 Processor -- start 2023-10-14T12:33:51.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.313+0000 7f3d37781700 1 -- start start 2023-10-14T12:33:51.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.314+0000 7f3d37781700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d300c3800 0x7f3d30071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.314+0000 7f3d37781700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d300d1120 con 0x7f3d300d0ca0 2023-10-14T12:33:51.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.314+0000 7f3d37781700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d300acf20 con 0x7f3d3006af30 2023-10-14T12:33:51.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.314+0000 7f3d37781700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30071ee0 con 0x7f3d300c3800 2023-10-14T12:33:51.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.314+0000 7f3d35d1e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3d3006af30 0x7f3d300ad3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51222/0 (socket says 172.21.15.72:51222) 2023-10-14T12:33:51.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.314+0000 7f3d35d1e700 1 -- 172.21.15.72:0/2886649755 learned_addr learned my addr 172.21.15.72:0/2886649755 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.314+0000 7f3d3551d700 1 --2- 172.21.15.72:0/2886649755 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d300c3800 0x7f3d30071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.314+0000 7f3d27fff700 1 -- 172.21.15.72:0/2886649755 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425784667 0 0) 0x7f3d300acf20 con 0x7f3d3006af30 2023-10-14T12:33:51.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.314+0000 7f3d27fff700 1 -- 172.21.15.72:0/2886649755 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d1c0035b0 con 0x7f3d3006af30 2023-10-14T12:33:51.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.315+0000 7f3d3551d700 1 -- 172.21.15.72:0/2886649755 >> v1:172.21.15.123:6789/0 conn(0x7f3d3006af30 legacy=0x7f3d300ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.315+0000 7f3d3551d700 1 -- 172.21.15.72:0/2886649755 >> v1:172.21.15.72:6789/0 conn(0x7f3d300d0ca0 legacy=0x7f3d3006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.315+0000 7f3d3551d700 1 -- 172.21.15.72:0/2886649755 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300721c0 con 0x7f3d300c3800 2023-10-14T12:33:51.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.315+0000 7f3d3551d700 1 --2- 172.21.15.72:0/2886649755 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d300c3800 0x7f3d30071850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009870 tx=0x7f3d20009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7714c9768f1ba225 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.315+0000 7f3d27fff700 1 -- 172.21.15.72:0/2886649755 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20004230 con 0x7f3d300c3800 2023-10-14T12:33:51.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.315+0000 7f3d27fff700 1 -- 172.21.15.72:0/2886649755 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d20004390 con 0x7f3d300c3800 2023-10-14T12:33:51.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.315+0000 7f3d27fff700 1 -- 172.21.15.72:0/2886649755 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d200036a0 con 0x7f3d300c3800 2023-10-14T12:33:51.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.316+0000 7f3d37781700 1 -- 172.21.15.72:0/2886649755 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d300c3800 msgr2=0x7f3d30071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.316+0000 7f3d37781700 1 --2- 172.21.15.72:0/2886649755 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d300c3800 0x7f3d30071850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009870 tx=0x7f3d20009b80 comp rx=0 tx=0).stop 2023-10-14T12:33:51.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.317+0000 7f3d37781700 1 -- 172.21.15.72:0/2886649755 shutdown_connections 2023-10-14T12:33:51.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.317+0000 7f3d37781700 1 --2- 172.21.15.72:0/2886649755 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d300c3800 0x7f3d30071850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.317+0000 7f3d37781700 1 -- 172.21.15.72:0/2886649755 >> 172.21.15.72:0/2886649755 conn(0x7f3d300d0180 msgr2=0x7f3d300d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.317+0000 7f3d37781700 1 -- 172.21.15.72:0/2886649755 shutdown_connections 2023-10-14T12:33:51.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.317+0000 7f3d37781700 1 -- 172.21.15.72:0/2886649755 wait complete. 2023-10-14T12:33:51.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.318+0000 7f2bd5b27700 1 Processor -- start 2023-10-14T12:33:51.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.318+0000 7f3d37781700 1 Processor -- start 2023-10-14T12:33:51.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.318+0000 7f2bd5b27700 1 -- start start 2023-10-14T12:33:51.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.319+0000 7f2bd5b27700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2bd0161a00 0x7f2bd00cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.319+0000 7f2bd5b27700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bd00cd2a0 0x7f2bd00c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.319+0000 7f2bd5b27700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd00ca950 con 0x7f2bd00c9610 2023-10-14T12:33:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.319+0000 7f2bd5b27700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd00ca0b0 con 0x7f2bd0161a00 2023-10-14T12:33:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.319+0000 7f2bd5b27700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00ca390 con 0x7f2bd00cd2a0 2023-10-14T12:33:51.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.319+0000 7f3d37781700 1 -- start start 2023-10-14T12:33:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f2bceffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2bd00c9610 0x7f2bd00ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53030/0 (socket says 172.21.15.72:53030) 2023-10-14T12:33:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f2bceffd700 1 -- 172.21.15.72:0/419885124 learned_addr learned my addr 172.21.15.72:0/419885124 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f2bcffff700 1 --2- 172.21.15.72:0/419885124 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bd00cd2a0 0x7f2bd00c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d37781700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d3006af30 0x7f3d300b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d37781700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d300c3800 0x7f3d300b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d37781700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300d0ca0 0x7f3d300b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d37781700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300c40e0 con 0x7f3d300d0ca0 2023-10-14T12:33:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d37781700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300c43c0 con 0x7f3d300c3800 2023-10-14T12:33:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d37781700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d300c46a0 con 0x7f3d3006af30 2023-10-14T12:33:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d35d1e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300d0ca0 0x7f3d300b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d35d1e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300d0ca0 0x7f3d300b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46734/0 (socket says 172.21.15.72:46734) 2023-10-14T12:33:51.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d35d1e700 1 -- 172.21.15.72:0/1363513618 learned_addr learned my addr 172.21.15.72:0/1363513618 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d35d1e700 1 -- 172.21.15.72:0/1363513618 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d3006af30 msgr2=0x7f3d300b5860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:33:51.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d35d1e700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d3006af30 0x7f3d300b5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d35d1e700 1 -- 172.21.15.72:0/1363513618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d300c3800 msgr2=0x7f3d300b0700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:33:51.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d35d1e700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d300c3800 0x7f3d300b0700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7f3d35d1e700 1 -- 172.21.15.72:0/1363513618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d200094a0 con 0x7f3d300d0ca0 2023-10-14T12:33:51.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7f2bcf7fe700 1 --2- 172.21.15.72:0/419885124 >> v2:172.21.15.123:3300/0 conn(0x7f2bd0161a00 0x7f2bd00cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7f2bcffff700 1 -- 172.21.15.72:0/419885124 >> v2:172.21.15.123:3300/0 conn(0x7f2bd0161a00 msgr2=0x7f2bd00cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7f2bcffff700 1 --2- 172.21.15.72:0/419885124 >> v2:172.21.15.123:3300/0 conn(0x7f2bd0161a00 0x7f2bd00cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7f2bcffff700 1 -- 172.21.15.72:0/419885124 >> v1:172.21.15.72:6789/0 conn(0x7f2bd00c9610 legacy=0x7f2bd00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7f2bcffff700 1 -- 172.21.15.72:0/419885124 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd00ca670 con 0x7f2bd00cd2a0 2023-10-14T12:33:51.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7f3d35d1e700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300d0ca0 0x7f3d300b0c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800caa0 tx=0x7f3d2800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7f2bcffff700 1 --2- 172.21.15.72:0/419885124 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bd00cd2a0 0x7f2bd00c9ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009d90 tx=0x7f2bc800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=562fba43561f095 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.319+0000 7ff388193700 1 Processor -- start 2023-10-14T12:33:51.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.320+0000 7ff388193700 1 -- start start 2023-10-14T12:33:51.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7ff388193700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff38006dd60 0x7ff38016e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7ff388193700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3800cae00 0x7ff38016eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7ff388193700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3800cd7b0 con 0x7ff38006e140 2023-10-14T12:33:51.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7ff388193700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3800cd5a0 con 0x7ff38006dd60 2023-10-14T12:33:51.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7ff388193700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800ca950 con 0x7ff3800cae00 2023-10-14T12:33:51.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7ff385f2f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff38006dd60 0x7ff38016e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7ff386730700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff38006e140 0x7ff3800c9610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53038/0 (socket says 172.21.15.72:53038) 2023-10-14T12:33:51.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.321+0000 7ff386730700 1 -- 172.21.15.72:0/3100286082 learned_addr learned my addr 172.21.15.72:0/3100286082 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7fc597fff700 1 Processor -- start 2023-10-14T12:33:51.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7f2bce7fc700 1 -- 172.21.15.72:0/419885124 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc800e070 con 0x7f2bd00cd2a0 2023-10-14T12:33:51.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7f2bce7fc700 1 -- 172.21.15.72:0/419885124 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc800bb90 con 0x7f2bd00cd2a0 2023-10-14T12:33:51.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7f2bce7fc700 1 -- 172.21.15.72:0/419885124 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8003a20 con 0x7f2bd00cd2a0 2023-10-14T12:33:51.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7f3d25ffb700 1 -- 172.21.15.72:0/1363513618 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800aa20 con 0x7f3d300d0ca0 2023-10-14T12:33:51.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7f3d25ffb700 1 -- 172.21.15.72:0/1363513618 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2800ab80 con 0x7f3d300d0ca0 2023-10-14T12:33:51.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7f3d25ffb700 1 -- 172.21.15.72:0/1363513618 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28012400 con 0x7f3d300d0ca0 2023-10-14T12:33:51.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d300c4980 con 0x7f3d300d0ca0 2023-10-14T12:33:51.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d300b28f0 con 0x7f3d300d0ca0 2023-10-14T12:33:51.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7ff384f2d700 1 -- 172.21.15.72:0/3100286082 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659302442 0 0) 0x7ff3800cd7b0 con 0x7ff38006e140 2023-10-14T12:33:51.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7ff385f2f700 1 -- 172.21.15.72:0/3100286082 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3800cae00 msgr2=0x7ff38016eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7ff385f2f700 1 --2- 172.21.15.72:0/3100286082 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3800cae00 0x7ff38016eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7ff385f2f700 1 -- 172.21.15.72:0/3100286082 >> v1:172.21.15.72:6789/0 conn(0x7ff38006e140 legacy=0x7ff3800c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7ff385f2f700 1 -- 172.21.15.72:0/3100286082 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3800cd1d0 con 0x7ff38006dd60 2023-10-14T12:33:51.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7ff385f2f700 1 --2- 172.21.15.72:0/3100286082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006dd60 0x7ff38016e660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c050 tx=0x7ff37000c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546a02f8a62b6284 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7ff384f2d700 1 -- 172.21.15.72:0/3100286082 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370007830 con 0x7ff38006dd60 2023-10-14T12:33:51.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7ff384f2d700 1 -- 172.21.15.72:0/3100286082 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff370007990 con 0x7ff38006dd60 2023-10-14T12:33:51.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7ff384f2d700 1 -- 172.21.15.72:0/3100286082 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370007d20 con 0x7ff38006dd60 2023-10-14T12:33:51.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.322+0000 7fc597fff700 1 -- start start 2023-10-14T12:33:51.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7fc597fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5980ce950 0x7fc5980ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7fc597fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5980c1f10 0x7fc5980c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7fc597fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5980ced30 con 0x7fc5980ade20 2023-10-14T12:33:51.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7fc597fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980c28e0 con 0x7fc5980ce950 2023-10-14T12:33:51.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7fc597fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980728d0 con 0x7fc5980c1f10 2023-10-14T12:33:51.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7fc596ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5980ce950 0x7fc5980ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7fc596ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5980ce950 0x7fc5980ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46744/0 (socket says 172.21.15.72:46744) 2023-10-14T12:33:51.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.324+0000 7fc596ffd700 1 -- 172.21.15.72:0/1768735779 learned_addr learned my addr 172.21.15.72:0/1768735779 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.324+0000 7ff388193700 1 -- 172.21.15.72:0/3100286082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006dd60 msgr2=0x7ff38016e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.324+0000 7ff388193700 1 --2- 172.21.15.72:0/3100286082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006dd60 0x7ff38016e660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c050 tx=0x7ff37000c360 comp rx=0 tx=0).stop 2023-10-14T12:33:51.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7f2bd5b27700 1 -- 172.21.15.72:0/419885124 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bd00cd2a0 msgr2=0x7f2bd00c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7f2bd5b27700 1 --2- 172.21.15.72:0/419885124 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bd00cd2a0 0x7f2bd00c9ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009d90 tx=0x7f2bc800b330 comp rx=0 tx=0).stop 2023-10-14T12:33:51.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7f2bd5b27700 1 -- 172.21.15.72:0/419885124 shutdown_connections 2023-10-14T12:33:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7f2bd5b27700 1 --2- 172.21.15.72:0/419885124 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bd00cd2a0 0x7f2bd00c9ac0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7f2bd5b27700 1 --2- 172.21.15.72:0/419885124 >> v2:172.21.15.123:3300/0 conn(0x7f2bd0161a00 0x7f2bd00cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.323+0000 7f2bd5b27700 1 -- 172.21.15.72:0/419885124 >> 172.21.15.72:0/419885124 conn(0x7f2bd006c850 msgr2=0x7f2bd006cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.324+0000 7ff388193700 1 -- 172.21.15.72:0/3100286082 shutdown_connections 2023-10-14T12:33:51.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.324+0000 7ff388193700 1 --2- 172.21.15.72:0/3100286082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006dd60 0x7ff38016e660 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.324+0000 7ff388193700 1 --2- 172.21.15.72:0/3100286082 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3800cae00 0x7ff38016eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.324+0000 7ff388193700 1 -- 172.21.15.72:0/3100286082 >> 172.21.15.72:0/3100286082 conn(0x7ff3800cbad0 msgr2=0x7ff3800cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.324+0000 7f2bd5b27700 1 -- 172.21.15.72:0/419885124 shutdown_connections 2023-10-14T12:33:51.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.325+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d10000fc0 con 0x7f3d300d0ca0 2023-10-14T12:33:51.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.325+0000 7fc596ffd700 1 -- 172.21.15.72:0/1768735779 >> v2:172.21.15.123:3300/0 conn(0x7fc5980c1f10 msgr2=0x7fc5980c23a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:33:51.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.325+0000 7fc596ffd700 1 --2- 172.21.15.72:0/1768735779 >> v2:172.21.15.123:3300/0 conn(0x7fc5980c1f10 0x7fc5980c23a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.325+0000 7fc596ffd700 1 -- 172.21.15.72:0/1768735779 >> v1:172.21.15.123:6789/0 conn(0x7fc5980ade20 legacy=0x7fc5981653f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:33:51.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.325+0000 7fc596ffd700 1 -- 172.21.15.72:0/1768735779 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc598072030 con 0x7fc5980ce950 2023-10-14T12:33:51.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.325+0000 7fc596ffd700 1 --2- 172.21.15.72:0/1768735779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5980ce950 0x7fc5980ae370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc598070930 tx=0x7fc588009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7355e04a489ab396 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.325+0000 7f91d40be700 1 Processor -- start 2023-10-14T12:33:51.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.325+0000 7f91d40be700 1 -- start start 2023-10-14T12:33:51.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.324+0000 7f2bd5b27700 1 -- 172.21.15.72:0/419885124 wait complete. 2023-10-14T12:33:51.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7f2bd5b27700 1 Processor -- start 2023-10-14T12:33:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7ff388193700 1 -- 172.21.15.72:0/3100286082 shutdown_connections 2023-10-14T12:33:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7fc595ffb700 1 -- 172.21.15.72:0/1768735779 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588004230 con 0x7fc5980ce950 2023-10-14T12:33:51.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7fc595ffb700 1 -- 172.21.15.72:0/1768735779 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588004390 con 0x7fc5980ce950 2023-10-14T12:33:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7fc595ffb700 1 -- 172.21.15.72:0/1768735779 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880036a0 con 0x7fc5980ce950 2023-10-14T12:33:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7fc597fff700 1 -- 172.21.15.72:0/1768735779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5980ce950 msgr2=0x7fc5980ae370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7fc597fff700 1 --2- 172.21.15.72:0/1768735779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5980ce950 0x7fc5980ae370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc598070930 tx=0x7fc588009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d40be700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d40be700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91cc0cb100 0x7f91cc06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d40be700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc06eba0 con 0x7f91cc06daf0 2023-10-14T12:33:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d40be700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc15dd80 con 0x7f91cc0cb100 2023-10-14T12:33:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d40be700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc06e4b0 con 0x7f91cc15d9a0 2023-10-14T12:33:51.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d1e5a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d1e5a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:42402/0 (socket says 172.21.15.72:42402) 2023-10-14T12:33:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d1e5a700 1 -- 172.21.15.72:0/2642620469 learned_addr learned my addr 172.21.15.72:0/2642620469 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d265b700 1 --2- 172.21.15.72:0/2642620469 >> v2:172.21.15.123:3300/0 conn(0x7f91cc0cb100 0x7f91cc06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.325+0000 7f3d25ffb700 1 -- 172.21.15.72:0/1363513618 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d28007d50 con 0x7f3d300d0ca0 2023-10-14T12:33:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7f3d25ffb700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d1406af50 0x7f3d1406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7f3d25ffb700 1 -- 172.21.15.72:0/1363513618 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d28089040 con 0x7f3d300d0ca0 2023-10-14T12:33:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7f3d25ffb700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7f3d14074510 0x7f3d14076950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7f3d25ffb700 1 -- 172.21.15.72:0/1363513618 --> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d14077020 con 0x7f3d14074510 2023-10-14T12:33:51.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f3d3551d700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d1406af50 0x7f3d1406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d1e5a700 1 -- 172.21.15.72:0/2642620469 >> v2:172.21.15.123:3300/0 conn(0x7f91cc0cb100 msgr2=0x7f91cc06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d1e5a700 1 --2- 172.21.15.72:0/2642620469 >> v2:172.21.15.123:3300/0 conn(0x7f91cc0cb100 0x7f91cc06df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d1e5a700 1 -- 172.21.15.72:0/2642620469 >> v1:172.21.15.123:6789/0 conn(0x7f91cc06daf0 legacy=0x7f91cc0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f91d1e5a700 1 -- 172.21.15.72:0/2642620469 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc06ee80 con 0x7f91cc15d9a0 2023-10-14T12:33:51.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.327+0000 7f3d25ffb700 1 -- 172.21.15.72:0/1363513618 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d28054020 con 0x7f3d300d0ca0 2023-10-14T12:33:51.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7fc597fff700 1 -- 172.21.15.72:0/1768735779 shutdown_connections 2023-10-14T12:33:51.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7fc597fff700 1 --2- 172.21.15.72:0/1768735779 >> v2:172.21.15.123:3300/0 conn(0x7fc5980c1f10 0x7fc5980c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7fc597fff700 1 --2- 172.21.15.72:0/1768735779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5980ce950 0x7fc5980ae370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7fc597fff700 1 -- 172.21.15.72:0/1768735779 >> 172.21.15.72:0/1768735779 conn(0x7fc5980cef40 msgr2=0x7fc5980cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7f3d34d1c700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7f3d14074510 0x7f3d14076950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.326+0000 7ff388193700 1 -- 172.21.15.72:0/3100286082 wait complete. 2023-10-14T12:33:51.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7ff388193700 1 Processor -- start 2023-10-14T12:33:51.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7f91d1e5a700 1 --2- 172.21.15.72:0/2642620469 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0ad1a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91c80098f0 tx=0x7f91c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60e4e8b725429588 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7f3d3551d700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d1406af50 0x7f3d1406d410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009bc0 tx=0x7f3d20008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7f3d34d1c700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7f3d14074510 0x7f3d14076950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7f91d0e58700 1 -- 172.21.15.72:0/2642620469 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8011830 con 0x7f91cc15d9a0 2023-10-14T12:33:51.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7f91d0e58700 1 -- 172.21.15.72:0/2642620469 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c8011990 con 0x7f91cc15d9a0 2023-10-14T12:33:51.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7f91d0e58700 1 -- 172.21.15.72:0/2642620469 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8011d20 con 0x7f91cc15d9a0 2023-10-14T12:33:51.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7ff388193700 1 -- start start 2023-10-14T12:33:51.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff388193700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38006dd60 0x7ff3800abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff388193700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006e140 0x7ff3800a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff388193700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3800a9520 0x7ff3800aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff388193700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800aa640 con 0x7ff38006e140 2023-10-14T12:33:51.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff388193700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800a99c0 con 0x7ff38006dd60 2023-10-14T12:33:51.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff388193700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800a9ca0 con 0x7ff3800a9520 2023-10-14T12:33:51.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff38572e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006e140 0x7ff3800a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff386730700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3800a9520 0x7ff3800aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff38572e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006e140 0x7ff3800a8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46762/0 (socket says 172.21.15.72:46762) 2023-10-14T12:33:51.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff38572e700 1 -- 172.21.15.72:0/661237482 learned_addr learned my addr 172.21.15.72:0/661237482 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f91d40be700 1 -- 172.21.15.72:0/2642620469 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 msgr2=0x7f91cc0ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f91d40be700 1 --2- 172.21.15.72:0/2642620469 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0ad1a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f91c80098f0 tx=0x7f91c8009c00 comp rx=0 tx=0).stop 2023-10-14T12:33:51.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f91d40be700 1 -- 172.21.15.72:0/2642620469 shutdown_connections 2023-10-14T12:33:51.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f91d40be700 1 --2- 172.21.15.72:0/2642620469 >> v2:172.21.15.123:3300/0 conn(0x7f91cc0cb100 0x7f91cc06df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f91d40be700 1 --2- 172.21.15.72:0/2642620469 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0ad1a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f91d40be700 1 -- 172.21.15.72:0/2642620469 >> 172.21.15.72:0/2642620469 conn(0x7f91cc0cbad0 msgr2=0x7f91cc0cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7f3d25ffb700 1 -- 172.21.15.72:0/1363513618 <== osd.3 v2:172.21.15.72:6824/2591734444 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3d14077020 con 0x7f3d14074510 2023-10-14T12:33:51.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7f91d40be700 1 -- 172.21.15.72:0/2642620469 shutdown_connections 2023-10-14T12:33:51.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7f91d40be700 1 -- 172.21.15.72:0/2642620469 wait complete. 2023-10-14T12:33:51.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7f2bd5b27700 1 -- start start 2023-10-14T12:33:51.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bd5b27700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bd00c9610 0x7f2bd0149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bd5b27700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bd00cd2a0 0x7f2bd013f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bd5b27700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd0161a00 0x7f2bd00711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bd5b27700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00c7690 con 0x7f2bd0161a00 2023-10-14T12:33:51.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bd5b27700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00c6a80 con 0x7f2bd00c9610 2023-10-14T12:33:51.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bd5b27700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00c6d60 con 0x7f2bd00cd2a0 2023-10-14T12:33:51.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bcf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bd00c9610 0x7f2bd0149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bcf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bd00c9610 0x7f2bd0149680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:34918/0 (socket says 172.21.15.72:34918) 2023-10-14T12:33:51.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bcf7fe700 1 -- 172.21.15.72:0/1298097128 learned_addr learned my addr 172.21.15.72:0/1298097128 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f2bcffff700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd0161a00 0x7f2bd00711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bcf7fe700 1 -- 172.21.15.72:0/1298097128 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bd00cd2a0 msgr2=0x7f2bd013f630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:33:51.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bcf7fe700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2bd00cd2a0 0x7f2bd013f630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bcf7fe700 1 -- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd0161a00 msgr2=0x7f2bd00711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bcf7fe700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bd0161a00 0x7f2bd00711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bcf7fe700 1 -- 172.21.15.72:0/1298097128 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8009a70 con 0x7f2bd00c9610 2023-10-14T12:33:51.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7ff385f2f700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38006dd60 0x7ff3800abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff38572e700 1 -- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3800a9520 msgr2=0x7ff3800aaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff38572e700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff3800a9520 0x7ff3800aaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff38572e700 1 -- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38006dd60 msgr2=0x7ff3800abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff38572e700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff38006dd60 0x7ff3800abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff38572e700 1 -- 172.21.15.72:0/661237482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370007510 con 0x7ff38006e140 2023-10-14T12:33:51.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff38572e700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006e140 0x7ff3800a8fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00b450 tx=0x7ff37c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff3767fc700 1 -- 172.21.15.72:0/661237482 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c011830 con 0x7ff38006e140 2023-10-14T12:33:51.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff3767fc700 1 -- 172.21.15.72:0/661237482 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c011990 con 0x7ff38006e140 2023-10-14T12:33:51.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff3767fc700 1 -- 172.21.15.72:0/661237482 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c011d40 con 0x7ff38006e140 2023-10-14T12:33:51.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3800a9f80 con 0x7ff38006e140 2023-10-14T12:33:51.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3800ac420 con 0x7ff38006e140 2023-10-14T12:33:51.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bcf7fe700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bd00c9610 0x7f2bd0149680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c7f0 tx=0x7f2bc400cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.331+0000 7f91d40be700 1 Processor -- start 2023-10-14T12:33:51.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bb7fff700 1 -- 172.21.15.72:0/1298097128 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4011800 con 0x7f2bd00c9610 2023-10-14T12:33:51.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bb7fff700 1 -- 172.21.15.72:0/1298097128 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc4011960 con 0x7f2bd00c9610 2023-10-14T12:33:51.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bb7fff700 1 -- 172.21.15.72:0/1298097128 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4011cd0 con 0x7f2bd00c9610 2023-10-14T12:33:51.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd00c7040 con 0x7f2bd00c9610 2023-10-14T12:33:51.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd0149bc0 con 0x7f2bd00c9610 2023-10-14T12:33:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff38006ea60 con 0x7ff38006e140 2023-10-14T12:33:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7f365533f700 1 Processor -- start 2023-10-14T12:33:51.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.328+0000 7f365533f700 1 -- start start 2023-10-14T12:33:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f365533f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f365006e140 0x7f3650175920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f365533f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365016f480 con 0x7f365006dd60 2023-10-14T12:33:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f365533f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36500cd7b0 con 0x7f36500cae00 2023-10-14T12:33:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f365533f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36500cd5a0 con 0x7f365006e140 2023-10-14T12:33:51.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f364e7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f36500cae00 0x7f365016ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51254/0 (socket says 172.21.15.72:51254) 2023-10-14T12:33:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.329+0000 7f364e7fc700 1 -- 172.21.15.72:0/2102206089 learned_addr learned my addr 172.21.15.72:0/2102206089 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7f364f7fe700 1 --2- 172.21.15.72:0/2102206089 >> v2:172.21.15.123:3300/0 conn(0x7f365006e140 0x7f3650175920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.330+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776693268 0 0) 0x7f36500cd7b0 con 0x7f36500cae00 2023-10-14T12:33:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36380034d0 con 0x7f36500cae00 2023-10-14T12:33:51.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bd00c4370 con 0x7f2bd00c9610 2023-10-14T12:33:51.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7fc597fff700 1 -- 172.21.15.72:0/1768735779 shutdown_connections 2023-10-14T12:33:51.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7fc597fff700 1 -- 172.21.15.72:0/1768735779 wait complete. 2023-10-14T12:33:51.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7f91d40be700 1 -- start start 2023-10-14T12:33:51.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f91d40be700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91cc06daf0 0x7f91cc14a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f91d40be700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91cc0cb100 0x7f91cc0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f91d40be700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f91d40be700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc14aaa0 con 0x7f91cc0cb100 2023-10-14T12:33:51.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f91d40be700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0aecb0 con 0x7f91cc06daf0 2023-10-14T12:33:51.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f91d40be700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0aef90 con 0x7f91cc15d9a0 2023-10-14T12:33:51.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.332+0000 7ff3767fc700 1 -- 172.21.15.72:0/661237482 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff37c01a400 con 0x7ff38006e140 2023-10-14T12:33:51.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7ff3767fc700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff36406af00 0x7ff36406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7ff3767fc700 1 -- 172.21.15.72:0/661237482 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff37c0898c0 con 0x7ff38006e140 2023-10-14T12:33:51.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7ff3767fc700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7ff364074440 0x7ff364076880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7ff3767fc700 1 -- 172.21.15.72:0/661237482 --> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff364076f50 con 0x7ff364074440 2023-10-14T12:33:51.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7ff3767fc700 1 -- 172.21.15.72:0/661237482 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff37c011ea0 con 0x7ff38006e140 2023-10-14T12:33:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 <== mon.1 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2273792493 0 0) 0x7f36380034d0 con 0x7f36500cae00 2023-10-14T12:33:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 >> v2:172.21.15.123:3300/0 conn(0x7f365006e140 msgr2=0x7f3650175920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 --2- 172.21.15.72:0/2102206089 >> v2:172.21.15.123:3300/0 conn(0x7f365006e140 0x7f3650175920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 >> v1:172.21.15.72:6789/0 conn(0x7f365006dd60 legacy=0x7f365016e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500ca950 con 0x7f36500cae00 2023-10-14T12:33:51.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 <== mon.1 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f36480019f0 con 0x7f36500cae00 2023-10-14T12:33:51.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 >> v1:172.21.15.123:6789/0 conn(0x7f36500cae00 legacy=0x7f365016ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f91d265b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d265b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:42428/0 (socket says 172.21.15.72:42428) 2023-10-14T12:33:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d265b700 1 -- 172.21.15.72:0/3974285604 learned_addr learned my addr 172.21.15.72:0/3974285604 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d1659700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91cc0cb100 0x7f91cc0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d1e5a700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91cc06daf0 0x7f91cc14a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 --2- 172.21.15.72:0/2102206089 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3638003c10 0x7f36380085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 --2- 172.21.15.72:0/2102206089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3638008b00 0x7f363800aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 --2- 172.21.15.72:0/2102206089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f363800b630 0x7f363800daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500cd5a0 con 0x7f3638008b00 2023-10-14T12:33:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363800e3d0 con 0x7f363800b630 2023-10-14T12:33:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363800e590 con 0x7f3638003c10 2023-10-14T12:33:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.333+0000 7f364f7fe700 1 --2- 172.21.15.72:0/2102206089 >> v2:172.21.15.123:3300/0 conn(0x7f365006e140 0x7f3650175920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:51.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f364f7fe700 1 --2- 172.21.15.72:0/2102206089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f363800b630 0x7f363800daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d265b700 1 -- 172.21.15.72:0/3974285604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91cc06daf0 msgr2=0x7f91cc14a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d265b700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91cc06daf0 0x7f91cc14a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d265b700 1 -- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91cc0cb100 msgr2=0x7f91cc0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d265b700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91cc0cb100 0x7f91cc0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d265b700 1 -- 172.21.15.72:0/3974285604 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c8009550 con 0x7f91cc15d9a0 2023-10-14T12:33:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91d265b700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0b22a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f91c400efc0 tx=0x7f91c400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f364f7fe700 1 -- 172.21.15.72:0/2102206089 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3638003c10 msgr2=0x7f36380085c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:33:51.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f364f7fe700 1 --2- 172.21.15.72:0/2102206089 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3638003c10 0x7f36380085c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f364f7fe700 1 -- 172.21.15.72:0/2102206089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3638008b00 msgr2=0x7f363800aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f364f7fe700 1 --2- 172.21.15.72:0/2102206089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3638008b00 0x7f363800aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f364f7fe700 1 -- 172.21.15.72:0/2102206089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500ca950 con 0x7f363800b630 2023-10-14T12:33:51.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f364f7fe700 1 -- 172.21.15.72:0/2102206089 reap_dead start 2023-10-14T12:33:51.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f91c27fc700 1 -- 172.21.15.72:0/3974285604 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c400cd40 con 0x7f91cc15d9a0 2023-10-14T12:33:51.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.334+0000 7f364f7fe700 1 --2- 172.21.15.72:0/2102206089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f363800b630 0x7f363800daf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f364000a6b0 tx=0x7f3638003780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1d2d30a88f2c840 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.335+0000 7f91c27fc700 1 -- 172.21.15.72:0/3974285604 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c400f040 con 0x7f91cc15d9a0 2023-10-14T12:33:51.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.335+0000 7f91c27fc700 1 -- 172.21.15.72:0/3974285604 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c40146c0 con 0x7f91cc15d9a0 2023-10-14T12:33:51.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.335+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc0af270 con 0x7f91cc15d9a0 2023-10-14T12:33:51.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.335+0000 7fc597fff700 1 Processor -- start 2023-10-14T12:33:51.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.335+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc0af830 con 0x7f91cc15d9a0 2023-10-14T12:33:51.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7f187b96d700 1 Processor -- start 2023-10-14T12:33:51.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7f187b96d700 1 -- start start 2023-10-14T12:33:51.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.335+0000 7fc597fff700 1 -- start start 2023-10-14T12:33:51.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7fc597fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5980ade20 0x7fc598155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7fc597fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5980c1f10 0x7fc5980c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7fc597fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc5980ce950 0x7fc5980c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7fc597fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980c7aa0 con 0x7fc5980ade20 2023-10-14T12:33:51.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7fc597fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980c8bd0 con 0x7fc5980c1f10 2023-10-14T12:33:51.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7fc597fff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980c7ce0 con 0x7fc5980ce950 2023-10-14T12:33:51.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7fc5967fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5980c1f10 0x7fc5980c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7fc5967fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5980c1f10 0x7fc5980c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:34936/0 (socket says 172.21.15.72:34936) 2023-10-14T12:33:51.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7fc5967fc700 1 -- 172.21.15.72:0/1412974333 learned_addr learned my addr 172.21.15.72:0/1412974333 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000c880 con 0x7f363800b630 2023-10-14T12:33:51.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364000c9e0 con 0x7f363800b630 2023-10-14T12:33:51.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7f364dffb700 1 -- 172.21.15.72:0/2102206089 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000cd50 con 0x7f363800b630 2023-10-14T12:33:51.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.336+0000 7f365533f700 1 -- 172.21.15.72:0/2102206089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f363800b630 msgr2=0x7f363800daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f365533f700 1 --2- 172.21.15.72:0/2102206089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f363800b630 0x7f363800daf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f364000a6b0 tx=0x7f3638003780 comp rx=0 tx=0).stop 2023-10-14T12:33:51.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7ff385f2f700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff36406af00 0x7ff36406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7fc596ffd700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5980ade20 0x7fc598155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7fc5967fc700 1 -- 172.21.15.72:0/1412974333 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc5980ce950 msgr2=0x7fc5980c7560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:33:51.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7fc5967fc700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc5980ce950 0x7fc5980c7560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7fc5967fc700 1 -- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5980ade20 msgr2=0x7fc598155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7fc5967fc700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5980ade20 0x7fc598155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7fc5967fc700 1 -- 172.21.15.72:0/1412974333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588009550 con 0x7fc5980c1f10 2023-10-14T12:33:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7fc596ffd700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5980ade20 0x7fc598155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91cc0c98f0 con 0x7f91cc15d9a0 2023-10-14T12:33:51.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7fc5967fc700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5980c1f10 0x7fc5980c7020 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00b580 tx=0x7fc58c00b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7ff385f2f700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff36406af00 0x7ff36406d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff370000c00 tx=0x7ff370009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f187b96d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f187415d9a0 0x7f18740ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f187b96d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187406eba0 con 0x7f187406daf0 2023-10-14T12:33:51.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f187b96d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187406ee80 con 0x7f18740cb100 2023-10-14T12:33:51.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f187b96d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187415dd80 con 0x7f187415d9a0 2023-10-14T12:33:51.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f1879709700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f187415d9a0 0x7f18740ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f1878f08700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f187406daf0 0x7f18740ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53092/0 (socket says 172.21.15.72:53092) 2023-10-14T12:33:51.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f1879709700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f187415d9a0 0x7f18740ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:34942/0 (socket says 172.21.15.72:34942) 2023-10-14T12:33:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f1878f08700 1 -- 172.21.15.72:0/3486541153 learned_addr learned my addr 172.21.15.72:0/3486541153 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f365533f700 1 -- 172.21.15.72:0/2102206089 shutdown_connections 2023-10-14T12:33:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f365533f700 1 --2- 172.21.15.72:0/2102206089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f363800b630 0x7f363800daf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f365533f700 1 -- 172.21.15.72:0/2102206089 >> 172.21.15.72:0/2102206089 conn(0x7f36500cbad0 msgr2=0x7f36500cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f91c27fc700 1 -- 172.21.15.72:0/3974285604 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f91c4014820 con 0x7f91cc15d9a0 2023-10-14T12:33:51.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7f365533f700 1 -- 172.21.15.72:0/2102206089 shutdown_connections 2023-10-14T12:33:51.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.337+0000 7fc57f7fe700 1 -- 172.21.15.72:0/1412974333 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c011830 con 0x7fc5980c1f10 2023-10-14T12:33:51.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7fc57f7fe700 1 -- 172.21.15.72:0/1412974333 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c0119b0 con 0x7fc5980c1f10 2023-10-14T12:33:51.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7fc57f7fe700 1 -- 172.21.15.72:0/1412974333 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c011d60 con 0x7fc5980c1f10 2023-10-14T12:33:51.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5980c7fc0 con 0x7fc5980c1f10 2023-10-14T12:33:51.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5980c8580 con 0x7fc5980c1f10 2023-10-14T12:33:51.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f365533f700 1 -- 172.21.15.72:0/2102206089 wait complete. 2023-10-14T12:33:51.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f1879709700 1 -- 172.21.15.72:0/3486541153 >> v1:172.21.15.123:6789/0 conn(0x7f18740cb100 legacy=0x7f18740cd480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:33:51.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f1879709700 1 -- 172.21.15.72:0/3486541153 >> v1:172.21.15.72:6789/0 conn(0x7f187406daf0 legacy=0x7f18740ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f1879709700 1 -- 172.21.15.72:0/3486541153 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18740c9610 con 0x7f187415d9a0 2023-10-14T12:33:51.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f1879709700 1 --2- 172.21.15.72:0/3486541153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187415d9a0 0x7f18740ad1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1870009840 tx=0x7f1870009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46fe8219c225f74a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7ff386730700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7ff364074440 0x7ff364076880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f91c27fc700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f91b006afd0 0x7f91b006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f91c27fc700 1 -- 172.21.15.72:0/3974285604 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91c408a5b0 con 0x7f91cc15d9a0 2023-10-14T12:33:51.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f91c27fc700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7f91b0074610 0x7f91b0076a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f91c27fc700 1 -- 172.21.15.72:0/3974285604 --> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91b0077120 con 0x7f91b0074610 2023-10-14T12:33:51.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7ff386730700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7ff364074440 0x7ff364076880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f91c27fc700 1 -- 172.21.15.72:0/3974285604 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91c408cbd0 con 0x7f91cc15d9a0 2023-10-14T12:33:51.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f2bb7fff700 1 -- 172.21.15.72:0/1298097128 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2bc4018360 con 0x7f2bd00c9610 2023-10-14T12:33:51.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f2bb7fff700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2bbc06af30 0x7f2bbc06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.338+0000 7f2bb7fff700 1 -- 172.21.15.72:0/1298097128 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2bc40897e0 con 0x7f2bd00c9610 2023-10-14T12:33:51.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.339+0000 7f2bb7fff700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f2bbc0744f0 0x7f2bbc076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.339+0000 7f2bb7fff700 1 -- 172.21.15.72:0/1298097128 --> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2bbc077000 con 0x7f2bbc0744f0 2023-10-14T12:33:51.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.339+0000 7f2bcffff700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f2bbc0744f0 0x7f2bbc076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.339+0000 7f1d20a7d700 1 Processor -- start 2023-10-14T12:33:51.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.339+0000 7f2bcffff700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f2bbc0744f0 0x7f2bbc076930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7fc57f7fe700 1 -- 172.21.15.72:0/1412974333 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc58c01a400 con 0x7fc5980c1f10 2023-10-14T12:33:51.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7fc57f7fe700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc58406afd0 0x7fc58406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7fc57f7fe700 1 -- 172.21.15.72:0/1412974333 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc58c089a30 con 0x7fc5980c1f10 2023-10-14T12:33:51.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7f2bceffd700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2bbc06af30 0x7f2bbc06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7ff3767fc700 1 -- 172.21.15.72:0/661237482 <== osd.5 v2:172.21.15.123:6809/1151915294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff364076f50 con 0x7ff364074440 2023-10-14T12:33:51.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7f186bfff700 1 -- 172.21.15.72:0/3486541153 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870004230 con 0x7f187415d9a0 2023-10-14T12:33:51.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7f186bfff700 1 -- 172.21.15.72:0/3486541153 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870004390 con 0x7f187415d9a0 2023-10-14T12:33:51.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7f186bfff700 1 -- 172.21.15.72:0/3486541153 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700036a0 con 0x7f187415d9a0 2023-10-14T12:33:51.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7f365533f700 1 Processor -- start 2023-10-14T12:33:51.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.340+0000 7f91d1e5a700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f91b006afd0 0x7f91b006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f187b96d700 1 -- 172.21.15.72:0/3486541153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187415d9a0 msgr2=0x7f18740ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f187b96d700 1 --2- 172.21.15.72:0/3486541153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187415d9a0 0x7f18740ad1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1870009840 tx=0x7f1870009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:51.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.339+0000 7f1d20a7d700 1 -- start start 2023-10-14T12:33:51.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d20a7d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d1c161830 0x7f1d1c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d20a7d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1d1c0c2080 0x7f1d1c0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d20a7d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c0cd0b0 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d20a7d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0ccef0 con 0x7f1d1c161830 2023-10-14T12:33:51.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d20a7d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0cc210 con 0x7f1d1c0c2080 2023-10-14T12:33:51.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d19d9b700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1d1c0c25d0 0x7f1d1c1654c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51306/0 (socket says 172.21.15.72:51306) 2023-10-14T12:33:51.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d19d9b700 1 -- 172.21.15.72:0/3925342129 learned_addr learned my addr 172.21.15.72:0/3925342129 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d1ad9d700 1 --2- 172.21.15.72:0/3925342129 >> v2:172.21.15.123:3300/0 conn(0x7f1d1c0c2080 0x7f1d1c0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7fc597fff700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7fc5780015e0 0x7fc578003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 --> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc578006bd0 con 0x7fc5780015e0 2023-10-14T12:33:51.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7fc5977fe700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7fc5780015e0 0x7fc578003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d1ad9d700 1 -- 172.21.15.72:0/3925342129 >> v2:172.21.15.72:3300/0 conn(0x7f1d1c161830 msgr2=0x7f1d1c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d1ad9d700 1 --2- 172.21.15.72:0/3925342129 >> v2:172.21.15.72:3300/0 conn(0x7f1d1c161830 0x7f1d1c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d1ad9d700 1 -- 172.21.15.72:0/3925342129 >> v1:172.21.15.123:6789/0 conn(0x7f1d1c0c25d0 legacy=0x7f1d1c1654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f1d1ad9d700 1 -- 172.21.15.72:0/3925342129 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c070650 con 0x7f1d1c0c2080 2023-10-14T12:33:51.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f365533f700 1 -- start start 2023-10-14T12:33:51.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f365533f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363800b630 0x7f3650089fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f365533f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f365016da40 0x7f36500b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7fc5977fe700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7fc5780015e0 0x7fc578003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f91d1e5a700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f91b006afd0 0x7f91b006d490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009c40 tx=0x7f91c8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.341+0000 7f2bceffd700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2bbc06af30 0x7f2bbc06d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00b5080 tx=0x7f2bc0007b30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f2bb7fff700 1 -- 172.21.15.72:0/1298097128 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bc400a440 con 0x7f2bd00c9610 2023-10-14T12:33:51.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f2bb7fff700 1 -- 172.21.15.72:0/1298097128 <== osd.2 v2:172.21.15.72:6816/1435036879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2bbc077000 con 0x7f2bbc0744f0 2023-10-14T12:33:51.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f1d1ad9d700 1 --2- 172.21.15.72:0/3925342129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c0c2080 0x7f1d1c0cbcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0c2a80 tx=0x7f1d1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a57dc33933de92 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f187b96d700 1 -- 172.21.15.72:0/3486541153 shutdown_connections 2023-10-14T12:33:51.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f187b96d700 1 --2- 172.21.15.72:0/3486541153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187415d9a0 0x7f18740ad1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f187b96d700 1 -- 172.21.15.72:0/3486541153 >> 172.21.15.72:0/3486541153 conn(0x7f18740cbad0 msgr2=0x7f18740cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f187b96d700 1 -- 172.21.15.72:0/3486541153 shutdown_connections 2023-10-14T12:33:51.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f365533f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365016cd90 0x7f365016d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f365533f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365008a4e0 con 0x7f363800b630 2023-10-14T12:33:51.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f365533f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365016d760 con 0x7f365016da40 2023-10-14T12:33:51.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f365533f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500a8b40 con 0x7f365016cd90 2023-10-14T12:33:51.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f364effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363800b630 0x7f3650089fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f364effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363800b630 0x7f3650089fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46818/0 (socket says 172.21.15.72:46818) 2023-10-14T12:33:51.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f364effd700 1 -- 172.21.15.72:0/3480493724 learned_addr learned my addr 172.21.15.72:0/3480493724 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f364effd700 1 -- 172.21.15.72:0/3480493724 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365016cd90 msgr2=0x7f365016d220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:33:51.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f364effd700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f365016cd90 0x7f365016d220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f364effd700 1 -- 172.21.15.72:0/3480493724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f365016da40 msgr2=0x7f36500b4100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:33:51.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f364effd700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f365016da40 0x7f36500b4100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f364effd700 1 -- 172.21.15.72:0/3480493724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500a8e20 con 0x7f363800b630 2023-10-14T12:33:51.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.343+0000 7f91d1659700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7f91b0074610 0x7f91b0076a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7fc596ffd700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc58406afd0 0x7fc58406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7fc57f7fe700 1 -- 172.21.15.72:0/1412974333 <== osd.0 v2:172.21.15.72:6800/608326575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc578006bd0 con 0x7fc5780015e0 2023-10-14T12:33:51.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7fc596ffd700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc58406afd0 0x7fc58406d490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc5980c1bb0 tx=0x7fc588008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f1d1959a700 1 -- 172.21.15.72:0/3925342129 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400e070 con 0x7f1d1c0c2080 2023-10-14T12:33:51.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f1d1959a700 1 -- 172.21.15.72:0/3925342129 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1400bad0 con 0x7f1d1c0c2080 2023-10-14T12:33:51.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f1d1959a700 1 -- 172.21.15.72:0/3925342129 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400be80 con 0x7f1d1c0c2080 2023-10-14T12:33:51.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.343+0000 7f1d20a7d700 1 -- 172.21.15.72:0/3925342129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c0c2080 msgr2=0x7f1d1c0cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.343+0000 7f1d20a7d700 1 --2- 172.21.15.72:0/3925342129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c0c2080 0x7f1d1c0cbcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0c2a80 tx=0x7f1d1400b330 comp rx=0 tx=0).stop 2023-10-14T12:33:51.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.344+0000 7f1d20a7d700 1 -- 172.21.15.72:0/3925342129 shutdown_connections 2023-10-14T12:33:51.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.344+0000 7f1d20a7d700 1 --2- 172.21.15.72:0/3925342129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c0c2080 0x7f1d1c0cbcd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.344+0000 7f1d20a7d700 1 --2- 172.21.15.72:0/3925342129 >> v2:172.21.15.72:3300/0 conn(0x7f1d1c161830 0x7f1d1c0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.344+0000 7f1d20a7d700 1 -- 172.21.15.72:0/3925342129 >> 172.21.15.72:0/3925342129 conn(0x7f1d1c0b0ae0 msgr2=0x7f1d1c0b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.344+0000 7f1d20a7d700 1 -- 172.21.15.72:0/3925342129 shutdown_connections 2023-10-14T12:33:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.344+0000 7f1d20a7d700 1 -- 172.21.15.72:0/3925342129 wait complete. 2023-10-14T12:33:51.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7f1d20a7d700 1 Processor -- start 2023-10-14T12:33:51.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.342+0000 7f187b96d700 1 -- 172.21.15.72:0/3486541153 wait complete. 2023-10-14T12:33:51.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.344+0000 7f187b96d700 1 Processor -- start 2023-10-14T12:33:51.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.344+0000 7f187b96d700 1 -- start start 2023-10-14T12:33:51.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.345+0000 7f187b96d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187406daf0 0x7f18740b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.345+0000 7f187b96d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f18740cb100 0x7f18740b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.345+0000 7f187b96d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f187415d9a0 0x7f18742026d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.345+0000 7f187b96d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18740b22a0 con 0x7f187415d9a0 2023-10-14T12:33:51.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.345+0000 7f187b96d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18740b45b0 con 0x7f187406daf0 2023-10-14T12:33:51.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.345+0000 7f187b96d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18740b4890 con 0x7f18740cb100 2023-10-14T12:33:51.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7f1879f0a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f187415d9a0 0x7f18742026d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7f1878f08700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f18740cb100 0x7f18740b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7f1879f0a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f187415d9a0 0x7f18742026d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46826/0 (socket says 172.21.15.72:46826) 2023-10-14T12:33:51.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7f1879f0a700 1 -- 172.21.15.72:0/2655119470 learned_addr learned my addr 172.21.15.72:0/2655119470 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f1879f0a700 1 -- 172.21.15.72:0/2655119470 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f18740cb100 msgr2=0x7f18740b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f1879f0a700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f18740cb100 0x7f18740b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f1879f0a700 1 -- 172.21.15.72:0/2655119470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187406daf0 msgr2=0x7f18740b1550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:33:51.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f1879f0a700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f187406daf0 0x7f18740b1550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f1879f0a700 1 -- 172.21.15.72:0/2655119470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700094a0 con 0x7f187415d9a0 2023-10-14T12:33:51.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.343+0000 7f364effd700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363800b630 0x7f3650089fa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3650067730 tx=0x7f364400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.343+0000 7f36377fe700 1 -- 172.21.15.72:0/3480493724 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36440054e0 con 0x7f363800b630 2023-10-14T12:33:51.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.343+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36500a9100 con 0x7f363800b630 2023-10-14T12:33:51.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.343+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36500a96c0 con 0x7f363800b630 2023-10-14T12:33:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.343+0000 7f36377fe700 1 -- 172.21.15.72:0/3480493724 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364400ce50 con 0x7f363800b630 2023-10-14T12:33:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.343+0000 7f36377fe700 1 -- 172.21.15.72:0/3480493724 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644003880 con 0x7f363800b630 2023-10-14T12:33:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.344+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3630000fc0 con 0x7f363800b630 2023-10-14T12:33:51.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7f36377fe700 1 -- 172.21.15.72:0/3480493724 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36440039e0 con 0x7f363800b630 2023-10-14T12:33:51.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f1d20a7d700 1 -- start start 2023-10-14T12:33:51.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d20a7d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c0c2080 0x7f1d1c0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d20a7d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c0c25d0 0x7f1d1c0c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d20a7d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d1c161830 0x7f1d1c0c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d20a7d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c9e40 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d20a7d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c17b960 con 0x7f1d1c0c2080 2023-10-14T12:33:51.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d20a7d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c91c0 con 0x7f1d1c161830 2023-10-14T12:33:51.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d19d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c0c25d0 0x7f1d1c0c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d19d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c0c25d0 0x7f1d1c0c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46830/0 (socket says 172.21.15.72:46830) 2023-10-14T12:33:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d19d9b700 1 -- 172.21.15.72:0/1649974729 learned_addr learned my addr 172.21.15.72:0/1649974729 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f1d1a59c700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c0c2080 0x7f1d1c0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d19d9b700 1 -- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d1c161830 msgr2=0x7f1d1c0c4c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:33:51.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d19d9b700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d1c161830 0x7f1d1c0c4c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d19d9b700 1 -- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c0c2080 msgr2=0x7f1d1c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d19d9b700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c0c2080 0x7f1d1c0c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d19d9b700 1 -- 172.21.15.72:0/1649974729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d14009a70 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d19d9b700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c0c25d0 0x7f1d1c0c8770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000c780 tx=0x7f1d1000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1879f0a700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f187415d9a0 0x7f18742026d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f186c00b7b0 tx=0x7f186c00bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1869ffb700 1 -- 172.21.15.72:0/2655119470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c010800 con 0x7f187415d9a0 2023-10-14T12:33:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1869ffb700 1 -- 172.21.15.72:0/2655119470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c010960 con 0x7f187415d9a0 2023-10-14T12:33:51.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1869ffb700 1 -- 172.21.15.72:0/2655119470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c010d10 con 0x7f187415d9a0 2023-10-14T12:33:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d0affd700 1 -- 172.21.15.72:0/1649974729 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10004c80 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d0affd700 1 -- 172.21.15.72:0/1649974729 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d10004de0 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d0affd700 1 -- 172.21.15.72:0/1649974729 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10007310 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f91d1659700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7f91b0074610 0x7f91b0076a50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.348+0000 7f91c27fc700 1 -- 172.21.15.72:0/3974285604 <== osd.1 v2:172.21.15.72:6808/1445654978 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f91b0077120 con 0x7f91b0074610 2023-10-14T12:33:51.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.349+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c0c94a0 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.350+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c0c9a60 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.351+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d1c0cd5e0 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.353+0000 7f1d0affd700 1 -- 172.21.15.72:0/1649974729 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d10007470 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.353+0000 7f1d0affd700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af80 0x7f1cfc06d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.353+0000 7f1d0affd700 1 -- 172.21.15.72:0/1649974729 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d10089520 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.353+0000 7f1d1a59c700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af80 0x7f1cfc06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.353+0000 7f1d0affd700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f1cfc0745c0 0x7f1cfc076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.353+0000 7f1d0affd700 1 -- 172.21.15.72:0/1649974729 --> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1cfc0770d0 con 0x7f1cfc0745c0 2023-10-14T12:33:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.353+0000 7f1d0affd700 1 -- 172.21.15.72:0/1649974729 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d1008bc30 con 0x7f1d1c0c25d0 2023-10-14T12:33:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.354+0000 7f1d1a59c700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af80 0x7f1cfc06d440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009a10 tx=0x7f1d0c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.358+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 --> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d10002d40 con 0x7f3d14074510 2023-10-14T12:33:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.358+0000 7f3d25ffb700 1 -- 172.21.15.72:0/1363513618 <== osd.3 v2:172.21.15.72:6824/2591734444 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d10002d40 con 0x7f3d14074510 2023-10-14T12:33:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.346+0000 7f36377fe700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f363c06af00 0x7f363c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f36377fe700 1 -- 172.21.15.72:0/3480493724 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3644089710 con 0x7f363800b630 2023-10-14T12:33:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f36377fe700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f363c0744c0 0x7f363c076900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f36377fe700 1 -- 172.21.15.72:0/3480493724 --> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f363c076fd0 con 0x7f363c0744c0 2023-10-14T12:33:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.347+0000 7f36377fe700 1 -- 172.21.15.72:0/3480493724 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3644089b60 con 0x7f363800b630 2023-10-14T12:33:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.350+0000 7f364e7fc700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f363c06af00 0x7f363c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.351+0000 7f364e7fc700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f363c06af00 0x7f363c06d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f36480012e0 tx=0x7f36480018a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.352+0000 7f364f7fe700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f363c0744c0 0x7f363c076900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.352+0000 7f364f7fe700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f363c0744c0 0x7f363c076900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.353+0000 7f36377fe700 1 -- 172.21.15.72:0/3480493724 <== osd.7 v2:172.21.15.123:6824/4045319468 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f363c076fd0 con 0x7f363c0744c0 2023-10-14T12:33:51.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18740b4b70 con 0x7f187415d9a0 2023-10-14T12:33:51.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f1d1ad9d700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f1cfc0745c0 0x7f1cfc076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7f3d14074510 msgr2=0x7f3d14076950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f3d37781700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7f3d14074510 0x7f3d14076950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1874202df0 con 0x7f187415d9a0 2023-10-14T12:33:51.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d1406af50 msgr2=0x7f3d1406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f3d37781700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d1406af50 0x7f3d1406d410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009bc0 tx=0x7f3d20008030 comp rx=0 tx=0).stop 2023-10-14T12:33:51.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300d0ca0 msgr2=0x7f3d300b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f3d37781700 1 --2- 172.21.15.72:0/1363513618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d300d0ca0 0x7f3d300b0c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800caa0 tx=0x7f3d2800ce60 comp rx=0 tx=0).stop 2023-10-14T12:33:51.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f3d35d1e700 1 -- 172.21.15.72:0/1363513618 reap_dead start 2023-10-14T12:33:51.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 shutdown_connections 2023-10-14T12:33:51.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.359+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 >> 172.21.15.72:0/1363513618 conn(0x7f3d300d0180 msgr2=0x7f3d300d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.360+0000 7f1869ffb700 1 -- 172.21.15.72:0/2655119470 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f186c021350 con 0x7f187415d9a0 2023-10-14T12:33:51.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.360+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 shutdown_connections 2023-10-14T12:33:51.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.361+0000 7f3d37781700 1 -- 172.21.15.72:0/1363513618 wait complete. 2023-10-14T12:33:51.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.361+0000 7f1869ffb700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f185806af00 0x7f185806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.361+0000 7f1869ffb700 1 -- 172.21.15.72:0/2655119470 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f186c089a40 con 0x7f187415d9a0 2023-10-14T12:33:51.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.364+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 --> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bd0165820 con 0x7f2bbc0744f0 2023-10-14T12:33:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.365+0000 7f2bb7fff700 1 -- 172.21.15.72:0/1298097128 <== osd.2 v2:172.21.15.72:6816/1435036879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2bc8003d20 con 0x7f2bbc0744f0 2023-10-14T12:33:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.363+0000 7f1879709700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f185806af00 0x7f185806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.363+0000 7f1879709700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f185806af00 0x7f185806d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1870009b90 tx=0x7f1870008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.365+0000 7f187b96d700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f18740b36c0 0x7f18740b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.365+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 --> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18740c9bd0 con 0x7f18740b36c0 2023-10-14T12:33:51.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.366+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f2bbc0744f0 msgr2=0x7f2bbc076930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.366+0000 7f2bd5b27700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f2bbc0744f0 0x7f2bbc076930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.366+0000 7f1d1ad9d700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f1cfc0745c0 0x7f1cfc076a00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.367+0000 7f1d0affd700 1 -- 172.21.15.72:0/1649974729 <== osd.4 v2:172.21.15.123:6800/2822863008 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1cfc0770d0 con 0x7f1cfc0745c0 2023-10-14T12:33:51.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.368+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2bbc06af30 msgr2=0x7f2bbc06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.368+0000 7f2bd5b27700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2bbc06af30 0x7f2bbc06d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00b5080 tx=0x7f2bc0007b30 comp rx=0 tx=0).stop 2023-10-14T12:33:51.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.368+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bd00c9610 msgr2=0x7f2bd0149680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.368+0000 7f2bd5b27700 1 --2- 172.21.15.72:0/1298097128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2bd00c9610 0x7f2bd0149680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c7f0 tx=0x7f2bc400cb00 comp rx=0 tx=0).stop 2023-10-14T12:33:51.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.368+0000 7f2bcffff700 1 -- 172.21.15.72:0/1298097128 reap_dead start 2023-10-14T12:33:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.370+0000 7f1878f08700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f18740b36c0 0x7f18740b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.370+0000 7f1878f08700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f18740b36c0 0x7f18740b3aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.371+0000 7f1869ffb700 1 -- 172.21.15.72:0/2655119470 <== osd.6 v2:172.21.15.123:6808/3866020482 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1864001580 con 0x7f18740b36c0 2023-10-14T12:33:51.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.373+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 --> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3800aa780 con 0x7ff364074440 2023-10-14T12:33:51.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.373+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 shutdown_connections 2023-10-14T12:33:51.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.373+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 >> 172.21.15.72:0/1298097128 conn(0x7f2bd006c850 msgr2=0x7f2bd014c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.373+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 shutdown_connections 2023-10-14T12:33:51.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.373+0000 7f2bd5b27700 1 -- 172.21.15.72:0/1298097128 wait complete. 2023-10-14T12:33:51.462 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:51.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T12:33:51.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.379+0000 7ff3767fc700 1 -- 172.21.15.72:0/661237482 <== osd.5 v2:172.21.15.123:6809/1151915294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff3800aa780 con 0x7ff364074440 2023-10-14T12:33:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.380+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 --> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc578005cb0 con 0x7fc5780015e0 2023-10-14T12:33:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.381+0000 7fc57f7fe700 1 -- 172.21.15.72:0/1412974333 <== osd.0 v2:172.21.15.72:6800/608326575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc578005cb0 con 0x7fc5780015e0 2023-10-14T12:33:51.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.381+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 --> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91cc0c9610 con 0x7f91b0074610 2023-10-14T12:33:51.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.381+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7fc5780015e0 msgr2=0x7fc578003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.381+0000 7fc597fff700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7fc5780015e0 0x7fc578003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.381+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc58406afd0 msgr2=0x7fc58406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.381+0000 7fc597fff700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc58406afd0 0x7fc58406d490 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc5980c1bb0 tx=0x7fc588008030 comp rx=0 tx=0).stop 2023-10-14T12:33:51.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.381+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5980c1f10 msgr2=0x7fc5980c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.381+0000 7fc597fff700 1 --2- 172.21.15.72:0/1412974333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5980c1f10 0x7fc5980c7020 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00b580 tx=0x7fc58c00b940 comp rx=0 tx=0).stop 2023-10-14T12:33:51.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.381+0000 7fc5977fe700 1 -- 172.21.15.72:0/1412974333 reap_dead start 2023-10-14T12:33:51.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 shutdown_connections 2023-10-14T12:33:51.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 >> 172.21.15.72:0/1412974333 conn(0x7fc5980cef40 msgr2=0x7fc5980cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7ff364074440 msgr2=0x7ff364076880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7ff364074440 0x7ff364076880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff36406af00 msgr2=0x7ff36406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff36406af00 0x7ff36406d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff370000c00 tx=0x7ff370009030 comp rx=0 tx=0).stop 2023-10-14T12:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006e140 msgr2=0x7ff3800a8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 --2- 172.21.15.72:0/661237482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff38006e140 0x7ff3800a8fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00b450 tx=0x7ff37c00b810 comp rx=0 tx=0).stop 2023-10-14T12:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff386730700 1 -- 172.21.15.72:0/661237482 reap_dead start 2023-10-14T12:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 shutdown_connections 2023-10-14T12:33:51.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 >> 172.21.15.72:0/661237482 conn(0x7ff3800cbad0 msgr2=0x7ff3800c3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 shutdown_connections 2023-10-14T12:33:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.382+0000 7ff388193700 1 -- 172.21.15.72:0/661237482 wait complete. 2023-10-14T12:33:51.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.384+0000 7f91c27fc700 1 -- 172.21.15.72:0/3974285604 <== osd.1 v2:172.21.15.72:6808/1445654978 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f91bc001590 con 0x7f91b0074610 2023-10-14T12:33:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.385+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 --> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3630002d40 con 0x7f363c0744c0 2023-10-14T12:33:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.385+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 shutdown_connections 2023-10-14T12:33:51.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.385+0000 7fc597fff700 1 -- 172.21.15.72:0/1412974333 wait complete. 2023-10-14T12:33:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f36377fe700 1 -- 172.21.15.72:0/3480493724 <== osd.7 v2:172.21.15.123:6824/4045319468 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3630002d40 con 0x7f363c0744c0 2023-10-14T12:33:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7f91b0074610 msgr2=0x7f91b0076a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7f91b0074610 0x7f91b0076a50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 --> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d1c0cd300 con 0x7f1cfc0745c0 2023-10-14T12:33:51.474 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:51.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T12:33:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f91b006afd0 msgr2=0x7f91b006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f91b006afd0 0x7f91b006d490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009c40 tx=0x7f91c8008030 comp rx=0 tx=0).stop 2023-10-14T12:33:51.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 msgr2=0x7f91cc0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 --2- 172.21.15.72:0/3974285604 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f91cc15d9a0 0x7f91cc0b22a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f91c400efc0 tx=0x7f91c400c3a0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d265b700 1 -- 172.21.15.72:0/3974285604 reap_dead start 2023-10-14T12:33:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 shutdown_connections 2023-10-14T12:33:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 >> 172.21.15.72:0/3974285604 conn(0x7f91cc0cbad0 msgr2=0x7f91cc15b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 shutdown_connections 2023-10-14T12:33:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f91d40be700 1 -- 172.21.15.72:0/3974285604 wait complete. 2023-10-14T12:33:51.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.387+0000 7f1d0affd700 1 -- 172.21.15.72:0/1649974729 <== osd.4 v2:172.21.15.123:6800/2822863008 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d1400bd80 con 0x7f1cfc0745c0 2023-10-14T12:33:51.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.388+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f1cfc0745c0 msgr2=0x7f1cfc076a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.388+0000 7f1d20a7d700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f1cfc0745c0 0x7f1cfc076a00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.388+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af80 msgr2=0x7f1cfc06d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.388+0000 7f1d20a7d700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af80 0x7f1cfc06d440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c009a10 tx=0x7f1d0c009190 comp rx=0 tx=0).stop 2023-10-14T12:33:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.388+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c0c25d0 msgr2=0x7f1d1c0c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.388+0000 7f1d20a7d700 1 --2- 172.21.15.72:0/1649974729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c0c25d0 0x7f1d1c0c8770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000c780 tx=0x7f1d1000ca90 comp rx=0 tx=0).stop 2023-10-14T12:33:51.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.388+0000 7f1d1ad9d700 1 -- 172.21.15.72:0/1649974729 reap_dead start 2023-10-14T12:33:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f363c0744c0 msgr2=0x7f363c076900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f363c0744c0 0x7f363c076900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f363c06af00 msgr2=0x7f363c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f363c06af00 0x7f363c06d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f36480012e0 tx=0x7f36480018a0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363800b630 msgr2=0x7f3650089fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 --2- 172.21.15.72:0/3480493724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f363800b630 0x7f3650089fa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3650067730 tx=0x7f364400c6a0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f364f7fe700 1 -- 172.21.15.72:0/3480493724 reap_dead start 2023-10-14T12:33:51.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 shutdown_connections 2023-10-14T12:33:51.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 >> 172.21.15.72:0/3480493724 conn(0x7f36500cbad0 msgr2=0x7f36500aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 shutdown_connections 2023-10-14T12:33:51.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.389+0000 7f365533f700 1 -- 172.21.15.72:0/3480493724 wait complete. 2023-10-14T12:33:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.392+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 shutdown_connections 2023-10-14T12:33:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.392+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 >> 172.21.15.72:0/1649974729 conn(0x7f1d1c0b0ae0 msgr2=0x7f1d1c0aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.392+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 shutdown_connections 2023-10-14T12:33:51.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.392+0000 7f1d20a7d700 1 -- 172.21.15.72:0/1649974729 wait complete. 2023-10-14T12:33:51.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.397+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 --> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18740c98f0 con 0x7f18740b36c0 2023-10-14T12:33:51.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.397+0000 7f1869ffb700 1 -- 172.21.15.72:0/2655119470 <== osd.6 v2:172.21.15.123:6808/3866020482 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f18640019c0 con 0x7f18740b36c0 2023-10-14T12:33:51.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.402+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f18740b36c0 msgr2=0x7f18740b3aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.402+0000 7f187b96d700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f18740b36c0 0x7f18740b3aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.403+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f185806af00 msgr2=0x7f185806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.403+0000 7f187b96d700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f185806af00 0x7f185806d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1870009b90 tx=0x7f1870008030 comp rx=0 tx=0).stop 2023-10-14T12:33:51.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.403+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f187415d9a0 msgr2=0x7f18742026d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.403+0000 7f187b96d700 1 --2- 172.21.15.72:0/2655119470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f187415d9a0 0x7f18742026d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f186c00b7b0 tx=0x7f186c00bac0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.486 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-10-14T12:33:51.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T12:33:51.488 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-10-14T12:33:51.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T12:33:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.406+0000 7f1879f0a700 1 -- 172.21.15.72:0/2655119470 reap_dead start 2023-10-14T12:33:51.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.406+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 shutdown_connections 2023-10-14T12:33:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.406+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 >> 172.21.15.72:0/2655119470 conn(0x7f18740cbad0 msgr2=0x7f1874154530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.406+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 shutdown_connections 2023-10-14T12:33:51.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.406+0000 7f187b96d700 1 -- 172.21.15.72:0/2655119470 wait complete. 2023-10-14T12:33:51.491 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:51.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T12:33:51.492 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-10-14T12:33:51.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T12:33:51.493 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:51.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T12:33:51.494 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:51.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T12:33:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.720+0000 7f069eac4700 1 Processor -- start 2023-10-14T12:33:51.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.720+0000 7f069eac4700 1 -- start start 2023-10-14T12:33:51.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.722+0000 7f069eac4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f069815a240 0x7f06980caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.722+0000 7f069eac4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06980aefb0 0x7f06980af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.722+0000 7f069eac4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069815e1b0 con 0x7f06980cb400 2023-10-14T12:33:51.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.722+0000 7f069eac4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06980af980 con 0x7f06980aefb0 2023-10-14T12:33:51.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.722+0000 7f069eac4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069815de60 con 0x7f069815a240 2023-10-14T12:33:51.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.722+0000 7f0697fff700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f06980cb400 0x7f069815e640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51346/0 (socket says 172.21.15.72:51346) 2023-10-14T12:33:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.722+0000 7f0697fff700 1 -- 172.21.15.72:0/2399785321 learned_addr learned my addr 172.21.15.72:0/2399785321 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.722+0000 7f069c860700 1 --2- 172.21.15.72:0/2399785321 >> v2:172.21.15.123:3300/0 conn(0x7f069815a240 0x7f06980caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.723+0000 7f069c860700 1 -- 172.21.15.72:0/2399785321 >> v2:172.21.15.72:3300/0 conn(0x7f06980aefb0 msgr2=0x7f06980af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.723+0000 7f069c860700 1 --2- 172.21.15.72:0/2399785321 >> v2:172.21.15.72:3300/0 conn(0x7f06980aefb0 0x7f06980af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.723+0000 7f069c860700 1 -- 172.21.15.72:0/2399785321 >> v1:172.21.15.123:6789/0 conn(0x7f06980cb400 legacy=0x7f069815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.723+0000 7f069c860700 1 -- 172.21.15.72:0/2399785321 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980cb9c0 con 0x7f069815a240 2023-10-14T12:33:51.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.723+0000 7f069c860700 1 --2- 172.21.15.72:0/2399785321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f069815a240 0x7f06980caa20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0698073e90 tx=0x7f0684009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68c6519bc518e3d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.726+0000 7f06977fe700 1 -- 172.21.15.72:0/2399785321 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011830 con 0x7f069815a240 2023-10-14T12:33:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.726+0000 7f06977fe700 1 -- 172.21.15.72:0/2399785321 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684011990 con 0x7f069815a240 2023-10-14T12:33:51.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.726+0000 7f06977fe700 1 -- 172.21.15.72:0/2399785321 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011d20 con 0x7f069815a240 2023-10-14T12:33:51.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.727+0000 7fc3d5035700 1 Processor -- start 2023-10-14T12:33:51.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.727+0000 7f069eac4700 1 -- 172.21.15.72:0/2399785321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f069815a240 msgr2=0x7f06980caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.727+0000 7f069eac4700 1 --2- 172.21.15.72:0/2399785321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f069815a240 0x7f06980caa20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0698073e90 tx=0x7f0684009b20 comp rx=0 tx=0).stop 2023-10-14T12:33:51.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.727+0000 7f07c646d700 1 Processor -- start 2023-10-14T12:33:51.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.727+0000 7f07c646d700 1 -- start start 2023-10-14T12:33:51.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f069eac4700 1 -- 172.21.15.72:0/2399785321 shutdown_connections 2023-10-14T12:33:51.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f069eac4700 1 --2- 172.21.15.72:0/2399785321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f069815a240 0x7f06980caa20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f069eac4700 1 --2- 172.21.15.72:0/2399785321 >> v2:172.21.15.72:3300/0 conn(0x7f06980aefb0 0x7f06980af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f069eac4700 1 -- 172.21.15.72:0/2399785321 >> 172.21.15.72:0/2399785321 conn(0x7f06980ccbd0 msgr2=0x7f06980ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f07c646d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07c0144ea0 0x7f07c015f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f07c646d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07c00cbc10 0x7f07c00cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f07c646d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c00cd4b0 con 0x7f07c00712e0 2023-10-14T12:33:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f07c646d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c015b8f0 con 0x7f07c0144ea0 2023-10-14T12:33:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f07c646d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00cc0c0 con 0x7f07c00cbc10 2023-10-14T12:33:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f07bffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f07c00712e0 0x7f07c00716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53152/0 (socket says 172.21.15.72:53152) 2023-10-14T12:33:51.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f07bffff700 1 -- 172.21.15.72:0/2958790683 learned_addr learned my addr 172.21.15.72:0/2958790683 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f108cfe4700 1 Processor -- start 2023-10-14T12:33:51.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7fa5aeb82700 1 Processor -- start 2023-10-14T12:33:51.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7fa5aeb82700 1 -- start start 2023-10-14T12:33:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937739161 0 0) 0x7f07c00cd4b0 con 0x7f07c00712e0 2023-10-14T12:33:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a80035b0 con 0x7f07c00712e0 2023-10-14T12:33:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3542648152 0 0) 0x7f07a80035b0 con 0x7f07c00712e0 2023-10-14T12:33:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07c00cbc10 msgr2=0x7f07c00cd940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:33:51.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07c00cbc10 0x7f07c00cd940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 >> v2:172.21.15.72:3300/0 conn(0x7f07c0144ea0 msgr2=0x7f07c015f790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:33:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 --2- 172.21.15.72:0/2958790683 >> v2:172.21.15.72:3300/0 conn(0x7f07c0144ea0 0x7f07c015f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c015fdb0 con 0x7f07c00712e0 2023-10-14T12:33:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f07b4001670 con 0x7f07c00712e0 2023-10-14T12:33:51.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 >> v1:172.21.15.72:6789/0 conn(0x7f07c00712e0 legacy=0x7f07c00716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07a8003a00 0x7f07a8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a8004850 0x7f07a8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a8005210 0x7f07a800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c015b8f0 con 0x7f07a8004850 2023-10-14T12:33:51.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00cc0c0 con 0x7f07a8005210 2023-10-14T12:33:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8010620 con 0x7f07a8003a00 2023-10-14T12:33:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7f07bffff700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07a8003a00 0x7f07a8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7fa5aeb82700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa5a8146150 0x7fa5a806a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7fa5aeb82700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5a80c5730 0x7fa5a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7fa5aeb82700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a81612c0 con 0x7fa5a806ad60 2023-10-14T12:33:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7fa5aeb82700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a806b210 con 0x7fa5a8146150 2023-10-14T12:33:51.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.729+0000 7fa5aeb82700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a8161560 con 0x7fa5a80c5730 2023-10-14T12:33:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.728+0000 7f108cfe4700 1 -- start start 2023-10-14T12:33:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f108cfe4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f108806eb10 0x7f1088164a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f108cfe4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10880c9a30 con 0x7f108806daf0 2023-10-14T12:33:51.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f108cfe4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10880c9cd0 con 0x7f10880cb210 2023-10-14T12:33:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f108cfe4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10880c9fb0 con 0x7f108806eb10 2023-10-14T12:33:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7fa5ad11f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5a80c5730 0x7fa5a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f108659c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f108806daf0 0x7f108806ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53162/0 (socket says 172.21.15.72:53162) 2023-10-14T12:33:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f108659c700 1 -- 172.21.15.72:0/4026088056 learned_addr learned my addr 172.21.15.72:0/4026088056 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7fa5ac91e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa5a8146150 0x7fa5a806a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7fa5ac91e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa5a8146150 0x7fa5a806a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46856/0 (socket says 172.21.15.72:46856) 2023-10-14T12:33:51.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7fa5ac91e700 1 -- 172.21.15.72:0/247608786 learned_addr learned my addr 172.21.15.72:0/247608786 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f1086d9d700 1 --2- 172.21.15.72:0/4026088056 >> v2:172.21.15.123:3300/0 conn(0x7f108806eb10 0x7f1088164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f07bf7fe700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a8004850 0x7f07a8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f1086d9d700 1 -- 172.21.15.72:0/4026088056 >> v1:172.21.15.123:6789/0 conn(0x7f10880cb210 legacy=0x7f1088161340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:33:51.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f1086d9d700 1 -- 172.21.15.72:0/4026088056 >> v1:172.21.15.72:6789/0 conn(0x7f108806daf0 legacy=0x7f108806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7fa5ac91e700 1 -- 172.21.15.72:0/247608786 >> v2:172.21.15.123:3300/0 conn(0x7fa5a80c5730 msgr2=0x7fa5a806edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7fa5ac91e700 1 --2- 172.21.15.72:0/247608786 >> v2:172.21.15.123:3300/0 conn(0x7fa5a80c5730 0x7fa5a806edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7fa5ac91e700 1 -- 172.21.15.72:0/247608786 >> v1:172.21.15.72:6789/0 conn(0x7fa5a806ad60 legacy=0x7fa5a80c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7fa5ac91e700 1 -- 172.21.15.72:0/247608786 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8161840 con 0x7fa5a8146150 2023-10-14T12:33:51.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f1086d9d700 1 -- 172.21.15.72:0/4026088056 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10880ca290 con 0x7f108806eb10 2023-10-14T12:33:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f07bf7fe700 1 -- 172.21.15.72:0/2958790683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07a8003a00 msgr2=0x7f07a8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f07bf7fe700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07a8003a00 0x7f07a8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f07bf7fe700 1 -- 172.21.15.72:0/2958790683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a8005210 msgr2=0x7f07a800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:33:51.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f07bf7fe700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a8005210 0x7f07a800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.730+0000 7f07bf7fe700 1 -- 172.21.15.72:0/2958790683 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c015fdb0 con 0x7f07a8004850 2023-10-14T12:33:51.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7f07bf7fe700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a8004850 0x7f07a8004cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009880 tx=0x7f07a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ef8908145f0a44 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7f1086d9d700 1 --2- 172.21.15.72:0/4026088056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f108806eb10 0x7f1088164a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1078008840 tx=0x7f107800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c3d57cf4dab5192 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7fa5ac91e700 1 --2- 172.21.15.72:0/247608786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a8146150 0x7fa5a806a820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8147340 tx=0x7fa594009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcdb41acca14592 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0011620 con 0x7f07a8004850 2023-10-14T12:33:51.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0011780 con 0x7f07a8004850 2023-10-14T12:33:51.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7f07beffd700 1 -- 172.21.15.72:0/2958790683 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0011b10 con 0x7f07a8004850 2023-10-14T12:33:51.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7f108559a700 1 -- 172.21.15.72:0/4026088056 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078010070 con 0x7f108806eb10 2023-10-14T12:33:51.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7f108559a700 1 -- 172.21.15.72:0/4026088056 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107800d980 con 0x7f108806eb10 2023-10-14T12:33:51.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7f108559a700 1 -- 172.21.15.72:0/4026088056 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800dd10 con 0x7f108806eb10 2023-10-14T12:33:51.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7fa5a77fe700 1 -- 172.21.15.72:0/247608786 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594004230 con 0x7fa5a8146150 2023-10-14T12:33:51.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7fa5a77fe700 1 -- 172.21.15.72:0/247608786 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594004390 con 0x7fa5a8146150 2023-10-14T12:33:51.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7fa5a77fe700 1 -- 172.21.15.72:0/247608786 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940036a0 con 0x7fa5a8146150 2023-10-14T12:33:51.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.731+0000 7fc3d5035700 1 -- start start 2023-10-14T12:33:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7f069eac4700 1 -- 172.21.15.72:0/2399785321 shutdown_connections 2023-10-14T12:33:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3d5035700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3d0071210 0x7fc3d00cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3d5035700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc3d006bf80 0x7fc3d0166140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fa5aeb82700 1 -- 172.21.15.72:0/247608786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a8146150 msgr2=0x7fa5a806a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fa5aeb82700 1 --2- 172.21.15.72:0/247608786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a8146150 0x7fa5a806a820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8147340 tx=0x7fa594009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3d5035700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d00715f0 0x7fc3d006a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3d5035700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d00cda90 con 0x7fc3d0071210 2023-10-14T12:33:51.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3d5035700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d00cdd70 con 0x7fc3d006bf80 2023-10-14T12:33:51.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3d5035700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0165660 con 0x7fc3d00715f0 2023-10-14T12:33:51.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3cf59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d00715f0 0x7fc3d006a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3ced9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3d0071210 0x7fc3d00cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3cf59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d00715f0 0x7fc3d006a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:42524/0 (socket says 172.21.15.72:42524) 2023-10-14T12:33:51.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3cf59e700 1 -- 172.21.15.72:0/2317637168 learned_addr learned my addr 172.21.15.72:0/2317637168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7f108cfe4700 1 -- 172.21.15.72:0/4026088056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f108806eb10 msgr2=0x7f1088164a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7f108cfe4700 1 --2- 172.21.15.72:0/4026088056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f108806eb10 0x7f1088164a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1078008840 tx=0x7f107800d330 comp rx=0 tx=0).stop 2023-10-14T12:33:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7f108cfe4700 1 -- 172.21.15.72:0/4026088056 shutdown_connections 2023-10-14T12:33:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7f108cfe4700 1 --2- 172.21.15.72:0/4026088056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f108806eb10 0x7f1088164a70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7f108cfe4700 1 -- 172.21.15.72:0/4026088056 >> 172.21.15.72:0/4026088056 conn(0x7f10880cbad0 msgr2=0x7f10880cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3cf59e700 1 -- 172.21.15.72:0/2317637168 >> v2:172.21.15.123:3300/0 conn(0x7fc3d006bf80 msgr2=0x7fc3d0166140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:33:51.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3cf59e700 1 --2- 172.21.15.72:0/2317637168 >> v2:172.21.15.123:3300/0 conn(0x7fc3d006bf80 0x7fc3d0166140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3cf59e700 1 -- 172.21.15.72:0/2317637168 >> v2:172.21.15.72:3300/0 conn(0x7fc3d0071210 msgr2=0x7fc3d00cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7fc3ced9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3d0071210 0x7fc3d00cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46870/0 (socket says 172.21.15.72:46870) 2023-10-14T12:33:51.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7f07c646d700 1 -- 172.21.15.72:0/2958790683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a8004850 msgr2=0x7f07a8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7f07c646d700 1 --2- 172.21.15.72:0/2958790683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07a8004850 0x7f07a8004cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009880 tx=0x7f07a8005880 comp rx=0 tx=0).stop 2023-10-14T12:33:51.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7f07c4a0a700 1 -- 172.21.15.72:0/2958790683 reap_dead start 2023-10-14T12:33:51.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7f07c646d700 1 -- 172.21.15.72:0/2958790683 shutdown_connections 2023-10-14T12:33:51.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7f07c646d700 1 -- 172.21.15.72:0/2958790683 >> 172.21.15.72:0/2958790683 conn(0x7f07c00cfcd0 msgr2=0x7f07c00d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7f07c646d700 1 -- 172.21.15.72:0/2958790683 shutdown_connections 2023-10-14T12:33:51.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7f07c646d700 1 -- 172.21.15.72:0/2958790683 wait complete. 2023-10-14T12:33:51.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fc3cf59e700 1 --2- 172.21.15.72:0/2317637168 >> v2:172.21.15.72:3300/0 conn(0x7fc3d0071210 0x7fc3d00cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fc3cf59e700 1 -- 172.21.15.72:0/2317637168 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d0165940 con 0x7fc3d00715f0 2023-10-14T12:33:51.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fc3ced9d700 1 --2- 172.21.15.72:0/2317637168 >> v2:172.21.15.72:3300/0 conn(0x7fc3d0071210 0x7fc3d00cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:51.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fc3cf59e700 1 --2- 172.21.15.72:0/2317637168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d00715f0 0x7fc3d006a820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0071f40 tx=0x7fc3c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f6f4e8d6b6c415 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fa5aeb82700 1 -- 172.21.15.72:0/247608786 shutdown_connections 2023-10-14T12:33:51.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fa5aeb82700 1 --2- 172.21.15.72:0/247608786 >> v2:172.21.15.123:3300/0 conn(0x7fa5a80c5730 0x7fa5a806edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fa5aeb82700 1 --2- 172.21.15.72:0/247608786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a8146150 0x7fa5a806a820 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8147340 tx=0x7fa594009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fa5aeb82700 1 -- 172.21.15.72:0/247608786 >> 172.21.15.72:0/247608786 conn(0x7fa5a80d0180 msgr2=0x7fa5a80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fc3cdd9b700 1 -- 172.21.15.72:0/2317637168 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c800e070 con 0x7fc3d00715f0 2023-10-14T12:33:51.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fc3cdd9b700 1 -- 172.21.15.72:0/2317637168 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c800b9c0 con 0x7fc3d00715f0 2023-10-14T12:33:51.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.733+0000 7fc3cdd9b700 1 -- 172.21.15.72:0/2317637168 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c800bd70 con 0x7fc3d00715f0 2023-10-14T12:33:51.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.732+0000 7f069eac4700 1 -- 172.21.15.72:0/2399785321 wait complete. 2023-10-14T12:33:51.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7f069eac4700 1 Processor -- start 2023-10-14T12:33:51.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7f069eac4700 1 -- start start 2023-10-14T12:33:51.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7f0458668700 1 Processor -- start 2023-10-14T12:33:51.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fc3d5035700 1 -- 172.21.15.72:0/2317637168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d00715f0 msgr2=0x7fc3d006a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fc3d5035700 1 --2- 172.21.15.72:0/2317637168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d00715f0 0x7fc3d006a820 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0071f40 tx=0x7fc3c800b330 comp rx=0 tx=0).stop 2023-10-14T12:33:51.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7f0458668700 1 -- start start 2023-10-14T12:33:51.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fa5aeb82700 1 -- 172.21.15.72:0/247608786 shutdown_connections 2023-10-14T12:33:51.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fc3d5035700 1 -- 172.21.15.72:0/2317637168 shutdown_connections 2023-10-14T12:33:51.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fc3d5035700 1 --2- 172.21.15.72:0/2317637168 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d00715f0 0x7fc3d006a820 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fc3d5035700 1 --2- 172.21.15.72:0/2317637168 >> v2:172.21.15.72:3300/0 conn(0x7fc3d0071210 0x7fc3d00cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fc3d5035700 1 --2- 172.21.15.72:0/2317637168 >> v2:172.21.15.123:3300/0 conn(0x7fc3d006bf80 0x7fc3d0166140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fc3d5035700 1 -- 172.21.15.72:0/2317637168 >> 172.21.15.72:0/2317637168 conn(0x7fc3d00cfcd0 msgr2=0x7fc3d00d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fc3d5035700 1 -- 172.21.15.72:0/2317637168 shutdown_connections 2023-10-14T12:33:51.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f07c646d700 1 Processor -- start 2023-10-14T12:33:51.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f108cfe4700 1 -- 172.21.15.72:0/4026088056 shutdown_connections 2023-10-14T12:33:51.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f07c646d700 1 -- start start 2023-10-14T12:33:51.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f069eac4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06980aefb0 0x7f06981514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f069eac4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06980cb400 0x7f06980b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f069eac4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069815a240 0x7f069814efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f069eac4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069815a800 con 0x7f069815a240 2023-10-14T12:33:51.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f069eac4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980b3c90 con 0x7f06980cb400 2023-10-14T12:33:51.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f069eac4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980b4ab0 con 0x7f06980aefb0 2023-10-14T12:33:51.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f069c860700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06980aefb0 0x7f06981514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.735+0000 7f0697fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06980cb400 0x7f06980b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f069c860700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06980aefb0 0x7f06981514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:42528/0 (socket says 172.21.15.72:42528) 2023-10-14T12:33:51.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0697fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06980cb400 0x7f06980b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:35030/0 (socket says 172.21.15.72:35030) 2023-10-14T12:33:51.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f069c860700 1 -- 172.21.15.72:0/3400392371 learned_addr learned my addr 172.21.15.72:0/3400392371 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07c646d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a8004850 0x7f07c0155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07c646d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07c00b2450 0x7f07c00c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07c646d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07c00c95c0 0x7f07c00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07c646d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00b34f0 con 0x7f07c00b2450 2023-10-14T12:33:51.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07c646d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00b28e0 con 0x7f07a8004850 2023-10-14T12:33:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07c646d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00b2bc0 con 0x7f07c00c95c0 2023-10-14T12:33:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07bffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a8004850 0x7f07c0155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07bffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a8004850 0x7f07c0155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:35040/0 (socket says 172.21.15.72:35040) 2023-10-14T12:33:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07bffff700 1 -- 172.21.15.72:0/673141921 learned_addr learned my addr 172.21.15.72:0/673141921 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0458668700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cf580 0x7f04500cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0458668700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04500cdd50 0x7f04500d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0458668700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04500ce590 con 0x7f045015b420 2023-10-14T12:33:51.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07bf7fe700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07c00b2450 0x7f07c00c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0458668700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045015bb10 con 0x7f04500cdd50 2023-10-14T12:33:51.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0458668700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045015bdf0 con 0x7f04500cf580 2023-10-14T12:33:51.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0456c05700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04500cdd50 0x7f04500d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0456c05700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04500cdd50 0x7f04500d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:35036/0 (socket says 172.21.15.72:35036) 2023-10-14T12:33:51.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0456c05700 1 -- 172.21.15.72:0/1318320008 learned_addr learned my addr 172.21.15.72:0/1318320008 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.734+0000 7fa5aeb82700 1 -- 172.21.15.72:0/247608786 wait complete. 2023-10-14T12:33:51.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7fa5aeb82700 1 Processor -- start 2023-10-14T12:33:51.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f07c4a0a700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07c00c95c0 0x7f07c00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0456c05700 1 -- 172.21.15.72:0/1318320008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cf580 msgr2=0x7f04500cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0455402700 1 -- 172.21.15.72:0/1318320008 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226315314 0 0) 0x7f04500ce590 con 0x7f045015b420 2023-10-14T12:33:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0455c03700 1 --2- 172.21.15.72:0/1318320008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cf580 0x7f04500cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f0456c05700 1 --2- 172.21.15.72:0/1318320008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cf580 0x7f04500cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f07bf7fe700 1 -- 172.21.15.72:0/673141921 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07c00c95c0 msgr2=0x7f07c00c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f07bf7fe700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07c00c95c0 0x7f07c00c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f07bf7fe700 1 -- 172.21.15.72:0/673141921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a8004850 msgr2=0x7f07c0155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f07bf7fe700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a8004850 0x7f07c0155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f07bf7fe700 1 -- 172.21.15.72:0/673141921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00b2ea0 con 0x7f07c00b2450 2023-10-14T12:33:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f0456c05700 1 -- 172.21.15.72:0/1318320008 >> v1:172.21.15.123:6789/0 conn(0x7f045015b420 legacy=0x7f04500cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f0456c05700 1 -- 172.21.15.72:0/1318320008 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045015c0d0 con 0x7f04500cdd50 2023-10-14T12:33:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0697fff700 1 -- 172.21.15.72:0/3400392371 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06980aefb0 msgr2=0x7f06981514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0697fff700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06980aefb0 0x7f06981514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0697fff700 1 -- 172.21.15.72:0/3400392371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069815a240 msgr2=0x7f069814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0697fff700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069815a240 0x7f069814efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0697fff700 1 -- 172.21.15.72:0/3400392371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840094a0 con 0x7f06980cb400 2023-10-14T12:33:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f0697fff700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06980cb400 0x7f06980b3750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f068c00c500 tx=0x7f068c00c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7f06957fa700 1 -- 172.21.15.72:0/3400392371 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c005d70 con 0x7f06980cb400 2023-10-14T12:33:51.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f06957fa700 1 -- 172.21.15.72:0/3400392371 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c0070d0 con 0x7f06980cb400 2023-10-14T12:33:51.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f06957fa700 1 -- 172.21.15.72:0/3400392371 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c007440 con 0x7f06980cb400 2023-10-14T12:33:51.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06980b3ea0 con 0x7f06980cb400 2023-10-14T12:33:51.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06980b4740 con 0x7f06980cb400 2023-10-14T12:33:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f0456c05700 1 --2- 172.21.15.72:0/1318320008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cdd50 0x7f04500d0670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0448009e50 tx=0x7f044800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec7a6616fda4d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f0455402700 1 -- 172.21.15.72:0/1318320008 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044800bbc0 con 0x7f04500cdd50 2023-10-14T12:33:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f0455402700 1 -- 172.21.15.72:0/1318320008 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044800bd20 con 0x7f04500cdd50 2023-10-14T12:33:51.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.737+0000 7f0455402700 1 -- 172.21.15.72:0/1318320008 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448010710 con 0x7f04500cdd50 2023-10-14T12:33:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7f07bf7fe700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07c00b2450 0x7f07c00c9080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07b0016000 tx=0x7f07b0004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7f07bcff9700 1 -- 172.21.15.72:0/673141921 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b001a650 con 0x7f07c00b2450 2023-10-14T12:33:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7f07bcff9700 1 -- 172.21.15.72:0/673141921 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b001a7f0 con 0x7f07c00b2450 2023-10-14T12:33:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c00b3180 con 0x7f07c00b2450 2023-10-14T12:33:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7f07bcff9700 1 -- 172.21.15.72:0/673141921 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b001aba0 con 0x7f07c00b2450 2023-10-14T12:33:51.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7fc3d5035700 1 -- 172.21.15.72:0/2317637168 wait complete. 2023-10-14T12:33:51.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7fc3d5035700 1 Processor -- start 2023-10-14T12:33:51.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7f06957fa700 1 -- 172.21.15.72:0/3400392371 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f068c0075a0 con 0x7f06980cb400 2023-10-14T12:33:51.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7f0458668700 1 -- 172.21.15.72:0/1318320008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cdd50 msgr2=0x7f04500d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7f0458668700 1 --2- 172.21.15.72:0/1318320008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cdd50 0x7f04500d0670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0448009e50 tx=0x7f044800b330 comp rx=0 tx=0).stop 2023-10-14T12:33:51.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c00c7420 con 0x7f07c00b2450 2023-10-14T12:33:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.736+0000 7fa5aeb82700 1 -- start start 2023-10-14T12:33:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7fa5aeb82700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5a806ad60 0x7fa5a815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7fa5aeb82700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa5a80c5730 0x7fa5a81346a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7fa5aeb82700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a815cd50 0x7fa5a80cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7fa5aeb82700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a815ee90 con 0x7fa5a815cd50 2023-10-14T12:33:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7fa5aeb82700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a81385b0 con 0x7fa5a806ad60 2023-10-14T12:33:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.738+0000 7fa5aeb82700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a815e280 con 0x7fa5a80c5730 2023-10-14T12:33:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7f0458668700 1 -- 172.21.15.72:0/1318320008 shutdown_connections 2023-10-14T12:33:51.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7f0458668700 1 --2- 172.21.15.72:0/1318320008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cdd50 0x7f04500d0670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7f0458668700 1 --2- 172.21.15.72:0/1318320008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cf580 0x7f04500cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7f0458668700 1 -- 172.21.15.72:0/1318320008 >> 172.21.15.72:0/1318320008 conn(0x7f045006a820 msgr2=0x7f045006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7f06957fa700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f067c06af00 0x7f067c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7f0458668700 1 -- 172.21.15.72:0/1318320008 shutdown_connections 2023-10-14T12:33:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7f06957fa700 1 -- 172.21.15.72:0/3400392371 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f068c088a40 con 0x7f06980cb400 2023-10-14T12:33:51.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7f069c860700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f067c06af00 0x7f067c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7f069c860700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f067c06af00 0x7f067c06d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0684009b60 tx=0x7f0684008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7fc3d5035700 1 -- start start 2023-10-14T12:33:51.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3d5035700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d006bf80 0x7fc3d00cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3d5035700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d0071210 0x7fc3d0164530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3d5035700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3d00715f0 0x7fc3d0164a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3d5035700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d01fb400 con 0x7fc3d00715f0 2023-10-14T12:33:51.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3d5035700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d01f72f0 con 0x7fc3d0071210 2023-10-14T12:33:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3d5035700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d01f75d0 con 0x7fc3d006bf80 2023-10-14T12:33:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7fa5ac91e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5a806ad60 0x7fa5a815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7fa5ac91e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5a806ad60 0x7fa5a815dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:35048/0 (socket says 172.21.15.72:35048) 2023-10-14T12:33:51.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7fa5ac91e700 1 -- 172.21.15.72:0/4177664283 learned_addr learned my addr 172.21.15.72:0/4177664283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ce59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d0071210 0x7fc3d0164530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7fa5ad11f700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a815cd50 0x7fa5a80cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fa5ac91e700 1 -- 172.21.15.72:0/4177664283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa5a80c5730 msgr2=0x7fa5a81346a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:33:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fa5ac91e700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa5a80c5730 0x7fa5a81346a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fa5ac91e700 1 -- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a815cd50 msgr2=0x7fa5a80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ce59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d0071210 0x7fc3d0164530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:35052/0 (socket says 172.21.15.72:35052) 2023-10-14T12:33:51.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ce59c700 1 -- 172.21.15.72:0/1125694657 learned_addr learned my addr 172.21.15.72:0/1125694657 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fa5ac91e700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a815cd50 0x7fa5a80cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fa5ac91e700 1 -- 172.21.15.72:0/4177664283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa594009550 con 0x7fa5a806ad60 2023-10-14T12:33:51.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fa5ac91e700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5a806ad60 0x7fa5a815dba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa594000c00 tx=0x7fa594004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ced9d700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d006bf80 0x7fc3d00cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06780052f0 con 0x7f06980cb400 2023-10-14T12:33:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3cf59e700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3d00715f0 0x7fc3d0164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ce59c700 1 -- 172.21.15.72:0/1125694657 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d006bf80 msgr2=0x7fc3d00cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ce59c700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d006bf80 0x7fc3d00cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ce59c700 1 -- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3d00715f0 msgr2=0x7fc3d0164a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ce59c700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3d00715f0 0x7fc3d0164a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ce59c700 1 -- 172.21.15.72:0/1125694657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8009b30 con 0x7fc3d0071210 2023-10-14T12:33:51.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3ced9d700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d006bf80 0x7fc3d00cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:51.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.740+0000 7fc3cf59e700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3d00715f0 0x7fc3d0164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7fa5a57fa700 1 -- 172.21.15.72:0/4177664283 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594003d60 con 0x7fa5a806ad60 2023-10-14T12:33:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7fa5a57fa700 1 -- 172.21.15.72:0/4177664283 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594011630 con 0x7fa5a806ad60 2023-10-14T12:33:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7fa5a57fa700 1 -- 172.21.15.72:0/4177664283 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5940119c0 con 0x7fa5a806ad60 2023-10-14T12:33:51.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a815e560 con 0x7fa5a806ad60 2023-10-14T12:33:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7fc3ce59c700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d0071210 0x7fc3d0164530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000b550 tx=0x7fc3c000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.739+0000 7f0458668700 1 -- 172.21.15.72:0/1318320008 wait complete. 2023-10-14T12:33:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7f0458668700 1 Processor -- start 2023-10-14T12:33:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a815eb20 con 0x7fa5a806ad60 2023-10-14T12:33:51.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7f07bcff9700 1 -- 172.21.15.72:0/673141921 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f07b001ad00 con 0x7f07c00b2450 2023-10-14T12:33:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7f07bcff9700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f07ac06af00 0x7f07ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f07bcff9700 1 -- 172.21.15.72:0/673141921 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07b008ac40 con 0x7f07c00b2450 2023-10-14T12:33:51.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7fc3b77fe700 1 -- 172.21.15.72:0/1125694657 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0011830 con 0x7fc3d0071210 2023-10-14T12:33:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d01f78b0 con 0x7fc3d0071210 2023-10-14T12:33:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d00cb840 con 0x7fc3d0071210 2023-10-14T12:33:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.747+0000 7fc3b77fe700 1 -- 172.21.15.72:0/1125694657 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c0009340 con 0x7fc3d0071210 2023-10-14T12:33:51.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.747+0000 7fc3b77fe700 1 -- 172.21.15.72:0/1125694657 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0011b90 con 0x7fc3d0071210 2023-10-14T12:33:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c004ebb0 con 0x7f07c00b2450 2023-10-14T12:33:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f07bffff700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f07ac06af00 0x7f07ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f07bffff700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f07ac06af00 0x7f07ac06d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07b4001760 tx=0x7f07b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7f108cfe4700 1 -- 172.21.15.72:0/4026088056 wait complete. 2023-10-14T12:33:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f108cfe4700 1 Processor -- start 2023-10-14T12:33:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f108cfe4700 1 -- start start 2023-10-14T12:33:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f108cfe4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108806daf0 0x7f10881ee060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f108cfe4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f108806eb10 0x7f10881f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f108cfe4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10881f2230 0x7f1088157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f108cfe4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10880c6140 con 0x7f108806daf0 2023-10-14T12:33:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f108cfe4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1088144e80 con 0x7f10881f2230 2023-10-14T12:33:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f108cfe4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10881f2860 con 0x7f108806eb10 2023-10-14T12:33:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f1085d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f108806eb10 0x7f10881f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f1085d9b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f108806eb10 0x7f10881f1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:42572/0 (socket says 172.21.15.72:42572) 2023-10-14T12:33:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f1085d9b700 1 -- 172.21.15.72:0/3591003076 learned_addr learned my addr 172.21.15.72:0/3591003076 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f1086d9d700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10881f2230 0x7f1088157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f1085d9b700 1 -- 172.21.15.72:0/3591003076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10881f2230 msgr2=0x7f1088157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f1085d9b700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10881f2230 0x7f1088157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f1085d9b700 1 -- 172.21.15.72:0/3591003076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108806daf0 msgr2=0x7f10881ee060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f1085d9b700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108806daf0 0x7f10881ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f1085d9b700 1 -- 172.21.15.72:0/3591003076 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1078008520 con 0x7f108806eb10 2023-10-14T12:33:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f1085d9b700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f108806eb10 0x7f10881f1cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f108000b9b0 tx=0x7f108000bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f1076ffd700 1 -- 172.21.15.72:0/3591003076 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000c950 con 0x7f108806eb10 2023-10-14T12:33:51.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f1076ffd700 1 -- 172.21.15.72:0/3591003076 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108000cab0 con 0x7f108806eb10 2023-10-14T12:33:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10881f2b40 con 0x7f108806eb10 2023-10-14T12:33:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f1076ffd700 1 -- 172.21.15.72:0/3591003076 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000ce60 con 0x7f108806eb10 2023-10-14T12:33:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1088154a90 con 0x7f108806eb10 2023-10-14T12:33:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.747+0000 7f1076ffd700 1 -- 172.21.15.72:0/3591003076 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1080014440 con 0x7f108806eb10 2023-10-14T12:33:51.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.747+0000 7f1076ffd700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f106806af00 0x7f106806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.747+0000 7f1076ffd700 1 -- 172.21.15.72:0/3591003076 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10800893c0 con 0x7f108806eb10 2023-10-14T12:33:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.748+0000 7f108659c700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f106806af00 0x7f106806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f108659c700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f106806af00 0x7f106806d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f107c001670 tx=0x7f107c007ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c0052f0 con 0x7f108806eb10 2023-10-14T12:33:51.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f06957fa700 1 -- 172.21.15.72:0/3400392371 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f068c053940 con 0x7f06980cb400 2023-10-14T12:33:51.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.741+0000 7f0458668700 1 -- start start 2023-10-14T12:33:51.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0458668700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cdd50 0x7f04500c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0458668700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cf580 0x7f0450151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0458668700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f045015b420 0x7f04501f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0458668700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0450158b60 con 0x7f045015b420 2023-10-14T12:33:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0458668700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04501f7e60 con 0x7f04500cf580 2023-10-14T12:33:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0458668700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04500c5370 con 0x7f04500cdd50 2023-10-14T12:33:51.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0455c03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cf580 0x7f0450151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0456404700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cdd50 0x7f04500c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0455c03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cf580 0x7f0450151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:35060/0 (socket says 172.21.15.72:35060) 2023-10-14T12:33:51.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0455c03700 1 -- 172.21.15.72:0/1335336152 learned_addr learned my addr 172.21.15.72:0/1335336152 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0456404700 1 -- 172.21.15.72:0/1335336152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cf580 msgr2=0x7f0450151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0456404700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cf580 0x7f0450151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0456404700 1 -- 172.21.15.72:0/1335336152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f045015b420 msgr2=0x7f04501f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f0456404700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f045015b420 0x7f04501f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f0456404700 1 -- 172.21.15.72:0/1335336152 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448009b30 con 0x7f04500cdd50 2023-10-14T12:33:51.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f0456404700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cdd50 0x7f04500c4d90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f044000c3e0 tx=0x7f044000c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f0446ffd700 1 -- 172.21.15.72:0/1335336152 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044000cea0 con 0x7f04500cdd50 2023-10-14T12:33:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f0446ffd700 1 -- 172.21.15.72:0/1335336152 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04400054e0 con 0x7f04500cdd50 2023-10-14T12:33:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04500c5650 con 0x7f04500cdd50 2023-10-14T12:33:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f0446ffd700 1 -- 172.21.15.72:0/1335336152 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04400038a0 con 0x7f04500cdd50 2023-10-14T12:33:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04500c5c10 con 0x7f04500cdd50 2023-10-14T12:33:51.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f0446ffd700 1 -- 172.21.15.72:0/1335336152 <== mon.2 v2:172.21.15.123:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0440003a00 con 0x7f04500cdd50 2023-10-14T12:33:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7f0446ffd700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f043406af50 0x7f043406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7f0446ffd700 1 -- 172.21.15.72:0/1335336152 <== mon.2 v2:172.21.15.123:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0440088bd0 con 0x7f04500cdd50 2023-10-14T12:33:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7f0455c03700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f043406af50 0x7f043406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.747+0000 7f0455c03700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f043406af50 0x7f043406d410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f045006d1b0 tx=0x7f044c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f442f693700 1 Processor -- start 2023-10-14T12:33:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.742+0000 7f442f693700 1 -- start start 2023-10-14T12:33:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f442f693700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44281598a0 0x7f4428070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f442f693700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4428071ad0 0x7f44280cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f442f693700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4428071f50 con 0x7f4428072520 2023-10-14T12:33:51.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f442f693700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442806b830 con 0x7f4428071ad0 2023-10-14T12:33:51.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f442f693700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4428159c80 con 0x7f44281598a0 2023-10-14T12:33:51.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f442cc2e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4428072520 0x7f44280713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51410/0 (socket says 172.21.15.72:51410) 2023-10-14T12:33:51.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f442cc2e700 1 -- 172.21.15.72:0/1053600846 learned_addr learned my addr 172.21.15.72:0/1053600846 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:51.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7f442d42f700 1 --2- 172.21.15.72:0/1053600846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44281598a0 0x7f4428070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f442d42f700 1 -- 172.21.15.72:0/1053600846 >> v2:172.21.15.72:3300/0 conn(0x7f4428071ad0 msgr2=0x7f44280cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f442d42f700 1 --2- 172.21.15.72:0/1053600846 >> v2:172.21.15.72:3300/0 conn(0x7f4428071ad0 0x7f44280cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f442d42f700 1 -- 172.21.15.72:0/1053600846 >> v1:172.21.15.123:6789/0 conn(0x7f4428072520 legacy=0x7f44280713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f442d42f700 1 -- 172.21.15.72:0/1053600846 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280721f0 con 0x7f44281598a0 2023-10-14T12:33:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f442d42f700 1 --2- 172.21.15.72:0/1053600846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44281598a0 0x7f4428070e80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4424009840 tx=0x7f4424009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4fd772565401cb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f441ffff700 1 -- 172.21.15.72:0/1053600846 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424004230 con 0x7f44281598a0 2023-10-14T12:33:51.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f441ffff700 1 -- 172.21.15.72:0/1053600846 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424004390 con 0x7f44281598a0 2023-10-14T12:33:51.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.744+0000 7f441ffff700 1 -- 172.21.15.72:0/1053600846 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240036a0 con 0x7f44281598a0 2023-10-14T12:33:51.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f442f693700 1 -- 172.21.15.72:0/1053600846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44281598a0 msgr2=0x7f4428070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.745+0000 7f442f693700 1 --2- 172.21.15.72:0/1053600846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44281598a0 0x7f4428070e80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4424009840 tx=0x7f4424009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:51.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7f442f693700 1 -- 172.21.15.72:0/1053600846 shutdown_connections 2023-10-14T12:33:51.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7f442f693700 1 --2- 172.21.15.72:0/1053600846 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f44281598a0 0x7f4428070e80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7f442f693700 1 --2- 172.21.15.72:0/1053600846 >> v2:172.21.15.72:3300/0 conn(0x7f4428071ad0 0x7f44280cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7f442f693700 1 -- 172.21.15.72:0/1053600846 >> 172.21.15.72:0/1053600846 conn(0x7f44280b1100 msgr2=0x7f44280b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.746+0000 7f442f693700 1 -- 172.21.15.72:0/1053600846 shutdown_connections 2023-10-14T12:33:51.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.747+0000 7f442f693700 1 -- 172.21.15.72:0/1053600846 wait complete. 2023-10-14T12:33:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.748+0000 7f442f693700 1 Processor -- start 2023-10-14T12:33:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.743+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a804ebb0 con 0x7fa5a806ad60 2023-10-14T12:33:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.748+0000 7fa5a57fa700 1 -- 172.21.15.72:0/4177664283 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa594011b20 con 0x7fa5a806ad60 2023-10-14T12:33:51.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.748+0000 7fa5a57fa700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa58c06af50 0x7fa58c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7fa5a57fa700 1 -- 172.21.15.72:0/4177664283 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa59408b350 con 0x7fa5a806ad60 2023-10-14T12:33:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7fc3b77fe700 1 -- 172.21.15.72:0/1125694657 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc3c0011cf0 con 0x7fc3d0071210 2023-10-14T12:33:51.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f07bcff9700 1 -- 172.21.15.72:0/673141921 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07b0055a90 con 0x7f07c00b2450 2023-10-14T12:33:51.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f45fceef700 1 Processor -- start 2023-10-14T12:33:51.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7fc3b77fe700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc3bc06af00 0x7fc3bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f45fceef700 1 -- start start 2023-10-14T12:33:51.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.748+0000 7f442f693700 1 -- start start 2023-10-14T12:33:51.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7fa5a7fff700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa58c06af50 0x7fa58c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f442f693700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4428071ad0 0x7f44280c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f442f693700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4428072520 0x7f442815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f442f693700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44281598a0 0x7f442815ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f442f693700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280c4270 con 0x7f4428072520 2023-10-14T12:33:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f442f693700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442815b240 con 0x7f44281598a0 2023-10-14T12:33:51.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.749+0000 7f442f693700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44280c44c0 con 0x7f4428071ad0 2023-10-14T12:33:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442cc2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4428072520 0x7f442815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442cc2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4428072520 0x7f442815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46934/0 (socket says 172.21.15.72:46934) 2023-10-14T12:33:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442cc2e700 1 -- 172.21.15.72:0/4190136309 learned_addr learned my addr 172.21.15.72:0/4190136309 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442cc2e700 1 -- 172.21.15.72:0/4190136309 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4428071ad0 msgr2=0x7f44280c65d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:33:51.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442cc2e700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4428071ad0 0x7f44280c65d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442cc2e700 1 -- 172.21.15.72:0/4190136309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44281598a0 msgr2=0x7f442815ad00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:33:51.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442cc2e700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44281598a0 0x7f442815ad00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442cc2e700 1 -- 172.21.15.72:0/4190136309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44240094a0 con 0x7f4428072520 2023-10-14T12:33:51.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442cc2e700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4428072520 0x7f442815cc60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f441800c500 tx=0x7f441800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f441dffb700 1 -- 172.21.15.72:0/4190136309 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418005d70 con 0x7f4428072520 2023-10-14T12:33:51.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f441dffb700 1 -- 172.21.15.72:0/4190136309 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44180070d0 con 0x7f4428072520 2023-10-14T12:33:51.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.750+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44280c47a0 con 0x7f4428072520 2023-10-14T12:33:51.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.751+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44280c4d60 con 0x7f4428072520 2023-10-14T12:33:51.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.751+0000 7f45fceef700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f815daa0 0x7f45f80af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.751+0000 7f45fceef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45f80af560 0x7f45f8071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.751+0000 7f45fceef700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f815ed10 con 0x7f45f8071d90 2023-10-14T12:33:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.751+0000 7f45fceef700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f8072200 con 0x7f45f80af560 2023-10-14T12:33:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.751+0000 7f45fceef700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8161410 con 0x7f45f815daa0 2023-10-14T12:33:51.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f45f5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45f80af560 0x7f45f8071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f45f5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45f80af560 0x7f45f8071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46938/0 (socket says 172.21.15.72:46938) 2023-10-14T12:33:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f45f5d9b700 1 -- 172.21.15.72:0/1356413854 learned_addr learned my addr 172.21.15.72:0/1356413854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7fc3b77fe700 1 -- 172.21.15.72:0/1125694657 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc3c00172c0 con 0x7fc3d0071210 2023-10-14T12:33:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f45f5d9b700 1 -- 172.21.15.72:0/1356413854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f815daa0 msgr2=0x7f45f80af020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:33:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f45f5d9b700 1 --2- 172.21.15.72:0/1356413854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f815daa0 0x7f45f80af020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f45f5d9b700 1 -- 172.21.15.72:0/1356413854 >> v1:172.21.15.123:6789/0 conn(0x7f45f8071d90 legacy=0x7f45f80ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:51.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.751+0000 7f441dffb700 1 -- 172.21.15.72:0/4190136309 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418007480 con 0x7f4428072520 2023-10-14T12:33:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f45f5d9b700 1 -- 172.21.15.72:0/1356413854 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f815de80 con 0x7f45f80af560 2023-10-14T12:33:51.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7fa5a7fff700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa58c06af50 0x7fa58c06d410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5a806fea0 tx=0x7fa59c007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f45f5d9b700 1 --2- 172.21.15.72:0/1356413854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80af560 0x7f45f8071850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0098f0 tx=0x7f45ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a58c8fc0cbd1c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7fa5a57fa700 1 -- 172.21.15.72:0/4177664283 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5940562b0 con 0x7fa5a806ad60 2023-10-14T12:33:51.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44080052f0 con 0x7f4428072520 2023-10-14T12:33:51.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.752+0000 7f45f559a700 1 -- 172.21.15.72:0/1356413854 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec004230 con 0x7f45f80af560 2023-10-14T12:33:51.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f45f559a700 1 -- 172.21.15.72:0/1356413854 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec004390 con 0x7f45f80af560 2023-10-14T12:33:51.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f45f559a700 1 -- 172.21.15.72:0/1356413854 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0036a0 con 0x7f45f80af560 2023-10-14T12:33:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04380052f0 con 0x7f04500cdd50 2023-10-14T12:33:51.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f441dffb700 1 -- 172.21.15.72:0/4190136309 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f44180075e0 con 0x7f4428072520 2023-10-14T12:33:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f441dffb700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f440c06aed0 0x7f440c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f441dffb700 1 -- 172.21.15.72:0/4190136309 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4418088e60 con 0x7f4428072520 2023-10-14T12:33:51.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f45fceef700 1 -- 172.21.15.72:0/1356413854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80af560 msgr2=0x7f45f8071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f45fceef700 1 --2- 172.21.15.72:0/1356413854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80af560 0x7f45f8071850 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0098f0 tx=0x7f45ec009c00 comp rx=0 tx=0).stop 2023-10-14T12:33:51.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f45fceef700 1 -- 172.21.15.72:0/1356413854 shutdown_connections 2023-10-14T12:33:51.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f45fceef700 1 --2- 172.21.15.72:0/1356413854 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f815daa0 0x7f45f80af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f45fceef700 1 --2- 172.21.15.72:0/1356413854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80af560 0x7f45f8071850 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.753+0000 7f45fceef700 1 -- 172.21.15.72:0/1356413854 >> 172.21.15.72:0/1356413854 conn(0x7f45f80d0180 msgr2=0x7f45f80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:51.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.754+0000 7f442d42f700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f440c06aed0 0x7f440c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.754+0000 7f45fceef700 1 -- 172.21.15.72:0/1356413854 shutdown_connections 2023-10-14T12:33:51.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.754+0000 7f45fceef700 1 -- 172.21.15.72:0/1356413854 wait complete. 2023-10-14T12:33:51.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.754+0000 7f442d42f700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f440c06aed0 0x7f440c06d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44240090b0 tx=0x7f4424013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.755+0000 7f1076ffd700 1 -- 172.21.15.72:0/3591003076 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1080054270 con 0x7f108806eb10 2023-10-14T12:33:51.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.756+0000 7f45fceef700 1 Processor -- start 2023-10-14T12:33:51.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.756+0000 7f45fceef700 1 -- start start 2023-10-14T12:33:51.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45fceef700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f8071d90 0x7f45f80c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45fceef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45f80af560 0x7f45f80b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45fceef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80b27c0 0x7f45f814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45fceef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80c66e0 con 0x7f45f80b27c0 2023-10-14T12:33:51.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45fceef700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80c5ad0 con 0x7f45f80af560 2023-10-14T12:33:51.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45fceef700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80c5db0 con 0x7f45f8071d90 2023-10-14T12:33:51.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45f6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80b27c0 0x7f45f814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45f6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80b27c0 0x7f45f814e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46946/0 (socket says 172.21.15.72:46946) 2023-10-14T12:33:51.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45f6d9d700 1 -- 172.21.15.72:0/1259649516 learned_addr learned my addr 172.21.15.72:0/1259649516 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:51.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45f6d9d700 1 -- 172.21.15.72:0/1259649516 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f8071d90 msgr2=0x7f45f80c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:51.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.757+0000 7f45f659c700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f8071d90 0x7f45f80c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.758+0000 7f45f6d9d700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f8071d90 0x7f45f80c3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.758+0000 7f45f6d9d700 1 -- 172.21.15.72:0/1259649516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45f80af560 msgr2=0x7f45f80b2280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T12:33:51.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.758+0000 7f45f6d9d700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45f80af560 0x7f45f80b2280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:51.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.758+0000 7f45f6d9d700 1 -- 172.21.15.72:0/1259649516 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec009550 con 0x7f45f80b27c0 2023-10-14T12:33:51.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.758+0000 7f45f659c700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f8071d90 0x7f45f80c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:51.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.758+0000 7f45f6d9d700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80b27c0 0x7f45f814e220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45f000b990 tx=0x7f45f000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.759+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b00052f0 con 0x7fc3d0071210 2023-10-14T12:33:51.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.759+0000 7f0446ffd700 1 -- 172.21.15.72:0/1335336152 <== mon.2 v2:172.21.15.123:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0440053a70 con 0x7f04500cdd50 2023-10-14T12:33:51.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.760+0000 7fc3ced9d700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc3bc06af00 0x7fc3bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.760+0000 7fc3ced9d700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc3bc06af00 0x7fc3bc06d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4006fd0 tx=0x7fc3c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.762+0000 7f45e6ffd700 1 -- 172.21.15.72:0/1259649516 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000c9d0 con 0x7f45f80b27c0 2023-10-14T12:33:51.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.762+0000 7f45e6ffd700 1 -- 172.21.15.72:0/1259649516 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f000cb30 con 0x7f45f80b27c0 2023-10-14T12:33:51.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.762+0000 7f45e6ffd700 1 -- 172.21.15.72:0/1259649516 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0014440 con 0x7f45f80b27c0 2023-10-14T12:33:51.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.762+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f80c6090 con 0x7f45f80b27c0 2023-10-14T12:33:51.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.762+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f80c4990 con 0x7f45f80b27c0 2023-10-14T12:33:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.764+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f804ebb0 con 0x7f45f80b27c0 2023-10-14T12:33:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.762+0000 7f441dffb700 1 -- 172.21.15.72:0/4190136309 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4418053c20 con 0x7f4428072520 2023-10-14T12:33:51.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.765+0000 7fc3b77fe700 1 -- 172.21.15.72:0/1125694657 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3c0058110 con 0x7fc3d0071210 2023-10-14T12:33:51.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.765+0000 7f45e6ffd700 1 -- 172.21.15.72:0/1259649516 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f45f001d3b0 con 0x7f45f80b27c0 2023-10-14T12:33:51.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.765+0000 7f45e6ffd700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45e006b080 0x7f45e006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:51.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.765+0000 7f45e6ffd700 1 -- 172.21.15.72:0/1259649516 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45f0089730 con 0x7f45f80b27c0 2023-10-14T12:33:51.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.766+0000 7f45f659c700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45e006b080 0x7f45e006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:51.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.767+0000 7f45f659c700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45e006b080 0x7f45e006d540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f45e8006fd0 tx=0x7f45e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:51.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:51.774+0000 7f45e6ffd700 1 -- 172.21.15.72:0/1259649516 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f45f0054450 con 0x7f45f80b27c0 2023-10-14T12:33:52.149 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:52.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.146+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0678005870 con 0x7f06980cb400 2023-10-14T12:33:52.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.147+0000 7f06957fa700 1 -- 172.21.15.72:0/3400392371 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f068c017030 con 0x7f06980cb400 2023-10-14T12:33:52.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.151+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f067c06af00 msgr2=0x7f067c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.151+0000 7f069eac4700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f067c06af00 0x7f067c06d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0684009b60 tx=0x7f0684008030 comp rx=0 tx=0).stop 2023-10-14T12:33:52.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.151+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06980cb400 msgr2=0x7f06980b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.151+0000 7f069eac4700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06980cb400 0x7f06980b3750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f068c00c500 tx=0x7f068c00c810 comp rx=0 tx=0).stop 2023-10-14T12:33:52.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.153+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 shutdown_connections 2023-10-14T12:33:52.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.153+0000 7f069eac4700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f067c06af00 0x7f067c06d3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.153+0000 7f069eac4700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f069815a240 0x7f069814efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.153+0000 7f069eac4700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f06980aefb0 0x7f06981514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.153+0000 7f069eac4700 1 --2- 172.21.15.72:0/3400392371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06980cb400 0x7f06980b3750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.153+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 >> 172.21.15.72:0/3400392371 conn(0x7f06980ccbd0 msgr2=0x7f06980b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:52.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.154+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07c006bd10 con 0x7f07c00b2450 2023-10-14T12:33:52.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.155+0000 7f07bcff9700 1 -- 172.21.15.72:0/673141921 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07b0015070 con 0x7f07c00b2450 2023-10-14T12:33:52.158 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f07ac06af00 msgr2=0x7f07ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f07ac06af00 0x7f07ac06d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07b4001760 tx=0x7f07b4009040 comp rx=0 tx=0).stop 2023-10-14T12:33:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07c00b2450 msgr2=0x7f07c00c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07c00b2450 0x7f07c00c9080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f07b0016000 tx=0x7f07b0004790 comp rx=0 tx=0).stop 2023-10-14T12:33:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 shutdown_connections 2023-10-14T12:33:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f07ac06af00 0x7f07ac06d3c0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07b4001760 tx=0x7f07b4009040 comp rx=0 tx=0).stop 2023-10-14T12:33:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f07c00c95c0 0x7f07c00c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a8004850 0x7f07c0155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 --2- 172.21.15.72:0/673141921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07c00b2450 0x7f07c00c9080 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.161+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 >> 172.21.15.72:0/673141921 conn(0x7f07c00cfcd0 msgr2=0x7f07c00af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:52.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.162+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0438005870 con 0x7f04500cdd50 2023-10-14T12:33:52.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.163+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 shutdown_connections 2023-10-14T12:33:52.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.163+0000 7f07c646d700 1 -- 172.21.15.72:0/673141921 wait complete. 2023-10-14T12:33:52.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.163+0000 7f0446ffd700 1 -- 172.21.15.72:0/1335336152 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0440017030 con 0x7f04500cdd50 2023-10-14T12:33:52.166 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-10-14T12:33:52.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.167+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f106c005870 con 0x7f108806eb10 2023-10-14T12:33:52.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.167+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 shutdown_connections 2023-10-14T12:33:52.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.168+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa5a8071a50 con 0x7fa5a806ad60 2023-10-14T12:33:52.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.168+0000 7f1076ffd700 1 -- 172.21.15.72:0/3591003076 <== mon.2 v2:172.21.15.123:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1080019070 con 0x7f108806eb10 2023-10-14T12:33:52.170 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-10-14T12:33:52.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.170+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3b0005870 con 0x7fc3d0071210 2023-10-14T12:33:52.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.170+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f043406af50 msgr2=0x7f043406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.170+0000 7f0458668700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f043406af50 0x7f043406d410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f045006d1b0 tx=0x7f044c008040 comp rx=0 tx=0).stop 2023-10-14T12:33:52.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.170+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cdd50 msgr2=0x7f04500c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.170+0000 7f0458668700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cdd50 0x7f04500c4d90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f044000c3e0 tx=0x7f044000c6f0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.170+0000 7fa5a57fa700 1 -- 172.21.15.72:0/4177664283 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5940598d0 con 0x7fa5a806ad60 2023-10-14T12:33:52.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.170+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4408005870 con 0x7f4428072520 2023-10-14T12:33:52.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.170+0000 7f441dffb700 1 -- 172.21.15.72:0/4190136309 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4418017020 con 0x7f4428072520 2023-10-14T12:33:52.173 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-10-14T12:33:52.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 shutdown_connections 2023-10-14T12:33:52.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f0458668700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f043406af50 0x7f043406d410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f0458668700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f045015b420 0x7f04501f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f0458668700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f04500cdd50 0x7f04500c4d90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f0458668700 1 --2- 172.21.15.72:0/1335336152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04500cf580 0x7f0450151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 >> 172.21.15.72:0/1335336152 conn(0x7f045006a820 msgr2=0x7f045006d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:52.175 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-10-14T12:33:52.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f106806af00 msgr2=0x7f106806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f106806af00 0x7f106806d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f107c001670 tx=0x7f107c007ad0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f108806eb10 msgr2=0x7f10881f1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f108806eb10 0x7f10881f1cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f108000b9b0 tx=0x7f108000bcc0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 shutdown_connections 2023-10-14T12:33:52.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 shutdown_connections 2023-10-14T12:33:52.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f106806af00 0x7f106806d3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10881f2230 0x7f1088157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f108806daf0 0x7f10881ee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 --2- 172.21.15.72:0/3591003076 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f108806eb10 0x7f10881f1cf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 >> 172.21.15.72:0/3591003076 conn(0x7f10880cbad0 msgr2=0x7f10880aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7fc3b77fe700 1 -- 172.21.15.72:0/1125694657 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3c0057ca0 con 0x7fc3d0071210 2023-10-14T12:33:52.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f0458668700 1 -- 172.21.15.72:0/1335336152 wait complete. 2023-10-14T12:33:52.179 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:52.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 shutdown_connections 2023-10-14T12:33:52.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f45dc0051a0 con 0x7f45f80b27c0 2023-10-14T12:33:52.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.171+0000 7f108cfe4700 1 -- 172.21.15.72:0/3591003076 wait complete. 2023-10-14T12:33:52.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.172+0000 7f45e6ffd700 1 -- 172.21.15.72:0/1259649516 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45f0019020 con 0x7f45f80b27c0 2023-10-14T12:33:52.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.174+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f440c06aed0 msgr2=0x7f440c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.174+0000 7f442f693700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f440c06aed0 0x7f440c06d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44240090b0 tx=0x7f4424013040 comp rx=0 tx=0).stop 2023-10-14T12:33:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.174+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4428072520 msgr2=0x7f442815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.174+0000 7f442f693700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4428072520 0x7f442815cc60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f441800c500 tx=0x7f441800c8c0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.182 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-10-14T12:33:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.174+0000 7f069eac4700 1 -- 172.21.15.72:0/3400392371 wait complete. 2023-10-14T12:33:52.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.175+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc3bc06af00 msgr2=0x7fc3bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.175+0000 7fc3d5035700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc3bc06af00 0x7fc3bc06d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4006fd0 tx=0x7fc3c4008040 comp rx=0 tx=0).stop 2023-10-14T12:33:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.175+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d0071210 msgr2=0x7fc3d0164530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.175+0000 7fc3d5035700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d0071210 0x7fc3d0164530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000b550 tx=0x7fc3c000b910 comp rx=0 tx=0).stop 2023-10-14T12:33:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.177+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 shutdown_connections 2023-10-14T12:33:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.177+0000 7f442f693700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f440c06aed0 0x7f440c06d390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.177+0000 7f442f693700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44281598a0 0x7f442815ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.177+0000 7f442f693700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4428071ad0 0x7f44280c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.177+0000 7f442f693700 1 --2- 172.21.15.72:0/4190136309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4428072520 0x7f442815cc60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.177+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 >> 172.21.15.72:0/4190136309 conn(0x7f44280b1100 msgr2=0x7f4428154d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45e006b080 msgr2=0x7f45e006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7f45fceef700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45e006b080 0x7f45e006d540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f45e8006fd0 tx=0x7f45e8008040 comp rx=0 tx=0).stop 2023-10-14T12:33:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80b27c0 msgr2=0x7f45f814e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7f45fceef700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80b27c0 0x7f45f814e220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45f000b990 tx=0x7f45f000bd50 comp rx=0 tx=0).stop 2023-10-14T12:33:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa58c06af50 msgr2=0x7fa58c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa58c06af50 0x7fa58c06d410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5a806fea0 tx=0x7fa59c007a40 comp rx=0 tx=0).stop 2023-10-14T12:33:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5a806ad60 msgr2=0x7fa5a815dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5a806ad60 0x7fa5a815dba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa594000c00 tx=0x7fa594004750 comp rx=0 tx=0).stop 2023-10-14T12:33:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 shutdown_connections 2023-10-14T12:33:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa58c06af50 0x7fa58c06d410 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5a806fea0 tx=0x7fa59c007a40 comp rx=0 tx=0).stop 2023-10-14T12:33:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a815cd50 0x7fa5a80cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5a806ad60 0x7fa5a815dba0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 --2- 172.21.15.72:0/4177664283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa5a80c5730 0x7fa5a81346a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.178+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 >> 172.21.15.72:0/4177664283 conn(0x7fa5a80d0180 msgr2=0x7fa5a80b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.179+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 shutdown_connections 2023-10-14T12:33:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.179+0000 7fc3d5035700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc3bc06af00 0x7fc3bc06d3c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.179+0000 7fc3d5035700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3d00715f0 0x7fc3d0164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.179+0000 7fc3d5035700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc3d006bf80 0x7fc3d00cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.179+0000 7fc3d5035700 1 --2- 172.21.15.72:0/1125694657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3d0071210 0x7fc3d0164530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.179+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 >> 172.21.15.72:0/1125694657 conn(0x7fc3d00cfcd0 msgr2=0x7fc3d00d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.179+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 shutdown_connections 2023-10-14T12:33:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.179+0000 7fc3d5035700 1 -- 172.21.15.72:0/1125694657 wait complete. 2023-10-14T12:33:52.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.180+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 shutdown_connections 2023-10-14T12:33:52.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.180+0000 7f45fceef700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45e006b080 0x7f45e006d540 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.180+0000 7f45fceef700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45f80b27c0 0x7f45f814e220 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.180+0000 7f45fceef700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45f8071d90 0x7f45f80c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.180+0000 7f45fceef700 1 --2- 172.21.15.72:0/1259649516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45f80af560 0x7f45f80b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:52.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.180+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 >> 172.21.15.72:0/1259649516 conn(0x7f45f80d0180 msgr2=0x7f45f815c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:52.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.180+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 shutdown_connections 2023-10-14T12:33:52.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.180+0000 7f45fceef700 1 -- 172.21.15.72:0/1259649516 wait complete. 2023-10-14T12:33:52.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.182+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 shutdown_connections 2023-10-14T12:33:52.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.182+0000 7f442f693700 1 -- 172.21.15.72:0/4190136309 wait complete. 2023-10-14T12:33:52.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.184+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 shutdown_connections 2023-10-14T12:33:52.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:52.188+0000 7fa5aeb82700 1 -- 172.21.15.72:0/4177664283 wait complete. 2023-10-14T12:33:52.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-10-14T12:33:52.196 DEBUG:teuthology.parallel:result is None 2023-10-14T12:33:52.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-10-14T12:33:52.198 DEBUG:teuthology.parallel:result is None 2023-10-14T12:33:52.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-10-14T12:33:52.199 DEBUG:teuthology.parallel:result is None 2023-10-14T12:33:52.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-10-14T12:33:52.200 DEBUG:teuthology.parallel:result is None 2023-10-14T12:33:52.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-10-14T12:33:52.203 DEBUG:teuthology.parallel:result is None 2023-10-14T12:33:52.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-10-14T12:33:52.207 DEBUG:teuthology.parallel:result is None 2023-10-14T12:33:52.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-10-14T12:33:52.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2023-10-14T12:33:53.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T12:33:53.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T12:33:53.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.349+0000 7f030f651700 1 Processor -- start 2023-10-14T12:33:53.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.349+0000 7f6682571700 1 Processor -- start 2023-10-14T12:33:53.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.350+0000 7f030f651700 1 -- start start 2023-10-14T12:33:53.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.350+0000 7f6682571700 1 -- start start 2023-10-14T12:33:53.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.350+0000 7f6682571700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f667c140800 0x7f667c0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.350+0000 7f6682571700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c0b5770 0x7f667c140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.350+0000 7f6682571700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0b4da0 con 0x7f667c141120 2023-10-14T12:33:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.350+0000 7f6682571700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c141c10 con 0x7f667c140800 2023-10-14T12:33:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.350+0000 7f6682571700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0b4820 con 0x7f667c0b5770 2023-10-14T12:33:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f667c140800 0x7f667c0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f667c140800 0x7f667c0b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46952/0 (socket says 172.21.15.72:46952) 2023-10-14T12:33:53.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f6680b0e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f667c141120 0x7f667c06a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53256/0 (socket says 172.21.15.72:53256) 2023-10-14T12:33:53.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667bfff700 1 -- 172.21.15.72:0/426070006 learned_addr learned my addr 172.21.15.72:0/426070006 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:53.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f6673fff700 1 --2- 172.21.15.72:0/426070006 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c0b5770 0x7f667c140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667bfff700 1 -- 172.21.15.72:0/426070006 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c0b5770 msgr2=0x7f667c140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:53.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667bfff700 1 --2- 172.21.15.72:0/426070006 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c0b5770 0x7f667c140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667bfff700 1 -- 172.21.15.72:0/426070006 >> v1:172.21.15.72:6789/0 conn(0x7f667c141120 legacy=0x7f667c06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030f651700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f030815d890 0x7f03080ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030f651700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f030806bef0 0x7f03080b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030f651700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03080ceab0 con 0x7f03080ce610 2023-10-14T12:33:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030f651700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03080ced90 con 0x7f030815d890 2023-10-14T12:33:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030f651700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03080cf070 con 0x7f030806bef0 2023-10-14T12:33:53.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030cbec700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f03080ce610 0x7f030806b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53260/0 (socket says 172.21.15.72:53260) 2023-10-14T12:33:53.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030cbec700 1 -- 172.21.15.72:0/2441304398 learned_addr learned my addr 172.21.15.72:0/2441304398 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:53.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667b7fe700 1 -- 172.21.15.72:0/426070006 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449746973 0 0) 0x7f667c0b4da0 con 0x7f667c141120 2023-10-14T12:33:53.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667bfff700 1 -- 172.21.15.72:0/426070006 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c141650 con 0x7f667c140800 2023-10-14T12:33:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030dbee700 1 --2- 172.21.15.72:0/2441304398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f030806bef0 0x7f03080b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030d3ed700 1 --2- 172.21.15.72:0/2441304398 >> v2:172.21.15.72:3300/0 conn(0x7f030815d890 0x7f03080ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f02fffff700 1 -- 172.21.15.72:0/2441304398 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250027134 0 0) 0x7f03080ceab0 con 0x7f03080ce610 2023-10-14T12:33:53.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667bfff700 1 --2- 172.21.15.72:0/426070006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 0x7f667c0b5230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f666c0098f0 tx=0x7f666c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1837072ea8957b14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:53.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f02fffff700 1 -- 172.21.15.72:0/2441304398 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02f40035b0 con 0x7f03080ce610 2023-10-14T12:33:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667b7fe700 1 -- 172.21.15.72:0/426070006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00b8a0 con 0x7f667c140800 2023-10-14T12:33:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667b7fe700 1 -- 172.21.15.72:0/426070006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c00ba00 con 0x7f667c140800 2023-10-14T12:33:53.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f667b7fe700 1 -- 172.21.15.72:0/426070006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c00bd90 con 0x7f667c140800 2023-10-14T12:33:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030d3ed700 1 -- 172.21.15.72:0/2441304398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f030806bef0 msgr2=0x7f03080b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030d3ed700 1 --2- 172.21.15.72:0/2441304398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f030806bef0 0x7f03080b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030d3ed700 1 -- 172.21.15.72:0/2441304398 >> v1:172.21.15.72:6789/0 conn(0x7f03080ce610 legacy=0x7f030806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.351+0000 7f030d3ed700 1 -- 172.21.15.72:0/2441304398 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03080cf350 con 0x7f030815d890 2023-10-14T12:33:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f030dbee700 1 --2- 172.21.15.72:0/2441304398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f030806bef0 0x7f03080b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f030d3ed700 1 --2- 172.21.15.72:0/2441304398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 0x7f03080ce0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0304009840 tx=0x7f0304009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7070e8ab47b4bfa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f02fffff700 1 -- 172.21.15.72:0/2441304398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304011830 con 0x7f030815d890 2023-10-14T12:33:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f02fffff700 1 -- 172.21.15.72:0/2441304398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0304011990 con 0x7f030815d890 2023-10-14T12:33:53.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f02fffff700 1 -- 172.21.15.72:0/2441304398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304011d20 con 0x7f030815d890 2023-10-14T12:33:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f6682571700 1 -- 172.21.15.72:0/426070006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 msgr2=0x7f667c0b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f6682571700 1 --2- 172.21.15.72:0/426070006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 0x7f667c0b5230 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f666c0098f0 tx=0x7f666c009c00 comp rx=0 tx=0).stop 2023-10-14T12:33:53.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f6682571700 1 -- 172.21.15.72:0/426070006 shutdown_connections 2023-10-14T12:33:53.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f6682571700 1 --2- 172.21.15.72:0/426070006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 0x7f667c0b5230 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f6682571700 1 --2- 172.21.15.72:0/426070006 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c0b5770 0x7f667c140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f6682571700 1 -- 172.21.15.72:0/426070006 >> 172.21.15.72:0/426070006 conn(0x7f667c0b1620 msgr2=0x7f667c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:53.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f6682571700 1 -- 172.21.15.72:0/426070006 shutdown_connections 2023-10-14T12:33:53.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.352+0000 7f6682571700 1 -- 172.21.15.72:0/426070006 wait complete. 2023-10-14T12:33:53.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.353+0000 7f030f651700 1 -- 172.21.15.72:0/2441304398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 msgr2=0x7f03080ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.353+0000 7f030f651700 1 --2- 172.21.15.72:0/2441304398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 0x7f03080ce0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0304009840 tx=0x7f0304009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.353+0000 7f030f651700 1 -- 172.21.15.72:0/2441304398 shutdown_connections 2023-10-14T12:33:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.353+0000 7f030f651700 1 --2- 172.21.15.72:0/2441304398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f030806bef0 0x7f03080b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.353+0000 7f030f651700 1 --2- 172.21.15.72:0/2441304398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 0x7f03080ce0d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.353+0000 7f030f651700 1 -- 172.21.15.72:0/2441304398 >> 172.21.15.72:0/2441304398 conn(0x7f0308072340 msgr2=0x7f0308072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.353+0000 7f030f651700 1 -- 172.21.15.72:0/2441304398 shutdown_connections 2023-10-14T12:33:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.353+0000 7f030f651700 1 -- 172.21.15.72:0/2441304398 wait complete. 2023-10-14T12:33:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.354+0000 7f6682571700 1 Processor -- start 2023-10-14T12:33:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.354+0000 7f6682571700 1 -- start start 2023-10-14T12:33:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.354+0000 7f6682571700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 0x7f667c1f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.354+0000 7f6682571700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c141120 0x7f667c1f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.354+0000 7f6682571700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f667c1f61e0 0x7f667c15c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.354+0000 7f6682571700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1f3bd0 con 0x7f667c140800 2023-10-14T12:33:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.354+0000 7f6682571700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0cd4e0 con 0x7f667c1f61e0 2023-10-14T12:33:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.354+0000 7f6682571700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1f66e0 con 0x7f667c141120 2023-10-14T12:33:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f667bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 0x7f667c1f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f667bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 0x7f667c1f3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46964/0 (socket says 172.21.15.72:46964) 2023-10-14T12:33:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f667bfff700 1 -- 172.21.15.72:0/1776376813 learned_addr learned my addr 172.21.15.72:0/1776376813 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f030f651700 1 Processor -- start 2023-10-14T12:33:53.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f030f651700 1 -- start start 2023-10-14T12:33:53.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f6673fff700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c141120 0x7f667c1f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f6680b0e700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f667c1f61e0 0x7f667c15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f667bfff700 1 -- 172.21.15.72:0/1776376813 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c141120 msgr2=0x7f667c1f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f667bfff700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c141120 0x7f667c1f24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f667bfff700 1 -- 172.21.15.72:0/1776376813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f667c1f61e0 msgr2=0x7f667c15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f667bfff700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f667c1f61e0 0x7f667c15c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f667bfff700 1 -- 172.21.15.72:0/1776376813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009550 con 0x7f667c140800 2023-10-14T12:33:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f667bfff700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 0x7f667c1f3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f666c009c40 tx=0x7f666c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f66797fa700 1 -- 172.21.15.72:0/1776376813 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c004380 con 0x7f667c140800 2023-10-14T12:33:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f66797fa700 1 -- 172.21.15.72:0/1776376813 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c01f070 con 0x7f667c140800 2023-10-14T12:33:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f66797fa700 1 -- 172.21.15.72:0/1776376813 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0036a0 con 0x7f667c140800 2023-10-14T12:33:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c1f69c0 con 0x7f667c140800 2023-10-14T12:33:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.355+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c1f6f80 con 0x7f667c140800 2023-10-14T12:33:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030f651700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f030806bef0 0x7f030815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030f651700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03080ce610 0x7f03081606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030f651700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 0x7f03081485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030f651700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030815fa70 con 0x7f030815d890 2023-10-14T12:33:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030f651700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0308160c20 con 0x7f030806bef0 2023-10-14T12:33:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030f651700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030815ee60 con 0x7f03080ce610 2023-10-14T12:33:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030d3ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f030806bef0 0x7f030815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030d3ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f030806bef0 0x7f030815e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:35122/0 (socket says 172.21.15.72:35122) 2023-10-14T12:33:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030d3ed700 1 -- 172.21.15.72:0/1488871242 learned_addr learned my addr 172.21.15.72:0/1488871242 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030dbee700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 0x7f03081485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030cbec700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03080ce610 0x7f03081606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030d3ed700 1 -- 172.21.15.72:0/1488871242 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03080ce610 msgr2=0x7f03081606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030d3ed700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03080ce610 0x7f03081606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030d3ed700 1 -- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 msgr2=0x7f03081485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030d3ed700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 0x7f03081485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030d3ed700 1 -- 172.21.15.72:0/1488871242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300009a70 con 0x7f030806bef0 2023-10-14T12:33:53.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f030dbee700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 0x7f03081485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:53.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.356+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c04ebb0 con 0x7f667c140800 2023-10-14T12:33:53.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.357+0000 7f030d3ed700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f030806bef0 0x7f030815e7d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0304009fd0 tx=0x7f0304004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:53.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.357+0000 7f02fdffb700 1 -- 172.21.15.72:0/1488871242 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304004550 con 0x7f030806bef0 2023-10-14T12:33:53.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.357+0000 7f02fdffb700 1 -- 172.21.15.72:0/1488871242 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030401e070 con 0x7f030806bef0 2023-10-14T12:33:53.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.357+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03040094a0 con 0x7f030806bef0 2023-10-14T12:33:53.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.357+0000 7f02fdffb700 1 -- 172.21.15.72:0/1488871242 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03040038e0 con 0x7f030806bef0 2023-10-14T12:33:53.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.357+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03080cfcd0 con 0x7f030806bef0 2023-10-14T12:33:53.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.357+0000 7f66797fa700 1 -- 172.21.15.72:0/1776376813 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f666c021030 con 0x7f667c140800 2023-10-14T12:33:53.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.357+0000 7f66797fa700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f665c06af00 0x7f665c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.358+0000 7f66797fa700 1 -- 172.21.15.72:0/1776376813 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f666c08ad20 con 0x7f667c140800 2023-10-14T12:33:53.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.358+0000 7f6673fff700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f665c06af00 0x7f665c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.358+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030804ebb0 con 0x7f030806bef0 2023-10-14T12:33:53.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.358+0000 7f6673fff700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f665c06af00 0x7f665c06d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ad160 tx=0x7f6664008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:53.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.358+0000 7f02fdffb700 1 -- 172.21.15.72:0/1488871242 <== mon.1 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0304003a40 con 0x7f030806bef0 2023-10-14T12:33:53.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.359+0000 7f02fdffb700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02ec06af00 0x7f02ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.359+0000 7f02fdffb700 1 -- 172.21.15.72:0/1488871242 <== mon.1 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f030408a730 con 0x7f030806bef0 2023-10-14T12:33:53.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.359+0000 7f030cbec700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02ec06af00 0x7f02ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.359+0000 7f030cbec700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02ec06af00 0x7f02ec06d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03081604a0 tx=0x7f02f8007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:53.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.362+0000 7f66797fa700 1 -- 172.21.15.72:0/1776376813 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f666c055c90 con 0x7f667c140800 2023-10-14T12:33:53.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.364+0000 7f02fdffb700 1 -- 172.21.15.72:0/1488871242 <== mon.1 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0304055470 con 0x7f030806bef0 2023-10-14T12:33:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.556+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f667c06d150 con 0x7f667c140800 2023-10-14T12:33:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.557+0000 7f66797fa700 1 -- 172.21.15.72:0/1776376813 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f666c015020 con 0x7f667c140800 2023-10-14T12:33:53.559 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f665c06af00 msgr2=0x7f665c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f665c06af00 0x7f665c06d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ad160 tx=0x7f6664008040 comp rx=0 tx=0).stop 2023-10-14T12:33:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 msgr2=0x7f667c1f3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 0x7f667c1f3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f666c009c40 tx=0x7f666c004750 comp rx=0 tx=0).stop 2023-10-14T12:33:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 shutdown_connections 2023-10-14T12:33:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f665c06af00 0x7f665c06d3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f667c1f61e0 0x7f667c15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f667c140800 0x7f667c1f3690 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 --2- 172.21.15.72:0/1776376813 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f667c141120 0x7f667c1f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 >> 172.21.15.72:0/1776376813 conn(0x7f667c0b1620 msgr2=0x7f667c06f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 shutdown_connections 2023-10-14T12:33:53.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.559+0000 7f6682571700 1 -- 172.21.15.72:0/1776376813 wait complete. 2023-10-14T12:33:53.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.563+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f03080d4380 con 0x7f030806bef0 2023-10-14T12:33:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.564+0000 7f02fdffb700 1 -- 172.21.15.72:0/1488871242 <== mon.1 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0304058a90 con 0x7f030806bef0 2023-10-14T12:33:53.565 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-10-14T12:33:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02ec06af00 msgr2=0x7f02ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02ec06af00 0x7f02ec06d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f03081604a0 tx=0x7f02f8007dc0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f030806bef0 msgr2=0x7f030815e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f030806bef0 0x7f030815e7d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0304009fd0 tx=0x7f0304004750 comp rx=0 tx=0).stop 2023-10-14T12:33:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 shutdown_connections 2023-10-14T12:33:53.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02ec06af00 0x7f02ec06d3c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030815d890 0x7f03081485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f030806bef0 0x7f030815e7d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 --2- 172.21.15.72:0/1488871242 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f03080ce610 0x7f03081606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 >> 172.21.15.72:0/1488871242 conn(0x7f0308072340 msgr2=0x7f030815bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:53.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 shutdown_connections 2023-10-14T12:33:53.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.566+0000 7f030f651700 1 -- 172.21.15.72:0/1488871242 wait complete. 2023-10-14T12:33:53.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-10-14T12:33:53.574 DEBUG:teuthology.parallel:result is None 2023-10-14T12:33:53.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-10-14T12:33:53.580 DEBUG:teuthology.parallel:result is None 2023-10-14T12:33:53.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T12:33:53.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:33:53.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.740+0000 7fe0af22d700 1 Processor -- start 2023-10-14T12:33:53.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.740+0000 7fe0af22d700 1 -- start start 2023-10-14T12:33:53.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.740+0000 7fe0af22d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0a80cd4b0 0x7fe0a806e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.740+0000 7fe0af22d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe0a806bf80 0x7fe0a80cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.740+0000 7fe0af22d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a815ec80 con 0x7fe0a806d070 2023-10-14T12:33:53.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.740+0000 7fe0af22d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a8161260 con 0x7fe0a80cd4b0 2023-10-14T12:33:53.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.740+0000 7fe0af22d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a8161b00 con 0x7fe0a806bf80 2023-10-14T12:33:53.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0acfc9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0a80cd4b0 0x7fe0a806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0acfc9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0a80cd4b0 0x7fe0a806e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46980/0 (socket says 172.21.15.72:46980) 2023-10-14T12:33:53.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0acfc9700 1 -- 172.21.15.72:0/1039267471 learned_addr learned my addr 172.21.15.72:0/1039267471 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0a7fff700 1 --2- 172.21.15.72:0/1039267471 >> v2:172.21.15.123:3300/0 conn(0x7fe0a806bf80 0x7fe0a80cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0acfc9700 1 -- 172.21.15.72:0/1039267471 >> v2:172.21.15.123:3300/0 conn(0x7fe0a806bf80 msgr2=0x7fe0a80cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0acfc9700 1 --2- 172.21.15.72:0/1039267471 >> v2:172.21.15.123:3300/0 conn(0x7fe0a806bf80 0x7fe0a80cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0acfc9700 1 -- 172.21.15.72:0/1039267471 >> v1:172.21.15.123:6789/0 conn(0x7fe0a806d070 legacy=0x7fe0a806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0acfc9700 1 -- 172.21.15.72:0/1039267471 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a806e7d0 con 0x7fe0a80cd4b0 2023-10-14T12:33:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0acfc9700 1 --2- 172.21.15.72:0/1039267471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a80cd4b0 0x7fe0a806e290 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80aea90 tx=0x7fe09c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c79f34ae2c17c9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0a77fe700 1 -- 172.21.15.72:0/1039267471 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00b870 con 0x7fe0a80cd4b0 2023-10-14T12:33:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0a77fe700 1 -- 172.21.15.72:0/1039267471 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c00b9d0 con 0x7fe0a80cd4b0 2023-10-14T12:33:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.741+0000 7fe0a77fe700 1 -- 172.21.15.72:0/1039267471 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c00bd60 con 0x7fe0a80cd4b0 2023-10-14T12:33:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.742+0000 7fe0af22d700 1 -- 172.21.15.72:0/1039267471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a80cd4b0 msgr2=0x7fe0a806e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.742+0000 7fe0af22d700 1 --2- 172.21.15.72:0/1039267471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a80cd4b0 0x7fe0a806e290 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe0a80aea90 tx=0x7fe09c009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.742+0000 7fe0af22d700 1 -- 172.21.15.72:0/1039267471 shutdown_connections 2023-10-14T12:33:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.742+0000 7fe0af22d700 1 --2- 172.21.15.72:0/1039267471 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a80cd4b0 0x7fe0a806e290 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.742+0000 7fe0af22d700 1 --2- 172.21.15.72:0/1039267471 >> v2:172.21.15.123:3300/0 conn(0x7fe0a806bf80 0x7fe0a80cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.742+0000 7fe0af22d700 1 -- 172.21.15.72:0/1039267471 >> 172.21.15.72:0/1039267471 conn(0x7fe0a80cfcd0 msgr2=0x7fe0a80d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.742+0000 7fe0af22d700 1 -- 172.21.15.72:0/1039267471 shutdown_connections 2023-10-14T12:33:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.742+0000 7fe0af22d700 1 -- 172.21.15.72:0/1039267471 wait complete. 2023-10-14T12:33:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.743+0000 7fe0af22d700 1 Processor -- start 2023-10-14T12:33:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.743+0000 7fe0af22d700 1 -- start start 2023-10-14T12:33:53.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0af22d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0a806bf80 0x7fe0a81f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0af22d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a806d070 0x7fe0a8150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0af22d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe0a80cd4b0 0x7fe0a80c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0af22d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81520f0 con 0x7fe0a806d070 2023-10-14T12:33:53.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0af22d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81523d0 con 0x7fe0a806bf80 2023-10-14T12:33:53.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0af22d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81526b0 con 0x7fe0a80cd4b0 2023-10-14T12:33:53.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0a7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a806d070 0x7fe0a8150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0a7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a806d070 0x7fe0a8150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46986/0 (socket says 172.21.15.72:46986) 2023-10-14T12:33:53.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0a7fff700 1 -- 172.21.15.72:0/3636329437 learned_addr learned my addr 172.21.15.72:0/3636329437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:53.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0acfc9700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0a806bf80 0x7fe0a81f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0ad7ca700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe0a80cd4b0 0x7fe0a80c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0a7fff700 1 -- 172.21.15.72:0/3636329437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe0a80cd4b0 msgr2=0x7fe0a80c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0a7fff700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe0a80cd4b0 0x7fe0a80c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0a7fff700 1 -- 172.21.15.72:0/3636329437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0a806bf80 msgr2=0x7fe0a81f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0a7fff700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0a806bf80 0x7fe0a81f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0a7fff700 1 -- 172.21.15.72:0/3636329437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c009550 con 0x7fe0a806d070 2023-10-14T12:33:53.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.744+0000 7fe0a7fff700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a806d070 0x7fe0a8150d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe09400d800 tx=0x7fe09400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:53.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.745+0000 7fe0a57fa700 1 -- 172.21.15.72:0/3636329437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940126b0 con 0x7fe0a806d070 2023-10-14T12:33:53.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.745+0000 7fe0a57fa700 1 -- 172.21.15.72:0/3636329437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094012810 con 0x7fe0a806d070 2023-10-14T12:33:53.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.745+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a8152990 con 0x7fe0a806d070 2023-10-14T12:33:53.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.745+0000 7fe0a57fa700 1 -- 172.21.15.72:0/3636329437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094012bc0 con 0x7fe0a806d070 2023-10-14T12:33:53.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.745+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a80c4e70 con 0x7fe0a806d070 2023-10-14T12:33:53.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.746+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a8152bd0 con 0x7fe0a806d070 2023-10-14T12:33:53.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.746+0000 7fe0a57fa700 1 -- 172.21.15.72:0/3636329437 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe094012d20 con 0x7fe0a806d070 2023-10-14T12:33:53.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.746+0000 7fe0a57fa700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe08c06af00 0x7fe08c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:53.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.746+0000 7fe0a57fa700 1 -- 172.21.15.72:0/3636329437 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0940898e0 con 0x7fe0a806d070 2023-10-14T12:33:53.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.746+0000 7fe0acfc9700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe08c06af00 0x7fe08c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:53.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.747+0000 7fe0acfc9700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe08c06af00 0x7fe08c06d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:53.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.751+0000 7fe0a57fa700 1 -- 172.21.15.72:0/3636329437 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0a8152bd0 con 0x7fe0a806d070 2023-10-14T12:33:53.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.937+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0a8152540 con 0x7fe08c06af00 2023-10-14T12:33:53.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.946+0000 7fe0a57fa700 1 -- 172.21.15.72:0/3636329437 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345256 (secure 0 0 0) 0x7fe0a8152540 con 0x7fe08c06af00 2023-10-14T12:33:53.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:53.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe08c06af00 msgr2=0x7fe08c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe08c06af00 0x7fe08c06d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c008030 comp rx=0 tx=0).stop 2023-10-14T12:33:53.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a806d070 msgr2=0x7fe0a8150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:53.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a806d070 0x7fe0a8150d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe09400d800 tx=0x7fe09400db10 comp rx=0 tx=0).stop 2023-10-14T12:33:53.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 shutdown_connections 2023-10-14T12:33:53.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe08c06af00 0x7fe08c06d3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe0a80cd4b0 0x7fe0a80c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0a806bf80 0x7fe0a81f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 --2- 172.21.15.72:0/3636329437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0a806d070 0x7fe0a8150d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:53.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 >> 172.21.15.72:0/3636329437 conn(0x7fe0a80cfcd0 msgr2=0x7fe0a80ac950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:53.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 shutdown_connections 2023-10-14T12:33:53.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:53.950+0000 7fe0af22d700 1 -- 172.21.15.72:0/3636329437 wait complete. 2023-10-14T12:33:53.957 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:33:53.963 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-14T12:33:53.389101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002864"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839274+0000","last_change":"2023-10-14T12:33:31.821005+0000","last_active":"2023-10-14T12:33:35.839274+0000","last_peered":"2023-10-14T12:33:35.839274+0000","last_clean":"2023-10-14T12:33:35.839274+0000","last_became_active":"2023-10-14T12:33:31.820734+0000","last_became_peered":"2023-10-14T12:33:31.820734+0000","last_unstale":"2023-10-14T12:33:35.839274+0000","last_undegraded":"2023-10-14T12:33:35.839274+0000","last_fullsized":"2023-10-14T12:33:35.839274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:09.495473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854834+0000","last_change":"2023-10-14T12:33:31.821170+0000","last_active":"2023-10-14T12:33:35.854834+0000","last_peered":"2023-10-14T12:33:35.854834+0000","last_clean":"2023-10-14T12:33:35.854834+0000","last_became_active":"2023-10-14T12:33:31.820856+0000","last_became_peered":"2023-10-14T12:33:31.820856+0000","last_unstale":"2023-10-14T12:33:35.854834+0000","last_undegraded":"2023-10-14T12:33:35.854834+0000","last_fullsized":"2023-10-14T12:33:35.854834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851677+0000","last_change":"2023-10-14T12:33:31.819460+0000","last_active":"2023-10-14T12:33:35.851677+0000","last_peered":"2023-10-14T12:33:35.851677+0000","last_clean":"2023-10-14T12:33:35.851677+0000","last_became_active":"2023-10-14T12:33:31.819214+0000","last_became_peered":"2023-10-14T12:33:31.819214+0000","last_unstale":"2023-10-14T12:33:35.851677+0000","last_undegraded":"2023-10-14T12:33:35.851677+0000","last_fullsized":"2023-10-14T12:33:35.851677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:45.477157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847884+0000","last_change":"2023-10-14T12:33:31.866158+0000","last_active":"2023-10-14T12:33:35.847884+0000","last_peered":"2023-10-14T12:33:35.847884+0000","last_clean":"2023-10-14T12:33:35.847884+0000","last_became_active":"2023-10-14T12:33:31.865728+0000","last_became_peered":"2023-10-14T12:33:31.865728+0000","last_unstale":"2023-10-14T12:33:35.847884+0000","last_undegraded":"2023-10-14T12:33:35.847884+0000","last_fullsized":"2023-10-14T12:33:35.847884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839008+0000","last_change":"2023-10-14T12:33:31.819060+0000","last_active":"2023-10-14T12:33:35.839008+0000","last_peered":"2023-10-14T12:33:35.839008+0000","last_clean":"2023-10-14T12:33:35.839008+0000","last_became_active":"2023-10-14T12:33:31.818717+0000","last_became_peered":"2023-10-14T12:33:31.818717+0000","last_unstale":"2023-10-14T12:33:35.839008+0000","last_undegraded":"2023-10-14T12:33:35.839008+0000","last_fullsized":"2023-10-14T12:33:35.839008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847401+0000","last_change":"2023-10-14T12:33:31.866358+0000","last_active":"2023-10-14T12:33:35.847401+0000","last_peered":"2023-10-14T12:33:35.847401+0000","last_clean":"2023-10-14T12:33:35.847401+0000","last_became_active":"2023-10-14T12:33:31.865112+0000","last_became_peered":"2023-10-14T12:33:31.865112+0000","last_unstale":"2023-10-14T12:33:35.847401+0000","last_undegraded":"2023-10-14T12:33:35.847401+0000","last_fullsized":"2023-10-14T12:33:35.847401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838459+0000","last_change":"2023-10-14T12:33:31.821764+0000","last_active":"2023-10-14T12:33:35.838459+0000","last_peered":"2023-10-14T12:33:35.838459+0000","last_clean":"2023-10-14T12:33:35.838459+0000","last_became_active":"2023-10-14T12:33:31.821450+0000","last_became_peered":"2023-10-14T12:33:31.821450+0000","last_unstale":"2023-10-14T12:33:35.838459+0000","last_undegraded":"2023-10-14T12:33:35.838459+0000","last_fullsized":"2023-10-14T12:33:35.838459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.850717+0000","last_change":"2023-10-14T12:33:31.861876+0000","last_active":"2023-10-14T12:33:35.850717+0000","last_peered":"2023-10-14T12:33:35.850717+0000","last_clean":"2023-10-14T12:33:35.850717+0000","last_became_active":"2023-10-14T12:33:31.861620+0000","last_became_peered":"2023-10-14T12:33:31.861620+0000","last_unstale":"2023-10-14T12:33:35.850717+0000","last_undegraded":"2023-10-14T12:33:35.850717+0000","last_fullsized":"2023-10-14T12:33:35.850717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839160+0000","last_change":"2023-10-14T12:33:31.863420+0000","last_active":"2023-10-14T12:33:35.839160+0000","last_peered":"2023-10-14T12:33:35.839160+0000","last_clean":"2023-10-14T12:33:35.839160+0000","last_became_active":"2023-10-14T12:33:31.863132+0000","last_became_peered":"2023-10-14T12:33:31.863132+0000","last_unstale":"2023-10-14T12:33:35.839160+0000","last_undegraded":"2023-10-14T12:33:35.839160+0000","last_fullsized":"2023-10-14T12:33:35.839160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:19.041798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.845863+0000","last_change":"2023-10-14T12:33:31.863478+0000","last_active":"2023-10-14T12:33:35.845863+0000","last_peered":"2023-10-14T12:33:35.845863+0000","last_clean":"2023-10-14T12:33:35.845863+0000","last_became_active":"2023-10-14T12:33:31.863150+0000","last_became_peered":"2023-10-14T12:33:31.863150+0000","last_unstale":"2023-10-14T12:33:35.845863+0000","last_undegraded":"2023-10-14T12:33:35.845863+0000","last_fullsized":"2023-10-14T12:33:35.845863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.845900+0000","last_change":"2023-10-14T12:33:31.866438+0000","last_active":"2023-10-14T12:33:35.845900+0000","last_peered":"2023-10-14T12:33:35.845900+0000","last_clean":"2023-10-14T12:33:35.845900+0000","last_became_active":"2023-10-14T12:33:31.866147+0000","last_became_peered":"2023-10-14T12:33:31.866147+0000","last_unstale":"2023-10-14T12:33:35.845900+0000","last_undegraded":"2023-10-14T12:33:35.845900+0000","last_fullsized":"2023-10-14T12:33:35.845900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839597+0000","last_change":"2023-10-14T12:33:31.829329+0000","last_active":"2023-10-14T12:33:35.839597+0000","last_peered":"2023-10-14T12:33:35.839597+0000","last_clean":"2023-10-14T12:33:35.839597+0000","last_became_active":"2023-10-14T12:33:31.828803+0000","last_became_peered":"2023-10-14T12:33:31.828803+0000","last_unstale":"2023-10-14T12:33:35.839597+0000","last_undegraded":"2023-10-14T12:33:35.839597+0000","last_fullsized":"2023-10-14T12:33:35.839597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:34.169023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844063+0000","last_change":"2023-10-14T12:33:31.817287+0000","last_active":"2023-10-14T12:33:35.844063+0000","last_peered":"2023-10-14T12:33:35.844063+0000","last_clean":"2023-10-14T12:33:35.844063+0000","last_became_active":"2023-10-14T12:33:31.817007+0000","last_became_peered":"2023-10-14T12:33:31.817007+0000","last_unstale":"2023-10-14T12:33:35.844063+0000","last_undegraded":"2023-10-14T12:33:35.844063+0000","last_fullsized":"2023-10-14T12:33:35.844063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852024+0000","last_change":"2023-10-14T12:33:31.818967+0000","last_active":"2023-10-14T12:33:35.852024+0000","last_peered":"2023-10-14T12:33:35.852024+0000","last_clean":"2023-10-14T12:33:35.852024+0000","last_became_active":"2023-10-14T12:33:31.818735+0000","last_became_peered":"2023-10-14T12:33:31.818735+0000","last_unstale":"2023-10-14T12:33:35.852024+0000","last_undegraded":"2023-10-14T12:33:35.852024+0000","last_fullsized":"2023-10-14T12:33:35.852024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:42.240740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854372+0000","last_change":"2023-10-14T12:33:31.834837+0000","last_active":"2023-10-14T12:33:35.854372+0000","last_peered":"2023-10-14T12:33:35.854372+0000","last_clean":"2023-10-14T12:33:35.854372+0000","last_became_active":"2023-10-14T12:33:31.834576+0000","last_became_peered":"2023-10-14T12:33:31.834576+0000","last_unstale":"2023-10-14T12:33:35.854372+0000","last_undegraded":"2023-10-14T12:33:35.854372+0000","last_fullsized":"2023-10-14T12:33:35.854372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847198+0000","last_change":"2023-10-14T12:33:31.865491+0000","last_active":"2023-10-14T12:33:35.847198+0000","last_peered":"2023-10-14T12:33:35.847198+0000","last_clean":"2023-10-14T12:33:35.847198+0000","last_became_active":"2023-10-14T12:33:31.865142+0000","last_became_peered":"2023-10-14T12:33:31.865142+0000","last_unstale":"2023-10-14T12:33:35.847198+0000","last_undegraded":"2023-10-14T12:33:35.847198+0000","last_fullsized":"2023-10-14T12:33:35.847198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848563+0000","last_change":"2023-10-14T12:33:31.861934+0000","last_active":"2023-10-14T12:33:35.848563+0000","last_peered":"2023-10-14T12:33:35.848563+0000","last_clean":"2023-10-14T12:33:35.848563+0000","last_became_active":"2023-10-14T12:33:31.861682+0000","last_became_peered":"2023-10-14T12:33:31.861682+0000","last_unstale":"2023-10-14T12:33:35.848563+0000","last_undegraded":"2023-10-14T12:33:35.848563+0000","last_fullsized":"2023-10-14T12:33:35.848563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:10.562723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.855911+0000","last_change":"2023-10-14T12:33:31.819647+0000","last_active":"2023-10-14T12:33:35.855911+0000","last_peered":"2023-10-14T12:33:35.855911+0000","last_clean":"2023-10-14T12:33:35.855911+0000","last_became_active":"2023-10-14T12:33:31.817659+0000","last_became_peered":"2023-10-14T12:33:31.817659+0000","last_unstale":"2023-10-14T12:33:35.855911+0000","last_undegraded":"2023-10-14T12:33:35.855911+0000","last_fullsized":"2023-10-14T12:33:35.855911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:54.849594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839113+0000","last_change":"2023-10-14T12:33:31.823287+0000","last_active":"2023-10-14T12:33:35.839113+0000","last_peered":"2023-10-14T12:33:35.839113+0000","last_clean":"2023-10-14T12:33:35.839113+0000","last_became_active":"2023-10-14T12:33:31.823062+0000","last_became_peered":"2023-10-14T12:33:31.823062+0000","last_unstale":"2023-10-14T12:33:35.839113+0000","last_undegraded":"2023-10-14T12:33:35.839113+0000","last_fullsized":"2023-10-14T12:33:35.839113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027435+0000","last_change":"2023-10-14T12:33:35.856495+0000","last_active":"2023-10-14T12:33:38.027435+0000","last_peered":"2023-10-14T12:33:38.027435+0000","last_clean":"2023-10-14T12:33:38.027435+0000","last_became_active":"2023-10-14T12:33:35.856098+0000","last_became_peered":"2023-10-14T12:33:35.856098+0000","last_unstale":"2023-10-14T12:33:38.027435+0000","last_undegraded":"2023-10-14T12:33:38.027435+0000","last_fullsized":"2023-10-14T12:33:38.027435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:19.985088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852656+0000","last_change":"2023-10-14T12:33:30.830266+0000","last_active":"2023-10-14T12:33:35.852656+0000","last_peered":"2023-10-14T12:33:35.852656+0000","last_clean":"2023-10-14T12:33:35.852656+0000","last_became_active":"2023-10-14T12:33:30.829974+0000","last_became_peered":"2023-10-14T12:33:30.829974+0000","last_unstale":"2023-10-14T12:33:35.852656+0000","last_undegraded":"2023-10-14T12:33:35.852656+0000","last_fullsized":"2023-10-14T12:33:35.852656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843869+0000","last_change":"2023-10-14T12:33:31.823407+0000","last_active":"2023-10-14T12:33:35.843869+0000","last_peered":"2023-10-14T12:33:35.843869+0000","last_clean":"2023-10-14T12:33:35.843869+0000","last_became_active":"2023-10-14T12:33:31.823134+0000","last_became_peered":"2023-10-14T12:33:31.823134+0000","last_unstale":"2023-10-14T12:33:35.843869+0000","last_undegraded":"2023-10-14T12:33:35.843869+0000","last_fullsized":"2023-10-14T12:33:35.843869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846110+0000","last_change":"2023-10-14T12:33:35.860480+0000","last_active":"2023-10-14T12:33:36.846110+0000","last_peered":"2023-10-14T12:33:36.846110+0000","last_clean":"2023-10-14T12:33:36.846110+0000","last_became_active":"2023-10-14T12:33:35.860054+0000","last_became_peered":"2023-10-14T12:33:35.860054+0000","last_unstale":"2023-10-14T12:33:36.846110+0000","last_undegraded":"2023-10-14T12:33:36.846110+0000","last_fullsized":"2023-10-14T12:33:36.846110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:46.147663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843810+0000","last_change":"2023-10-14T12:33:30.828686+0000","last_active":"2023-10-14T12:33:35.843810+0000","last_peered":"2023-10-14T12:33:35.843810+0000","last_clean":"2023-10-14T12:33:35.843810+0000","last_became_active":"2023-10-14T12:33:30.828358+0000","last_became_peered":"2023-10-14T12:33:30.828358+0000","last_unstale":"2023-10-14T12:33:35.843810+0000","last_undegraded":"2023-10-14T12:33:35.843810+0000","last_fullsized":"2023-10-14T12:33:35.843810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852396+0000","last_change":"2023-10-14T12:33:31.863657+0000","last_active":"2023-10-14T12:33:35.852396+0000","last_peered":"2023-10-14T12:33:35.852396+0000","last_clean":"2023-10-14T12:33:35.852396+0000","last_became_active":"2023-10-14T12:33:31.863270+0000","last_became_peered":"2023-10-14T12:33:31.863270+0000","last_unstale":"2023-10-14T12:33:35.852396+0000","last_undegraded":"2023-10-14T12:33:35.852396+0000","last_fullsized":"2023-10-14T12:33:35.852396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846369+0000","last_change":"2023-10-14T12:33:35.860669+0000","last_active":"2023-10-14T12:33:36.846369+0000","last_peered":"2023-10-14T12:33:36.846369+0000","last_clean":"2023-10-14T12:33:36.846369+0000","last_became_active":"2023-10-14T12:33:35.860172+0000","last_became_peered":"2023-10-14T12:33:35.860172+0000","last_unstale":"2023-10-14T12:33:36.846369+0000","last_undegraded":"2023-10-14T12:33:36.846369+0000","last_fullsized":"2023-10-14T12:33:36.846369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:34.560475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838805+0000","last_change":"2023-10-14T12:33:30.823902+0000","last_active":"2023-10-14T12:33:35.838805+0000","last_peered":"2023-10-14T12:33:35.838805+0000","last_clean":"2023-10-14T12:33:35.838805+0000","last_became_active":"2023-10-14T12:33:30.823644+0000","last_became_peered":"2023-10-14T12:33:30.823644+0000","last_unstale":"2023-10-14T12:33:35.838805+0000","last_undegraded":"2023-10-14T12:33:35.838805+0000","last_fullsized":"2023-10-14T12:33:35.838805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:29.522892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847636+0000","last_change":"2023-10-14T12:33:31.865659+0000","last_active":"2023-10-14T12:33:35.847636+0000","last_peered":"2023-10-14T12:33:35.847636+0000","last_clean":"2023-10-14T12:33:35.847636+0000","last_became_active":"2023-10-14T12:33:31.865277+0000","last_became_peered":"2023-10-14T12:33:31.865277+0000","last_unstale":"2023-10-14T12:33:35.847636+0000","last_undegraded":"2023-10-14T12:33:35.847636+0000","last_fullsized":"2023-10-14T12:33:35.847636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:15.636750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846392+0000","last_change":"2023-10-14T12:33:35.854228+0000","last_active":"2023-10-14T12:33:36.846392+0000","last_peered":"2023-10-14T12:33:36.846392+0000","last_clean":"2023-10-14T12:33:36.846392+0000","last_became_active":"2023-10-14T12:33:35.853491+0000","last_became_peered":"2023-10-14T12:33:35.853491+0000","last_unstale":"2023-10-14T12:33:36.846392+0000","last_undegraded":"2023-10-14T12:33:36.846392+0000","last_fullsized":"2023-10-14T12:33:36.846392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:41.319662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838457+0000","last_change":"2023-10-14T12:33:30.829300+0000","last_active":"2023-10-14T12:33:35.838457+0000","last_peered":"2023-10-14T12:33:35.838457+0000","last_clean":"2023-10-14T12:33:35.838457+0000","last_became_active":"2023-10-14T12:33:30.829047+0000","last_became_peered":"2023-10-14T12:33:30.829047+0000","last_unstale":"2023-10-14T12:33:35.838457+0000","last_undegraded":"2023-10-14T12:33:35.838457+0000","last_fullsized":"2023-10-14T12:33:35.838457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:41.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848050+0000","last_change":"2023-10-14T12:33:31.866122+0000","last_active":"2023-10-14T12:33:35.848050+0000","last_peered":"2023-10-14T12:33:35.848050+0000","last_clean":"2023-10-14T12:33:35.848050+0000","last_became_active":"2023-10-14T12:33:31.865828+0000","last_became_peered":"2023-10-14T12:33:31.865828+0000","last_unstale":"2023-10-14T12:33:35.848050+0000","last_undegraded":"2023-10-14T12:33:35.848050+0000","last_fullsized":"2023-10-14T12:33:35.848050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:13.669993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027681+0000","last_change":"2023-10-14T12:33:35.866746+0000","last_active":"2023-10-14T12:33:38.027681+0000","last_peered":"2023-10-14T12:33:38.027681+0000","last_clean":"2023-10-14T12:33:38.027681+0000","last_became_active":"2023-10-14T12:33:35.866256+0000","last_became_peered":"2023-10-14T12:33:35.866256+0000","last_unstale":"2023-10-14T12:33:38.027681+0000","last_undegraded":"2023-10-14T12:33:38.027681+0000","last_fullsized":"2023-10-14T12:33:38.027681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:45:51.637024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844274+0000","last_change":"2023-10-14T12:33:30.816017+0000","last_active":"2023-10-14T12:33:35.844274+0000","last_peered":"2023-10-14T12:33:35.844274+0000","last_clean":"2023-10-14T12:33:35.844274+0000","last_became_active":"2023-10-14T12:33:30.815728+0000","last_became_peered":"2023-10-14T12:33:30.815728+0000","last_unstale":"2023-10-14T12:33:35.844274+0000","last_undegraded":"2023-10-14T12:33:35.844274+0000","last_fullsized":"2023-10-14T12:33:35.844274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:23.740058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838523+0000","last_change":"2023-10-14T12:33:31.830404+0000","last_active":"2023-10-14T12:33:35.838523+0000","last_peered":"2023-10-14T12:33:35.838523+0000","last_clean":"2023-10-14T12:33:35.838523+0000","last_became_active":"2023-10-14T12:33:31.830125+0000","last_became_peered":"2023-10-14T12:33:31.830125+0000","last_unstale":"2023-10-14T12:33:35.838523+0000","last_undegraded":"2023-10-14T12:33:35.838523+0000","last_fullsized":"2023-10-14T12:33:35.838523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:13.312142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.318744+0000","last_change":"2023-10-14T12:33:35.865486+0000","last_active":"2023-10-14T12:33:37.318744+0000","last_peered":"2023-10-14T12:33:37.318744+0000","last_clean":"2023-10-14T12:33:37.318744+0000","last_became_active":"2023-10-14T12:33:35.865104+0000","last_became_peered":"2023-10-14T12:33:35.865104+0000","last_unstale":"2023-10-14T12:33:37.318744+0000","last_undegraded":"2023-10-14T12:33:37.318744+0000","last_fullsized":"2023-10-14T12:33:37.318744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:46.272679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846748+0000","last_change":"2023-10-14T12:33:30.818159+0000","last_active":"2023-10-14T12:33:35.846748+0000","last_peered":"2023-10-14T12:33:35.846748+0000","last_clean":"2023-10-14T12:33:35.846748+0000","last_became_active":"2023-10-14T12:33:30.817845+0000","last_became_peered":"2023-10-14T12:33:30.817845+0000","last_unstale":"2023-10-14T12:33:35.846748+0000","last_undegraded":"2023-10-14T12:33:35.846748+0000","last_fullsized":"2023-10-14T12:33:35.846748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851619+0000","last_change":"2023-10-14T12:33:31.833662+0000","last_active":"2023-10-14T12:33:35.851619+0000","last_peered":"2023-10-14T12:33:35.851619+0000","last_clean":"2023-10-14T12:33:35.851619+0000","last_became_active":"2023-10-14T12:33:31.833398+0000","last_became_peered":"2023-10-14T12:33:31.833398+0000","last_unstale":"2023-10-14T12:33:35.851619+0000","last_undegraded":"2023-10-14T12:33:35.851619+0000","last_fullsized":"2023-10-14T12:33:35.851619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.841255+0000","last_change":"2023-10-14T12:33:35.866463+0000","last_active":"2023-10-14T12:33:36.841255+0000","last_peered":"2023-10-14T12:33:36.841255+0000","last_clean":"2023-10-14T12:33:36.841255+0000","last_became_active":"2023-10-14T12:33:35.866062+0000","last_became_peered":"2023-10-14T12:33:35.866062+0000","last_unstale":"2023-10-14T12:33:36.841255+0000","last_undegraded":"2023-10-14T12:33:36.841255+0000","last_fullsized":"2023-10-14T12:33:36.841255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847361+0000","last_change":"2023-10-14T12:33:30.821259+0000","last_active":"2023-10-14T12:33:35.847361+0000","last_peered":"2023-10-14T12:33:35.847361+0000","last_clean":"2023-10-14T12:33:35.847361+0000","last_became_active":"2023-10-14T12:33:30.820962+0000","last_became_peered":"2023-10-14T12:33:30.820962+0000","last_unstale":"2023-10-14T12:33:35.847361+0000","last_undegraded":"2023-10-14T12:33:35.847361+0000","last_fullsized":"2023-10-14T12:33:35.847361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844696+0000","last_change":"2023-10-14T12:33:31.821784+0000","last_active":"2023-10-14T12:33:35.844696+0000","last_peered":"2023-10-14T12:33:35.844696+0000","last_clean":"2023-10-14T12:33:35.844696+0000","last_became_active":"2023-10-14T12:33:31.821472+0000","last_became_peered":"2023-10-14T12:33:31.821472+0000","last_unstale":"2023-10-14T12:33:35.844696+0000","last_undegraded":"2023-10-14T12:33:35.844696+0000","last_fullsized":"2023-10-14T12:33:35.844696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025944+0000","last_change":"2023-10-14T12:33:35.861224+0000","last_active":"2023-10-14T12:33:38.025944+0000","last_peered":"2023-10-14T12:33:38.025944+0000","last_clean":"2023-10-14T12:33:38.025944+0000","last_became_active":"2023-10-14T12:33:35.860816+0000","last_became_peered":"2023-10-14T12:33:35.860816+0000","last_unstale":"2023-10-14T12:33:38.025944+0000","last_undegraded":"2023-10-14T12:33:38.025944+0000","last_fullsized":"2023-10-14T12:33:38.025944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:23.073737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847265+0000","last_change":"2023-10-14T12:33:30.826762+0000","last_active":"2023-10-14T12:33:35.847265+0000","last_peered":"2023-10-14T12:33:35.847265+0000","last_clean":"2023-10-14T12:33:35.847265+0000","last_became_active":"2023-10-14T12:33:30.826477+0000","last_became_peered":"2023-10-14T12:33:30.826477+0000","last_unstale":"2023-10-14T12:33:35.847265+0000","last_undegraded":"2023-10-14T12:33:35.847265+0000","last_fullsized":"2023-10-14T12:33:35.847265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854580+0000","last_change":"2023-10-14T12:33:31.817507+0000","last_active":"2023-10-14T12:33:35.854580+0000","last_peered":"2023-10-14T12:33:35.854580+0000","last_clean":"2023-10-14T12:33:35.854580+0000","last_became_active":"2023-10-14T12:33:31.817121+0000","last_became_peered":"2023-10-14T12:33:31.817121+0000","last_unstale":"2023-10-14T12:33:35.854580+0000","last_undegraded":"2023-10-14T12:33:35.854580+0000","last_fullsized":"2023-10-14T12:33:35.854580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027281+0000","last_change":"2023-10-14T12:33:35.856441+0000","last_active":"2023-10-14T12:33:38.027281+0000","last_peered":"2023-10-14T12:33:38.027281+0000","last_clean":"2023-10-14T12:33:38.027281+0000","last_became_active":"2023-10-14T12:33:35.856034+0000","last_became_peered":"2023-10-14T12:33:35.856034+0000","last_unstale":"2023-10-14T12:33:38.027281+0000","last_undegraded":"2023-10-14T12:33:38.027281+0000","last_fullsized":"2023-10-14T12:33:38.027281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:56.042282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846794+0000","last_change":"2023-10-14T12:33:30.827702+0000","last_active":"2023-10-14T12:33:35.846794+0000","last_peered":"2023-10-14T12:33:35.846794+0000","last_clean":"2023-10-14T12:33:35.846794+0000","last_became_active":"2023-10-14T12:33:30.827300+0000","last_became_peered":"2023-10-14T12:33:30.827300+0000","last_unstale":"2023-10-14T12:33:35.846794+0000","last_undegraded":"2023-10-14T12:33:35.846794+0000","last_fullsized":"2023-10-14T12:33:35.846794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848452+0000","last_change":"2023-10-14T12:33:31.865300+0000","last_active":"2023-10-14T12:33:35.848452+0000","last_peered":"2023-10-14T12:33:35.848452+0000","last_clean":"2023-10-14T12:33:35.848452+0000","last_became_active":"2023-10-14T12:33:31.865011+0000","last_became_peered":"2023-10-14T12:33:31.865011+0000","last_unstale":"2023-10-14T12:33:35.848452+0000","last_undegraded":"2023-10-14T12:33:35.848452+0000","last_fullsized":"2023-10-14T12:33:35.848452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:21.583926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027294+0000","last_change":"2023-10-14T12:33:35.862519+0000","last_active":"2023-10-14T12:33:38.027294+0000","last_peered":"2023-10-14T12:33:38.027294+0000","last_clean":"2023-10-14T12:33:38.027294+0000","last_became_active":"2023-10-14T12:33:35.861926+0000","last_became_peered":"2023-10-14T12:33:35.861926+0000","last_unstale":"2023-10-14T12:33:38.027294+0000","last_undegraded":"2023-10-14T12:33:38.027294+0000","last_fullsized":"2023-10-14T12:33:38.027294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:27.584701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848363+0000","last_change":"2023-10-14T12:33:30.826679+0000","last_active":"2023-10-14T12:33:35.848363+0000","last_peered":"2023-10-14T12:33:35.848363+0000","last_clean":"2023-10-14T12:33:35.848363+0000","last_became_active":"2023-10-14T12:33:30.826407+0000","last_became_peered":"2023-10-14T12:33:30.826407+0000","last_unstale":"2023-10-14T12:33:35.848363+0000","last_undegraded":"2023-10-14T12:33:35.848363+0000","last_fullsized":"2023-10-14T12:33:35.848363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:48.937270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852489+0000","last_change":"2023-10-14T12:33:31.866686+0000","last_active":"2023-10-14T12:33:35.852489+0000","last_peered":"2023-10-14T12:33:35.852489+0000","last_clean":"2023-10-14T12:33:35.852489+0000","last_became_active":"2023-10-14T12:33:31.866296+0000","last_became_peered":"2023-10-14T12:33:31.866296+0000","last_unstale":"2023-10-14T12:33:35.852489+0000","last_undegraded":"2023-10-14T12:33:35.852489+0000","last_fullsized":"2023-10-14T12:33:35.852489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846622+0000","last_change":"2023-10-14T12:33:35.860504+0000","last_active":"2023-10-14T12:33:36.846622+0000","last_peered":"2023-10-14T12:33:36.846622+0000","last_clean":"2023-10-14T12:33:36.846622+0000","last_became_active":"2023-10-14T12:33:35.860105+0000","last_became_peered":"2023-10-14T12:33:35.860105+0000","last_unstale":"2023-10-14T12:33:36.846622+0000","last_undegraded":"2023-10-14T12:33:36.846622+0000","last_fullsized":"2023-10-14T12:33:36.846622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:29.627124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854796+0000","last_change":"2023-10-14T12:33:30.828734+0000","last_active":"2023-10-14T12:33:35.854796+0000","last_peered":"2023-10-14T12:33:35.854796+0000","last_clean":"2023-10-14T12:33:35.854796+0000","last_became_active":"2023-10-14T12:33:30.827180+0000","last_became_peered":"2023-10-14T12:33:30.827180+0000","last_unstale":"2023-10-14T12:33:35.854796+0000","last_undegraded":"2023-10-14T12:33:35.854796+0000","last_fullsized":"2023-10-14T12:33:35.854796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:17.918071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839536+0000","last_change":"2023-10-14T12:33:31.829359+0000","last_active":"2023-10-14T12:33:35.839536+0000","last_peered":"2023-10-14T12:33:35.839536+0000","last_clean":"2023-10-14T12:33:35.839536+0000","last_became_active":"2023-10-14T12:33:31.828972+0000","last_became_peered":"2023-10-14T12:33:31.828972+0000","last_unstale":"2023-10-14T12:33:35.839536+0000","last_undegraded":"2023-10-14T12:33:35.839536+0000","last_fullsized":"2023-10-14T12:33:35.839536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:35.674331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025766+0000","last_change":"2023-10-14T12:33:35.857105+0000","last_active":"2023-10-14T12:33:38.025766+0000","last_peered":"2023-10-14T12:33:38.025766+0000","last_clean":"2023-10-14T12:33:38.025766+0000","last_became_active":"2023-10-14T12:33:35.856756+0000","last_became_peered":"2023-10-14T12:33:35.856756+0000","last_unstale":"2023-10-14T12:33:38.025766+0000","last_undegraded":"2023-10-14T12:33:38.025766+0000","last_fullsized":"2023-10-14T12:33:38.025766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:41.635415+0000","last_change":"2023-10-14T12:33:30.825111+0000","last_active":"2023-10-14T12:33:41.635415+0000","last_peered":"2023-10-14T12:33:41.635415+0000","last_clean":"2023-10-14T12:33:41.635415+0000","last_became_active":"2023-10-14T12:33:30.824768+0000","last_became_peered":"2023-10-14T12:33:30.824768+0000","last_unstale":"2023-10-14T12:33:41.635415+0000","last_undegraded":"2023-10-14T12:33:41.635415+0000","last_fullsized":"2023-10-14T12:33:41.635415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:09.427953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839014+0000","last_change":"2023-10-14T12:33:31.822451+0000","last_active":"2023-10-14T12:33:35.839014+0000","last_peered":"2023-10-14T12:33:35.839014+0000","last_clean":"2023-10-14T12:33:35.839014+0000","last_became_active":"2023-10-14T12:33:31.822131+0000","last_became_peered":"2023-10-14T12:33:31.822131+0000","last_unstale":"2023-10-14T12:33:35.839014+0000","last_undegraded":"2023-10-14T12:33:35.839014+0000","last_fullsized":"2023-10-14T12:33:35.839014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.319564+0000","last_change":"2023-10-14T12:33:35.864107+0000","last_active":"2023-10-14T12:33:37.319564+0000","last_peered":"2023-10-14T12:33:37.319564+0000","last_clean":"2023-10-14T12:33:37.319564+0000","last_became_active":"2023-10-14T12:33:35.863602+0000","last_became_peered":"2023-10-14T12:33:35.863602+0000","last_unstale":"2023-10-14T12:33:37.319564+0000","last_undegraded":"2023-10-14T12:33:37.319564+0000","last_fullsized":"2023-10-14T12:33:37.319564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:27.584701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851934+0000","last_change":"2023-10-14T12:33:30.830335+0000","last_active":"2023-10-14T12:33:35.851934+0000","last_peered":"2023-10-14T12:33:35.851934+0000","last_clean":"2023-10-14T12:33:35.851934+0000","last_became_active":"2023-10-14T12:33:30.829756+0000","last_became_peered":"2023-10-14T12:33:30.829756+0000","last_unstale":"2023-10-14T12:33:35.851934+0000","last_undegraded":"2023-10-14T12:33:35.851934+0000","last_fullsized":"2023-10-14T12:33:35.851934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:49.417513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852109+0000","last_change":"2023-10-14T12:33:31.822308+0000","last_active":"2023-10-14T12:33:35.852109+0000","last_peered":"2023-10-14T12:33:35.852109+0000","last_clean":"2023-10-14T12:33:35.852109+0000","last_became_active":"2023-10-14T12:33:31.822055+0000","last_became_peered":"2023-10-14T12:33:31.822055+0000","last_unstale":"2023-10-14T12:33:35.852109+0000","last_undegraded":"2023-10-14T12:33:35.852109+0000","last_fullsized":"2023-10-14T12:33:35.852109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:10.433597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027505+0000","last_change":"2023-10-14T12:33:35.869237+0000","last_active":"2023-10-14T12:33:38.027505+0000","last_peered":"2023-10-14T12:33:38.027505+0000","last_clean":"2023-10-14T12:33:38.027505+0000","last_became_active":"2023-10-14T12:33:35.866485+0000","last_became_peered":"2023-10-14T12:33:35.866485+0000","last_unstale":"2023-10-14T12:33:38.027505+0000","last_undegraded":"2023-10-14T12:33:38.027505+0000","last_fullsized":"2023-10-14T12:33:38.027505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:51:59.414054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847188+0000","last_change":"2023-10-14T12:33:30.826101+0000","last_active":"2023-10-14T12:33:35.847188+0000","last_peered":"2023-10-14T12:33:35.847188+0000","last_clean":"2023-10-14T12:33:35.847188+0000","last_became_active":"2023-10-14T12:33:30.825904+0000","last_became_peered":"2023-10-14T12:33:30.825904+0000","last_unstale":"2023-10-14T12:33:35.847188+0000","last_undegraded":"2023-10-14T12:33:35.847188+0000","last_fullsized":"2023-10-14T12:33:35.847188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:34.109444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839117+0000","last_change":"2023-10-14T12:33:31.829811+0000","last_active":"2023-10-14T12:33:35.839117+0000","last_peered":"2023-10-14T12:33:35.839117+0000","last_clean":"2023-10-14T12:33:35.839117+0000","last_became_active":"2023-10-14T12:33:31.829557+0000","last_became_peered":"2023-10-14T12:33:31.829557+0000","last_unstale":"2023-10-14T12:33:35.839117+0000","last_undegraded":"2023-10-14T12:33:35.839117+0000","last_fullsized":"2023-10-14T12:33:35.839117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:21.583926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027964+0000","last_change":"2023-10-14T12:33:35.866238+0000","last_active":"2023-10-14T12:33:38.027964+0000","last_peered":"2023-10-14T12:33:38.027964+0000","last_clean":"2023-10-14T12:33:38.027964+0000","last_became_active":"2023-10-14T12:33:35.865766+0000","last_became_peered":"2023-10-14T12:33:35.865766+0000","last_unstale":"2023-10-14T12:33:38.027964+0000","last_undegraded":"2023-10-14T12:33:38.027964+0000","last_fullsized":"2023-10-14T12:33:38.027964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:29:39.610994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846622+0000","last_change":"2023-10-14T12:33:30.818254+0000","last_active":"2023-10-14T12:33:35.846622+0000","last_peered":"2023-10-14T12:33:35.846622+0000","last_clean":"2023-10-14T12:33:35.846622+0000","last_became_active":"2023-10-14T12:33:30.817968+0000","last_became_peered":"2023-10-14T12:33:30.817968+0000","last_unstale":"2023-10-14T12:33:35.846622+0000","last_undegraded":"2023-10-14T12:33:35.846622+0000","last_fullsized":"2023-10-14T12:33:35.846622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:34.668687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847416+0000","last_change":"2023-10-14T12:33:31.822035+0000","last_active":"2023-10-14T12:33:35.847416+0000","last_peered":"2023-10-14T12:33:35.847416+0000","last_clean":"2023-10-14T12:33:35.847416+0000","last_became_active":"2023-10-14T12:33:31.821751+0000","last_became_peered":"2023-10-14T12:33:31.821751+0000","last_unstale":"2023-10-14T12:33:35.847416+0000","last_undegraded":"2023-10-14T12:33:35.847416+0000","last_fullsized":"2023-10-14T12:33:35.847416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025739+0000","last_change":"2023-10-14T12:33:35.864410+0000","last_active":"2023-10-14T12:33:38.025739+0000","last_peered":"2023-10-14T12:33:38.025739+0000","last_clean":"2023-10-14T12:33:38.025739+0000","last_became_active":"2023-10-14T12:33:35.863490+0000","last_became_peered":"2023-10-14T12:33:35.863490+0000","last_unstale":"2023-10-14T12:33:38.025739+0000","last_undegraded":"2023-10-14T12:33:38.025739+0000","last_fullsized":"2023-10-14T12:33:38.025739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854376+0000","last_change":"2023-10-14T12:33:30.825658+0000","last_active":"2023-10-14T12:33:35.854376+0000","last_peered":"2023-10-14T12:33:35.854376+0000","last_clean":"2023-10-14T12:33:35.854376+0000","last_became_active":"2023-10-14T12:33:30.825377+0000","last_became_peered":"2023-10-14T12:33:30.825377+0000","last_unstale":"2023-10-14T12:33:35.854376+0000","last_undegraded":"2023-10-14T12:33:35.854376+0000","last_fullsized":"2023-10-14T12:33:35.854376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:45.725924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839717+0000","last_change":"2023-10-14T12:33:31.829114+0000","last_active":"2023-10-14T12:33:35.839717+0000","last_peered":"2023-10-14T12:33:35.839717+0000","last_clean":"2023-10-14T12:33:35.839717+0000","last_became_active":"2023-10-14T12:33:31.828836+0000","last_became_peered":"2023-10-14T12:33:31.828836+0000","last_unstale":"2023-10-14T12:33:35.839717+0000","last_undegraded":"2023-10-14T12:33:35.839717+0000","last_fullsized":"2023-10-14T12:33:35.839717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846100+0000","last_change":"2023-10-14T12:33:35.861113+0000","last_active":"2023-10-14T12:33:36.846100+0000","last_peered":"2023-10-14T12:33:36.846100+0000","last_clean":"2023-10-14T12:33:36.846100+0000","last_became_active":"2023-10-14T12:33:35.860576+0000","last_became_peered":"2023-10-14T12:33:35.860576+0000","last_unstale":"2023-10-14T12:33:36.846100+0000","last_undegraded":"2023-10-14T12:33:36.846100+0000","last_fullsized":"2023-10-14T12:33:36.846100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:01.926300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838546+0000","last_change":"2023-10-14T12:33:30.831073+0000","last_active":"2023-10-14T12:33:35.838546+0000","last_peered":"2023-10-14T12:33:35.838546+0000","last_clean":"2023-10-14T12:33:35.838546+0000","last_became_active":"2023-10-14T12:33:30.830742+0000","last_became_peered":"2023-10-14T12:33:30.830742+0000","last_unstale":"2023-10-14T12:33:35.838546+0000","last_undegraded":"2023-10-14T12:33:35.838546+0000","last_fullsized":"2023-10-14T12:33:35.838546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:45.725924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839426+0000","last_change":"2023-10-14T12:33:31.827984+0000","last_active":"2023-10-14T12:33:35.839426+0000","last_peered":"2023-10-14T12:33:35.839426+0000","last_clean":"2023-10-14T12:33:35.839426+0000","last_became_active":"2023-10-14T12:33:31.827707+0000","last_became_peered":"2023-10-14T12:33:31.827707+0000","last_unstale":"2023-10-14T12:33:35.839426+0000","last_undegraded":"2023-10-14T12:33:35.839426+0000","last_fullsized":"2023-10-14T12:33:35.839426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:15.636750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025631+0000","last_change":"2023-10-14T12:33:35.859968+0000","last_active":"2023-10-14T12:33:38.025631+0000","last_peered":"2023-10-14T12:33:38.025631+0000","last_clean":"2023-10-14T12:33:38.025631+0000","last_became_active":"2023-10-14T12:33:35.859542+0000","last_became_peered":"2023-10-14T12:33:35.859542+0000","last_unstale":"2023-10-14T12:33:38.025631+0000","last_undegraded":"2023-10-14T12:33:38.025631+0000","last_fullsized":"2023-10-14T12:33:38.025631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:28.879987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854731+0000","last_change":"2023-10-14T12:33:30.829611+0000","last_active":"2023-10-14T12:33:35.854731+0000","last_peered":"2023-10-14T12:33:35.854731+0000","last_clean":"2023-10-14T12:33:35.854731+0000","last_became_active":"2023-10-14T12:33:30.829317+0000","last_became_peered":"2023-10-14T12:33:30.829317+0000","last_unstale":"2023-10-14T12:33:35.854731+0000","last_undegraded":"2023-10-14T12:33:35.854731+0000","last_fullsized":"2023-10-14T12:33:35.854731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847512+0000","last_change":"2023-10-14T12:33:31.867826+0000","last_active":"2023-10-14T12:33:35.847512+0000","last_peered":"2023-10-14T12:33:35.847512+0000","last_clean":"2023-10-14T12:33:35.847512+0000","last_became_active":"2023-10-14T12:33:31.867531+0000","last_became_peered":"2023-10-14T12:33:31.867531+0000","last_unstale":"2023-10-14T12:33:35.847512+0000","last_undegraded":"2023-10-14T12:33:35.847512+0000","last_fullsized":"2023-10-14T12:33:35.847512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:19.041798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026385+0000","last_change":"2023-10-14T12:33:35.860655+0000","last_active":"2023-10-14T12:33:38.026385+0000","last_peered":"2023-10-14T12:33:38.026385+0000","last_clean":"2023-10-14T12:33:38.026385+0000","last_became_active":"2023-10-14T12:33:35.859946+0000","last_became_peered":"2023-10-14T12:33:35.859946+0000","last_unstale":"2023-10-14T12:33:38.026385+0000","last_undegraded":"2023-10-14T12:33:38.026385+0000","last_fullsized":"2023-10-14T12:33:38.026385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:17.701932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847196+0000","last_change":"2023-10-14T12:33:30.828530+0000","last_active":"2023-10-14T12:33:35.847196+0000","last_peered":"2023-10-14T12:33:35.847196+0000","last_clean":"2023-10-14T12:33:35.847196+0000","last_became_active":"2023-10-14T12:33:30.828070+0000","last_became_peered":"2023-10-14T12:33:30.828070+0000","last_unstale":"2023-10-14T12:33:35.847196+0000","last_undegraded":"2023-10-14T12:33:35.847196+0000","last_fullsized":"2023-10-14T12:33:35.847196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:29.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.841114+0000","last_change":"2023-10-14T12:33:31.828949+0000","last_active":"2023-10-14T12:33:35.841114+0000","last_peered":"2023-10-14T12:33:35.841114+0000","last_clean":"2023-10-14T12:33:35.841114+0000","last_became_active":"2023-10-14T12:33:31.828658+0000","last_became_peered":"2023-10-14T12:33:31.828658+0000","last_unstale":"2023-10-14T12:33:35.841114+0000","last_undegraded":"2023-10-14T12:33:35.841114+0000","last_fullsized":"2023-10-14T12:33:35.841114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:24.745702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026150+0000","last_change":"2023-10-14T12:33:35.860287+0000","last_active":"2023-10-14T12:33:38.026150+0000","last_peered":"2023-10-14T12:33:38.026150+0000","last_clean":"2023-10-14T12:33:38.026150+0000","last_became_active":"2023-10-14T12:33:35.859467+0000","last_became_peered":"2023-10-14T12:33:35.859467+0000","last_unstale":"2023-10-14T12:33:38.026150+0000","last_undegraded":"2023-10-14T12:33:38.026150+0000","last_fullsized":"2023-10-14T12:33:38.026150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854284+0000","last_change":"2023-10-14T12:33:31.820322+0000","last_active":"2023-10-14T12:33:35.854284+0000","last_peered":"2023-10-14T12:33:35.854284+0000","last_clean":"2023-10-14T12:33:35.854284+0000","last_became_active":"2023-10-14T12:33:31.820087+0000","last_became_peered":"2023-10-14T12:33:31.820087+0000","last_unstale":"2023-10-14T12:33:35.854284+0000","last_undegraded":"2023-10-14T12:33:35.854284+0000","last_fullsized":"2023-10-14T12:33:35.854284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:45.477157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854363+0000","last_change":"2023-10-14T12:33:30.821383+0000","last_active":"2023-10-14T12:33:35.854363+0000","last_peered":"2023-10-14T12:33:35.854363+0000","last_clean":"2023-10-14T12:33:35.854363+0000","last_became_active":"2023-10-14T12:33:30.821096+0000","last_became_peered":"2023-10-14T12:33:30.821096+0000","last_unstale":"2023-10-14T12:33:35.854363+0000","last_undegraded":"2023-10-14T12:33:35.854363+0000","last_fullsized":"2023-10-14T12:33:35.854363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:23.650329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.840950+0000","last_change":"2023-10-14T12:33:35.858076+0000","last_active":"2023-10-14T12:33:36.840950+0000","last_peered":"2023-10-14T12:33:36.840950+0000","last_clean":"2023-10-14T12:33:36.840950+0000","last_became_active":"2023-10-14T12:33:35.857526+0000","last_became_peered":"2023-10-14T12:33:35.857526+0000","last_unstale":"2023-10-14T12:33:36.840950+0000","last_undegraded":"2023-10-14T12:33:36.840950+0000","last_fullsized":"2023-10-14T12:33:36.840950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843234+0000","last_change":"2023-10-14T12:33:31.868186+0000","last_active":"2023-10-14T12:33:35.843234+0000","last_peered":"2023-10-14T12:33:35.843234+0000","last_clean":"2023-10-14T12:33:35.843234+0000","last_became_active":"2023-10-14T12:33:31.867909+0000","last_became_peered":"2023-10-14T12:33:31.867909+0000","last_unstale":"2023-10-14T12:33:35.843234+0000","last_undegraded":"2023-10-14T12:33:35.843234+0000","last_fullsized":"2023-10-14T12:33:35.843234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847138+0000","last_change":"2023-10-14T12:33:30.828058+0000","last_active":"2023-10-14T12:33:35.847138+0000","last_peered":"2023-10-14T12:33:35.847138+0000","last_clean":"2023-10-14T12:33:35.847138+0000","last_became_active":"2023-10-14T12:33:30.827816+0000","last_became_peered":"2023-10-14T12:33:30.827816+0000","last_unstale":"2023-10-14T12:33:35.847138+0000","last_undegraded":"2023-10-14T12:33:35.847138+0000","last_fullsized":"2023-10-14T12:33:35.847138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:23.650329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839385+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:33:35.839385+0000","last_peered":"2023-10-14T12:33:35.839385+0000","last_clean":"2023-10-14T12:33:35.839385+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:33:35.839385+0000","last_undegraded":"2023-10-14T12:33:35.839385+0000","last_fullsized":"2023-10-14T12:33:35.839385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025827+0000","last_change":"2023-10-14T12:33:35.864687+0000","last_active":"2023-10-14T12:33:38.025827+0000","last_peered":"2023-10-14T12:33:38.025827+0000","last_clean":"2023-10-14T12:33:38.025827+0000","last_became_active":"2023-10-14T12:33:35.864048+0000","last_became_peered":"2023-10-14T12:33:35.864048+0000","last_unstale":"2023-10-14T12:33:38.025827+0000","last_undegraded":"2023-10-14T12:33:38.025827+0000","last_fullsized":"2023-10-14T12:33:38.025827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:17.701932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.849606+0000","last_change":"2023-10-14T12:33:31.833047+0000","last_active":"2023-10-14T12:33:35.849606+0000","last_peered":"2023-10-14T12:33:35.849606+0000","last_clean":"2023-10-14T12:33:35.849606+0000","last_became_active":"2023-10-14T12:33:31.832727+0000","last_became_peered":"2023-10-14T12:33:31.832727+0000","last_unstale":"2023-10-14T12:33:35.849606+0000","last_undegraded":"2023-10-14T12:33:35.849606+0000","last_fullsized":"2023-10-14T12:33:35.849606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839488+0000","last_change":"2023-10-14T12:33:30.825584+0000","last_active":"2023-10-14T12:33:35.839488+0000","last_peered":"2023-10-14T12:33:35.839488+0000","last_clean":"2023-10-14T12:33:35.839488+0000","last_became_active":"2023-10-14T12:33:30.825306+0000","last_became_peered":"2023-10-14T12:33:30.825306+0000","last_unstale":"2023-10-14T12:33:35.839488+0000","last_undegraded":"2023-10-14T12:33:35.839488+0000","last_fullsized":"2023-10-14T12:33:35.839488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025810+0000","last_change":"2023-10-14T12:33:35.869042+0000","last_active":"2023-10-14T12:33:38.025810+0000","last_peered":"2023-10-14T12:33:38.025810+0000","last_clean":"2023-10-14T12:33:38.025810+0000","last_became_active":"2023-10-14T12:33:35.866286+0000","last_became_peered":"2023-10-14T12:33:35.866286+0000","last_unstale":"2023-10-14T12:33:38.025810+0000","last_undegraded":"2023-10-14T12:33:38.025810+0000","last_fullsized":"2023-10-14T12:33:38.025810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838691+0000","last_change":"2023-10-14T12:33:30.830475+0000","last_active":"2023-10-14T12:33:35.838691+0000","last_peered":"2023-10-14T12:33:35.838691+0000","last_clean":"2023-10-14T12:33:35.838691+0000","last_became_active":"2023-10-14T12:33:30.830146+0000","last_became_peered":"2023-10-14T12:33:30.830146+0000","last_unstale":"2023-10-14T12:33:35.838691+0000","last_undegraded":"2023-10-14T12:33:35.838691+0000","last_fullsized":"2023-10-14T12:33:35.838691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:41.110080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854835+0000","last_change":"2023-10-14T12:33:31.820598+0000","last_active":"2023-10-14T12:33:35.854835+0000","last_peered":"2023-10-14T12:33:35.854835+0000","last_clean":"2023-10-14T12:33:35.854835+0000","last_became_active":"2023-10-14T12:33:31.820407+0000","last_became_peered":"2023-10-14T12:33:31.820407+0000","last_unstale":"2023-10-14T12:33:35.854835+0000","last_undegraded":"2023-10-14T12:33:35.854835+0000","last_fullsized":"2023-10-14T12:33:35.854835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027136+0000","last_change":"2023-10-14T12:33:35.862298+0000","last_active":"2023-10-14T12:33:38.027136+0000","last_peered":"2023-10-14T12:33:38.027136+0000","last_clean":"2023-10-14T12:33:38.027136+0000","last_became_active":"2023-10-14T12:33:35.861343+0000","last_became_peered":"2023-10-14T12:33:35.861343+0000","last_unstale":"2023-10-14T12:33:38.027136+0000","last_undegraded":"2023-10-14T12:33:38.027136+0000","last_fullsized":"2023-10-14T12:33:38.027136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:08:15.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854868+0000","last_change":"2023-10-14T12:33:30.822607+0000","last_active":"2023-10-14T12:33:35.854868+0000","last_peered":"2023-10-14T12:33:35.854868+0000","last_clean":"2023-10-14T12:33:35.854868+0000","last_became_active":"2023-10-14T12:33:30.822335+0000","last_became_peered":"2023-10-14T12:33:30.822335+0000","last_unstale":"2023-10-14T12:33:35.854868+0000","last_undegraded":"2023-10-14T12:33:35.854868+0000","last_fullsized":"2023-10-14T12:33:35.854868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.842317+0000","last_change":"2023-10-14T12:33:31.819508+0000","last_active":"2023-10-14T12:33:35.842317+0000","last_peered":"2023-10-14T12:33:35.842317+0000","last_clean":"2023-10-14T12:33:35.842317+0000","last_became_active":"2023-10-14T12:33:31.819245+0000","last_became_peered":"2023-10-14T12:33:31.819245+0000","last_unstale":"2023-10-14T12:33:35.842317+0000","last_undegraded":"2023-10-14T12:33:35.842317+0000","last_fullsized":"2023-10-14T12:33:35.842317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846081+0000","last_change":"2023-10-14T12:33:35.852496+0000","last_active":"2023-10-14T12:33:36.846081+0000","last_peered":"2023-10-14T12:33:36.846081+0000","last_clean":"2023-10-14T12:33:36.846081+0000","last_became_active":"2023-10-14T12:33:35.852067+0000","last_became_peered":"2023-10-14T12:33:35.852067+0000","last_unstale":"2023-10-14T12:33:36.846081+0000","last_undegraded":"2023-10-14T12:33:36.846081+0000","last_fullsized":"2023-10-14T12:33:36.846081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:22.810399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846693+0000","last_change":"2023-10-14T12:33:30.823983+0000","last_active":"2023-10-14T12:33:35.846693+0000","last_peered":"2023-10-14T12:33:35.846693+0000","last_clean":"2023-10-14T12:33:35.846693+0000","last_became_active":"2023-10-14T12:33:30.823708+0000","last_became_peered":"2023-10-14T12:33:30.823708+0000","last_unstale":"2023-10-14T12:33:35.846693+0000","last_undegraded":"2023-10-14T12:33:35.846693+0000","last_fullsized":"2023-10-14T12:33:35.846693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:21.825878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852271+0000","last_change":"2023-10-14T12:33:31.818663+0000","last_active":"2023-10-14T12:33:35.852271+0000","last_peered":"2023-10-14T12:33:35.852271+0000","last_clean":"2023-10-14T12:33:35.852271+0000","last_became_active":"2023-10-14T12:33:31.818315+0000","last_became_peered":"2023-10-14T12:33:31.818315+0000","last_unstale":"2023-10-14T12:33:35.852271+0000","last_undegraded":"2023-10-14T12:33:35.852271+0000","last_fullsized":"2023-10-14T12:33:35.852271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846628+0000","last_change":"2023-10-14T12:33:35.861468+0000","last_active":"2023-10-14T12:33:36.846628+0000","last_peered":"2023-10-14T12:33:36.846628+0000","last_clean":"2023-10-14T12:33:36.846628+0000","last_became_active":"2023-10-14T12:33:35.861024+0000","last_became_peered":"2023-10-14T12:33:35.861024+0000","last_unstale":"2023-10-14T12:33:36.846628+0000","last_undegraded":"2023-10-14T12:33:36.846628+0000","last_fullsized":"2023-10-14T12:33:36.846628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:32.157229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838156+0000","last_change":"2023-10-14T12:33:30.828550+0000","last_active":"2023-10-14T12:33:35.838156+0000","last_peered":"2023-10-14T12:33:35.838156+0000","last_clean":"2023-10-14T12:33:35.838156+0000","last_became_active":"2023-10-14T12:33:30.828270+0000","last_became_peered":"2023-10-14T12:33:30.828270+0000","last_unstale":"2023-10-14T12:33:35.838156+0000","last_undegraded":"2023-10-14T12:33:35.838156+0000","last_fullsized":"2023-10-14T12:33:35.838156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:49.417513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.840140+0000","last_change":"2023-10-14T12:33:31.827714+0000","last_active":"2023-10-14T12:33:35.840140+0000","last_peered":"2023-10-14T12:33:35.840140+0000","last_clean":"2023-10-14T12:33:35.840140+0000","last_became_active":"2023-10-14T12:33:31.827425+0000","last_became_peered":"2023-10-14T12:33:31.827425+0000","last_unstale":"2023-10-14T12:33:35.840140+0000","last_undegraded":"2023-10-14T12:33:35.840140+0000","last_fullsized":"2023-10-14T12:33:35.840140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:22.831522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026298+0000","last_change":"2023-10-14T12:33:35.862529+0000","last_active":"2023-10-14T12:33:38.026298+0000","last_peered":"2023-10-14T12:33:38.026298+0000","last_clean":"2023-10-14T12:33:38.026298+0000","last_became_active":"2023-10-14T12:33:35.862060+0000","last_became_peered":"2023-10-14T12:33:35.862060+0000","last_unstale":"2023-10-14T12:33:38.026298+0000","last_undegraded":"2023-10-14T12:33:38.026298+0000","last_fullsized":"2023-10-14T12:33:38.026298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854468+0000","last_change":"2023-10-14T12:33:30.820328+0000","last_active":"2023-10-14T12:33:35.854468+0000","last_peered":"2023-10-14T12:33:35.854468+0000","last_clean":"2023-10-14T12:33:35.854468+0000","last_became_active":"2023-10-14T12:33:30.820025+0000","last_became_peered":"2023-10-14T12:33:30.820025+0000","last_unstale":"2023-10-14T12:33:35.854468+0000","last_undegraded":"2023-10-14T12:33:35.854468+0000","last_fullsized":"2023-10-14T12:33:35.854468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:41.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844808+0000","last_change":"2023-10-14T12:33:31.818199+0000","last_active":"2023-10-14T12:33:35.844808+0000","last_peered":"2023-10-14T12:33:35.844808+0000","last_clean":"2023-10-14T12:33:35.844808+0000","last_became_active":"2023-10-14T12:33:31.817925+0000","last_became_peered":"2023-10-14T12:33:31.817925+0000","last_unstale":"2023-10-14T12:33:35.844808+0000","last_undegraded":"2023-10-14T12:33:35.844808+0000","last_fullsized":"2023-10-14T12:33:35.844808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846730+0000","last_change":"2023-10-14T12:33:35.861719+0000","last_active":"2023-10-14T12:33:36.846730+0000","last_peered":"2023-10-14T12:33:36.846730+0000","last_clean":"2023-10-14T12:33:36.846730+0000","last_became_active":"2023-10-14T12:33:35.861312+0000","last_became_peered":"2023-10-14T12:33:35.861312+0000","last_unstale":"2023-10-14T12:33:36.846730+0000","last_undegraded":"2023-10-14T12:33:36.846730+0000","last_fullsized":"2023-10-14T12:33:36.846730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:28.879987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.856801+0000","last_change":"2023-10-14T12:33:30.825142+0000","last_active":"2023-10-14T12:33:35.856801+0000","last_peered":"2023-10-14T12:33:35.856801+0000","last_clean":"2023-10-14T12:33:35.856801+0000","last_became_active":"2023-10-14T12:33:30.824853+0000","last_became_peered":"2023-10-14T12:33:30.824853+0000","last_unstale":"2023-10-14T12:33:35.856801+0000","last_undegraded":"2023-10-14T12:33:35.856801+0000","last_fullsized":"2023-10-14T12:33:35.856801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844382+0000","last_change":"2023-10-14T12:33:31.821965+0000","last_active":"2023-10-14T12:33:35.844382+0000","last_peered":"2023-10-14T12:33:35.844382+0000","last_clean":"2023-10-14T12:33:35.844382+0000","last_became_active":"2023-10-14T12:33:31.821689+0000","last_became_peered":"2023-10-14T12:33:31.821689+0000","last_unstale":"2023-10-14T12:33:35.844382+0000","last_undegraded":"2023-10-14T12:33:35.844382+0000","last_fullsized":"2023-10-14T12:33:35.844382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846686+0000","last_change":"2023-10-14T12:33:35.864185+0000","last_active":"2023-10-14T12:33:36.846686+0000","last_peered":"2023-10-14T12:33:36.846686+0000","last_clean":"2023-10-14T12:33:36.846686+0000","last_became_active":"2023-10-14T12:33:35.863769+0000","last_became_peered":"2023-10-14T12:33:35.863769+0000","last_unstale":"2023-10-14T12:33:36.846686+0000","last_undegraded":"2023-10-14T12:33:36.846686+0000","last_fullsized":"2023-10-14T12:33:36.846686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:32.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839226+0000","last_change":"2023-10-14T12:33:30.823464+0000","last_active":"2023-10-14T12:33:35.839226+0000","last_peered":"2023-10-14T12:33:35.839226+0000","last_clean":"2023-10-14T12:33:35.839226+0000","last_became_active":"2023-10-14T12:33:30.823177+0000","last_became_peered":"2023-10-14T12:33:30.823177+0000","last_unstale":"2023-10-14T12:33:35.839226+0000","last_undegraded":"2023-10-14T12:33:35.839226+0000","last_fullsized":"2023-10-14T12:33:35.839226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:29.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846843+0000","last_change":"2023-10-14T12:33:31.828060+0000","last_active":"2023-10-14T12:33:35.846843+0000","last_peered":"2023-10-14T12:33:35.846843+0000","last_clean":"2023-10-14T12:33:35.846843+0000","last_became_active":"2023-10-14T12:33:31.827687+0000","last_became_peered":"2023-10-14T12:33:31.827687+0000","last_unstale":"2023-10-14T12:33:35.846843+0000","last_undegraded":"2023-10-14T12:33:35.846843+0000","last_fullsized":"2023-10-14T12:33:35.846843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.840897+0000","last_change":"2023-10-14T12:33:35.865932+0000","last_active":"2023-10-14T12:33:36.840897+0000","last_peered":"2023-10-14T12:33:36.840897+0000","last_clean":"2023-10-14T12:33:36.840897+0000","last_became_active":"2023-10-14T12:33:35.865529+0000","last_became_peered":"2023-10-14T12:33:35.865529+0000","last_unstale":"2023-10-14T12:33:36.840897+0000","last_undegraded":"2023-10-14T12:33:36.840897+0000","last_fullsized":"2023-10-14T12:33:36.840897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.856213+0000","last_change":"2023-10-14T12:33:30.828503+0000","last_active":"2023-10-14T12:33:35.856213+0000","last_peered":"2023-10-14T12:33:35.856213+0000","last_clean":"2023-10-14T12:33:35.856213+0000","last_became_active":"2023-10-14T12:33:30.828211+0000","last_became_peered":"2023-10-14T12:33:30.828211+0000","last_unstale":"2023-10-14T12:33:35.856213+0000","last_undegraded":"2023-10-14T12:33:35.856213+0000","last_fullsized":"2023-10-14T12:33:35.856213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:21.825878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838912+0000","last_change":"2023-10-14T12:33:31.866962+0000","last_active":"2023-10-14T12:33:35.838912+0000","last_peered":"2023-10-14T12:33:35.838912+0000","last_clean":"2023-10-14T12:33:35.838912+0000","last_became_active":"2023-10-14T12:33:31.866696+0000","last_became_peered":"2023-10-14T12:33:31.866696+0000","last_unstale":"2023-10-14T12:33:35.838912+0000","last_undegraded":"2023-10-14T12:33:35.838912+0000","last_fullsized":"2023-10-14T12:33:35.838912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:10.562723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025680+0000","last_change":"2023-10-14T12:33:35.866856+0000","last_active":"2023-10-14T12:33:38.025680+0000","last_peered":"2023-10-14T12:33:38.025680+0000","last_clean":"2023-10-14T12:33:38.025680+0000","last_became_active":"2023-10-14T12:33:35.865775+0000","last_became_peered":"2023-10-14T12:33:35.865775+0000","last_unstale":"2023-10-14T12:33:38.025680+0000","last_undegraded":"2023-10-14T12:33:38.025680+0000","last_fullsized":"2023-10-14T12:33:38.025680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854778+0000","last_change":"2023-10-14T12:33:30.824177+0000","last_active":"2023-10-14T12:33:35.854778+0000","last_peered":"2023-10-14T12:33:35.854778+0000","last_clean":"2023-10-14T12:33:35.854778+0000","last_became_active":"2023-10-14T12:33:30.823858+0000","last_became_peered":"2023-10-14T12:33:30.823858+0000","last_unstale":"2023-10-14T12:33:35.854778+0000","last_undegraded":"2023-10-14T12:33:35.854778+0000","last_fullsized":"2023-10-14T12:33:35.854778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:09.427953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847722+0000","last_change":"2023-10-14T12:33:31.867990+0000","last_active":"2023-10-14T12:33:35.847722+0000","last_peered":"2023-10-14T12:33:35.847722+0000","last_clean":"2023-10-14T12:33:35.847722+0000","last_became_active":"2023-10-14T12:33:31.867711+0000","last_became_peered":"2023-10-14T12:33:31.867711+0000","last_unstale":"2023-10-14T12:33:35.847722+0000","last_undegraded":"2023-10-14T12:33:35.847722+0000","last_fullsized":"2023-10-14T12:33:35.847722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.319023+0000","last_change":"2023-10-14T12:33:35.852643+0000","last_active":"2023-10-14T12:33:37.319023+0000","last_peered":"2023-10-14T12:33:37.319023+0000","last_clean":"2023-10-14T12:33:37.319023+0000","last_became_active":"2023-10-14T12:33:35.852237+0000","last_became_peered":"2023-10-14T12:33:35.852237+0000","last_unstale":"2023-10-14T12:33:37.319023+0000","last_undegraded":"2023-10-14T12:33:37.319023+0000","last_fullsized":"2023-10-14T12:33:37.319023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:56.042282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.855802+0000","last_change":"2023-10-14T12:33:30.819872+0000","last_active":"2023-10-14T12:33:35.855802+0000","last_peered":"2023-10-14T12:33:35.855802+0000","last_clean":"2023-10-14T12:33:35.855802+0000","last_became_active":"2023-10-14T12:33:30.819553+0000","last_became_peered":"2023-10-14T12:33:30.819553+0000","last_unstale":"2023-10-14T12:33:35.855802+0000","last_undegraded":"2023-10-14T12:33:35.855802+0000","last_fullsized":"2023-10-14T12:33:35.855802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:23.740058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838889+0000","last_change":"2023-10-14T12:33:31.833122+0000","last_active":"2023-10-14T12:33:35.838889+0000","last_peered":"2023-10-14T12:33:35.838889+0000","last_clean":"2023-10-14T12:33:35.838889+0000","last_became_active":"2023-10-14T12:33:31.832825+0000","last_became_peered":"2023-10-14T12:33:31.832825+0000","last_unstale":"2023-10-14T12:33:35.838889+0000","last_undegraded":"2023-10-14T12:33:35.838889+0000","last_fullsized":"2023-10-14T12:33:35.838889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:13.669993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847506+0000","last_change":"2023-10-14T12:33:31.822399+0000","last_active":"2023-10-14T12:33:35.847506+0000","last_peered":"2023-10-14T12:33:35.847506+0000","last_clean":"2023-10-14T12:33:35.847506+0000","last_became_active":"2023-10-14T12:33:31.822073+0000","last_became_peered":"2023-10-14T12:33:31.822073+0000","last_unstale":"2023-10-14T12:33:35.847506+0000","last_undegraded":"2023-10-14T12:33:35.847506+0000","last_fullsized":"2023-10-14T12:33:35.847506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854508+0000","last_change":"2023-10-14T12:33:31.859894+0000","last_active":"2023-10-14T12:33:35.854508+0000","last_peered":"2023-10-14T12:33:35.854508+0000","last_clean":"2023-10-14T12:33:35.854508+0000","last_became_active":"2023-10-14T12:33:31.859679+0000","last_became_peered":"2023-10-14T12:33:31.859679+0000","last_unstale":"2023-10-14T12:33:35.854508+0000","last_undegraded":"2023-10-14T12:33:35.854508+0000","last_fullsized":"2023-10-14T12:33:35.854508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:34.169023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847296+0000","last_change":"2023-10-14T12:33:31.867239+0000","last_active":"2023-10-14T12:33:35.847296+0000","last_peered":"2023-10-14T12:33:35.847296+0000","last_clean":"2023-10-14T12:33:35.847296+0000","last_became_active":"2023-10-14T12:33:31.866961+0000","last_became_peered":"2023-10-14T12:33:31.866961+0000","last_unstale":"2023-10-14T12:33:35.847296+0000","last_undegraded":"2023-10-14T12:33:35.847296+0000","last_fullsized":"2023-10-14T12:33:35.847296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851705+0000","last_change":"2023-10-14T12:33:31.822450+0000","last_active":"2023-10-14T12:33:35.851705+0000","last_peered":"2023-10-14T12:33:35.851705+0000","last_clean":"2023-10-14T12:33:35.851705+0000","last_became_active":"2023-10-14T12:33:31.822248+0000","last_became_peered":"2023-10-14T12:33:31.822248+0000","last_unstale":"2023-10-14T12:33:35.851705+0000","last_undegraded":"2023-10-14T12:33:35.851705+0000","last_fullsized":"2023-10-14T12:33:35.851705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844108+0000","last_change":"2023-10-14T12:33:31.829535+0000","last_active":"2023-10-14T12:33:35.844108+0000","last_peered":"2023-10-14T12:33:35.844108+0000","last_clean":"2023-10-14T12:33:35.844108+0000","last_became_active":"2023-10-14T12:33:31.829266+0000","last_became_peered":"2023-10-14T12:33:31.829266+0000","last_unstale":"2023-10-14T12:33:35.844108+0000","last_undegraded":"2023-10-14T12:33:35.844108+0000","last_fullsized":"2023-10-14T12:33:35.844108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854698+0000","last_change":"2023-10-14T12:33:31.817303+0000","last_active":"2023-10-14T12:33:35.854698+0000","last_peered":"2023-10-14T12:33:35.854698+0000","last_clean":"2023-10-14T12:33:35.854698+0000","last_became_active":"2023-10-14T12:33:31.817008+0000","last_became_peered":"2023-10-14T12:33:31.817008+0000","last_unstale":"2023-10-14T12:33:35.854698+0000","last_undegraded":"2023-10-14T12:33:35.854698+0000","last_fullsized":"2023-10-14T12:33:35.854698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846113+0000","last_change":"2023-10-14T12:33:31.821532+0000","last_active":"2023-10-14T12:33:35.846113+0000","last_peered":"2023-10-14T12:33:35.846113+0000","last_clean":"2023-10-14T12:33:35.846113+0000","last_became_active":"2023-10-14T12:33:31.821205+0000","last_became_peered":"2023-10-14T12:33:31.821205+0000","last_unstale":"2023-10-14T12:33:35.846113+0000","last_undegraded":"2023-10-14T12:33:35.846113+0000","last_fullsized":"2023-10-14T12:33:35.846113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.842791+0000","last_change":"2023-10-14T12:33:31.832580+0000","last_active":"2023-10-14T12:33:35.842791+0000","last_peered":"2023-10-14T12:33:35.842791+0000","last_clean":"2023-10-14T12:33:35.842791+0000","last_became_active":"2023-10-14T12:33:31.832277+0000","last_became_peered":"2023-10-14T12:33:31.832277+0000","last_unstale":"2023-10-14T12:33:35.842791+0000","last_undegraded":"2023-10-14T12:33:35.842791+0000","last_fullsized":"2023-10-14T12:33:35.842791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848235+0000","last_change":"2023-10-14T12:33:31.865900+0000","last_active":"2023-10-14T12:33:35.848235+0000","last_peered":"2023-10-14T12:33:35.848235+0000","last_clean":"2023-10-14T12:33:35.848235+0000","last_became_active":"2023-10-14T12:33:31.865207+0000","last_became_peered":"2023-10-14T12:33:31.865207+0000","last_unstale":"2023-10-14T12:33:35.848235+0000","last_undegraded":"2023-10-14T12:33:35.848235+0000","last_fullsized":"2023-10-14T12:33:35.848235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847269+0000","last_change":"2023-10-14T12:33:31.832616+0000","last_active":"2023-10-14T12:33:35.847269+0000","last_peered":"2023-10-14T12:33:35.847269+0000","last_clean":"2023-10-14T12:33:35.847269+0000","last_became_active":"2023-10-14T12:33:31.832363+0000","last_became_peered":"2023-10-14T12:33:31.832363+0000","last_unstale":"2023-10-14T12:33:35.847269+0000","last_undegraded":"2023-10-14T12:33:35.847269+0000","last_fullsized":"2023-10-14T12:33:35.847269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847336+0000","last_change":"2023-10-14T12:33:31.866907+0000","last_active":"2023-10-14T12:33:35.847336+0000","last_peered":"2023-10-14T12:33:35.847336+0000","last_clean":"2023-10-14T12:33:35.847336+0000","last_became_active":"2023-10-14T12:33:31.866600+0000","last_became_peered":"2023-10-14T12:33:31.866600+0000","last_unstale":"2023-10-14T12:33:35.847336+0000","last_undegraded":"2023-10-14T12:33:35.847336+0000","last_fullsized":"2023-10-14T12:33:35.847336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851789+0000","last_change":"2023-10-14T12:33:31.822750+0000","last_active":"2023-10-14T12:33:35.851789+0000","last_peered":"2023-10-14T12:33:35.851789+0000","last_clean":"2023-10-14T12:33:35.851789+0000","last_became_active":"2023-10-14T12:33:31.822413+0000","last_became_peered":"2023-10-14T12:33:31.822413+0000","last_unstale":"2023-10-14T12:33:35.851789+0000","last_undegraded":"2023-10-14T12:33:35.851789+0000","last_fullsized":"2023-10-14T12:33:35.851789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:18.923716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847017+0000","last_change":"2023-10-14T12:33:31.831194+0000","last_active":"2023-10-14T12:33:35.847017+0000","last_peered":"2023-10-14T12:33:35.847017+0000","last_clean":"2023-10-14T12:33:35.847017+0000","last_became_active":"2023-10-14T12:33:31.830888+0000","last_became_peered":"2023-10-14T12:33:31.830888+0000","last_unstale":"2023-10-14T12:33:35.847017+0000","last_undegraded":"2023-10-14T12:33:35.847017+0000","last_fullsized":"2023-10-14T12:33:35.847017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:33:53.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:33:54.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.122+0000 7f8918fff700 1 Processor -- start 2023-10-14T12:33:54.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.122+0000 7f8918fff700 1 -- start start 2023-10-14T12:33:54.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8918fff700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f891415d7f0 0x7f891406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8918fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89140cd520 0x7f89140cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8918fff700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891406e950 con 0x7f891406e170 2023-10-14T12:33:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8918fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140ca600 con 0x7f89140cd520 2023-10-14T12:33:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8918fff700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140cde40 con 0x7f891415d7f0 2023-10-14T12:33:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8912d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89140cd520 0x7f89140cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8912d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89140cd520 0x7f89140cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46996/0 (socket says 172.21.15.72:46996) 2023-10-14T12:33:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8912d9d700 1 -- 172.21.15.72:0/1367646722 learned_addr learned my addr 172.21.15.72:0/1367646722 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f891259c700 1 --2- 172.21.15.72:0/1367646722 >> v2:172.21.15.123:3300/0 conn(0x7f891415d7f0 0x7f891406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8912d9d700 1 -- 172.21.15.72:0/1367646722 >> v2:172.21.15.123:3300/0 conn(0x7f891415d7f0 msgr2=0x7f891406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8912d9d700 1 --2- 172.21.15.72:0/1367646722 >> v2:172.21.15.123:3300/0 conn(0x7f891415d7f0 0x7f891406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8912d9d700 1 -- 172.21.15.72:0/1367646722 >> v1:172.21.15.123:6789/0 conn(0x7f891406e170 legacy=0x7f89140c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8912d9d700 1 -- 172.21.15.72:0/1367646722 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891406a950 con 0x7f89140cd520 2023-10-14T12:33:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f8912d9d700 1 --2- 172.21.15.72:0/1367646722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89140cd520 0x7f89140cd900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8914072ef0 tx=0x7f890c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25bb8d2de1adeab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.123+0000 7f891159a700 1 -- 172.21.15.72:0/1367646722 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c00e070 con 0x7f89140cd520 2023-10-14T12:33:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f891159a700 1 -- 172.21.15.72:0/1367646722 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c00b9c0 con 0x7f89140cd520 2023-10-14T12:33:54.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f891159a700 1 -- 172.21.15.72:0/1367646722 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c00bd70 con 0x7f89140cd520 2023-10-14T12:33:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f8918fff700 1 -- 172.21.15.72:0/1367646722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89140cd520 msgr2=0x7f89140cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f8918fff700 1 --2- 172.21.15.72:0/1367646722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89140cd520 0x7f89140cd900 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8914072ef0 tx=0x7f890c00b330 comp rx=0 tx=0).stop 2023-10-14T12:33:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f8918fff700 1 -- 172.21.15.72:0/1367646722 shutdown_connections 2023-10-14T12:33:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f8918fff700 1 --2- 172.21.15.72:0/1367646722 >> v2:172.21.15.123:3300/0 conn(0x7f891415d7f0 0x7f891406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f8918fff700 1 --2- 172.21.15.72:0/1367646722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89140cd520 0x7f89140cd900 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f8918fff700 1 -- 172.21.15.72:0/1367646722 >> 172.21.15.72:0/1367646722 conn(0x7f89140b1420 msgr2=0x7f89140b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f8918fff700 1 -- 172.21.15.72:0/1367646722 shutdown_connections 2023-10-14T12:33:54.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.124+0000 7f8918fff700 1 -- 172.21.15.72:0/1367646722 wait complete. 2023-10-14T12:33:54.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.125+0000 7f8918fff700 1 Processor -- start 2023-10-14T12:33:54.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8918fff700 1 -- start start 2023-10-14T12:33:54.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8918fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f891406e170 0x7f89140c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8918fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89140cd520 0x7f8914151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8918fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891415d7f0 0x7f89140b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8918fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89140b3660 con 0x7f891415d7f0 2023-10-14T12:33:54.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8918fff700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89140b2a50 con 0x7f891406e170 2023-10-14T12:33:54.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8918fff700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89140b2d30 con 0x7f89140cd520 2023-10-14T12:33:54.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8912d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891415d7f0 0x7f89140b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8912d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891415d7f0 0x7f89140b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47002/0 (socket says 172.21.15.72:47002) 2023-10-14T12:33:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.126+0000 7f8912d9d700 1 -- 172.21.15.72:0/483920709 learned_addr learned my addr 172.21.15.72:0/483920709 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8912d9d700 1 -- 172.21.15.72:0/483920709 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89140cd520 msgr2=0x7f8914151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f891259c700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f891406e170 0x7f89140c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8912d9d700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89140cd520 0x7f8914151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8912d9d700 1 -- 172.21.15.72:0/483920709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f891406e170 msgr2=0x7f89140c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8912d9d700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f891406e170 0x7f89140c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8912d9d700 1 -- 172.21.15.72:0/483920709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c009b30 con 0x7f891415d7f0 2023-10-14T12:33:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8912d9d700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891415d7f0 0x7f89140b3af0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8914071fe0 tx=0x7f890c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8902ffd700 1 -- 172.21.15.72:0/483920709 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0099b0 con 0x7f891415d7f0 2023-10-14T12:33:54.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8902ffd700 1 -- 172.21.15.72:0/483920709 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c0092e0 con 0x7f891415d7f0 2023-10-14T12:33:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89140b3010 con 0x7f891415d7f0 2023-10-14T12:33:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8902ffd700 1 -- 172.21.15.72:0/483920709 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c01b630 con 0x7f891415d7f0 2023-10-14T12:33:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.127+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89141587a0 con 0x7f891415d7f0 2023-10-14T12:33:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.128+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8914158930 con 0x7f891415d7f0 2023-10-14T12:33:54.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.128+0000 7f8902ffd700 1 -- 172.21.15.72:0/483920709 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f890c01b790 con 0x7f891415d7f0 2023-10-14T12:33:54.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.129+0000 7f8902ffd700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f88f406af00 0x7f88f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.129+0000 7f8902ffd700 1 -- 172.21.15.72:0/483920709 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f890c08b1a0 con 0x7f891415d7f0 2023-10-14T12:33:54.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.129+0000 7f891259c700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f88f406af00 0x7f88f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.129+0000 7f891259c700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f88f406af00 0x7f88f406d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8904009950 tx=0x7f8904008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:54.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.133+0000 7f8902ffd700 1 -- 172.21.15.72:0/483920709 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f890c055ff0 con 0x7f891415d7f0 2023-10-14T12:33:54.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.318+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f891406ac30 con 0x7f88f406af00 2023-10-14T12:33:54.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.327+0000 7f8902ffd700 1 -- 172.21.15.72:0/483920709 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345256 (secure 0 0 0) 0x7f89040095e0 con 0x7f88f406af00 2023-10-14T12:33:54.332 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:54.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f88f406af00 msgr2=0x7f88f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f88f406af00 0x7f88f406d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8904009950 tx=0x7f8904008040 comp rx=0 tx=0).stop 2023-10-14T12:33:54.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891415d7f0 msgr2=0x7f89140b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891415d7f0 0x7f89140b3af0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8914071fe0 tx=0x7f890c004ad0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 shutdown_connections 2023-10-14T12:33:54.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f88f406af00 0x7f88f406d3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891415d7f0 0x7f89140b3af0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f891406e170 0x7f89140c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 --2- 172.21.15.72:0/483920709 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89140cd520 0x7f8914151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.330+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 >> 172.21.15.72:0/483920709 conn(0x7f89140b1420 msgr2=0x7f89140c9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:54.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.331+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 shutdown_connections 2023-10-14T12:33:54.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.331+0000 7f8918fff700 1 -- 172.21.15.72:0/483920709 wait complete. 2023-10-14T12:33:54.337 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:33:54.344 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-10-14T12:33:53.389101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002864"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839274+0000","last_change":"2023-10-14T12:33:31.821005+0000","last_active":"2023-10-14T12:33:35.839274+0000","last_peered":"2023-10-14T12:33:35.839274+0000","last_clean":"2023-10-14T12:33:35.839274+0000","last_became_active":"2023-10-14T12:33:31.820734+0000","last_became_peered":"2023-10-14T12:33:31.820734+0000","last_unstale":"2023-10-14T12:33:35.839274+0000","last_undegraded":"2023-10-14T12:33:35.839274+0000","last_fullsized":"2023-10-14T12:33:35.839274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:14:09.495473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854834+0000","last_change":"2023-10-14T12:33:31.821170+0000","last_active":"2023-10-14T12:33:35.854834+0000","last_peered":"2023-10-14T12:33:35.854834+0000","last_clean":"2023-10-14T12:33:35.854834+0000","last_became_active":"2023-10-14T12:33:31.820856+0000","last_became_peered":"2023-10-14T12:33:31.820856+0000","last_unstale":"2023-10-14T12:33:35.854834+0000","last_undegraded":"2023-10-14T12:33:35.854834+0000","last_fullsized":"2023-10-14T12:33:35.854834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851677+0000","last_change":"2023-10-14T12:33:31.819460+0000","last_active":"2023-10-14T12:33:35.851677+0000","last_peered":"2023-10-14T12:33:35.851677+0000","last_clean":"2023-10-14T12:33:35.851677+0000","last_became_active":"2023-10-14T12:33:31.819214+0000","last_became_peered":"2023-10-14T12:33:31.819214+0000","last_unstale":"2023-10-14T12:33:35.851677+0000","last_undegraded":"2023-10-14T12:33:35.851677+0000","last_fullsized":"2023-10-14T12:33:35.851677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:45.477157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847884+0000","last_change":"2023-10-14T12:33:31.866158+0000","last_active":"2023-10-14T12:33:35.847884+0000","last_peered":"2023-10-14T12:33:35.847884+0000","last_clean":"2023-10-14T12:33:35.847884+0000","last_became_active":"2023-10-14T12:33:31.865728+0000","last_became_peered":"2023-10-14T12:33:31.865728+0000","last_unstale":"2023-10-14T12:33:35.847884+0000","last_undegraded":"2023-10-14T12:33:35.847884+0000","last_fullsized":"2023-10-14T12:33:35.847884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839008+0000","last_change":"2023-10-14T12:33:31.819060+0000","last_active":"2023-10-14T12:33:35.839008+0000","last_peered":"2023-10-14T12:33:35.839008+0000","last_clean":"2023-10-14T12:33:35.839008+0000","last_became_active":"2023-10-14T12:33:31.818717+0000","last_became_peered":"2023-10-14T12:33:31.818717+0000","last_unstale":"2023-10-14T12:33:35.839008+0000","last_undegraded":"2023-10-14T12:33:35.839008+0000","last_fullsized":"2023-10-14T12:33:35.839008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847401+0000","last_change":"2023-10-14T12:33:31.866358+0000","last_active":"2023-10-14T12:33:35.847401+0000","last_peered":"2023-10-14T12:33:35.847401+0000","last_clean":"2023-10-14T12:33:35.847401+0000","last_became_active":"2023-10-14T12:33:31.865112+0000","last_became_peered":"2023-10-14T12:33:31.865112+0000","last_unstale":"2023-10-14T12:33:35.847401+0000","last_undegraded":"2023-10-14T12:33:35.847401+0000","last_fullsized":"2023-10-14T12:33:35.847401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838459+0000","last_change":"2023-10-14T12:33:31.821764+0000","last_active":"2023-10-14T12:33:35.838459+0000","last_peered":"2023-10-14T12:33:35.838459+0000","last_clean":"2023-10-14T12:33:35.838459+0000","last_became_active":"2023-10-14T12:33:31.821450+0000","last_became_peered":"2023-10-14T12:33:31.821450+0000","last_unstale":"2023-10-14T12:33:35.838459+0000","last_undegraded":"2023-10-14T12:33:35.838459+0000","last_fullsized":"2023-10-14T12:33:35.838459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.850717+0000","last_change":"2023-10-14T12:33:31.861876+0000","last_active":"2023-10-14T12:33:35.850717+0000","last_peered":"2023-10-14T12:33:35.850717+0000","last_clean":"2023-10-14T12:33:35.850717+0000","last_became_active":"2023-10-14T12:33:31.861620+0000","last_became_peered":"2023-10-14T12:33:31.861620+0000","last_unstale":"2023-10-14T12:33:35.850717+0000","last_undegraded":"2023-10-14T12:33:35.850717+0000","last_fullsized":"2023-10-14T12:33:35.850717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839160+0000","last_change":"2023-10-14T12:33:31.863420+0000","last_active":"2023-10-14T12:33:35.839160+0000","last_peered":"2023-10-14T12:33:35.839160+0000","last_clean":"2023-10-14T12:33:35.839160+0000","last_became_active":"2023-10-14T12:33:31.863132+0000","last_became_peered":"2023-10-14T12:33:31.863132+0000","last_unstale":"2023-10-14T12:33:35.839160+0000","last_undegraded":"2023-10-14T12:33:35.839160+0000","last_fullsized":"2023-10-14T12:33:35.839160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:19.041798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.845863+0000","last_change":"2023-10-14T12:33:31.863478+0000","last_active":"2023-10-14T12:33:35.845863+0000","last_peered":"2023-10-14T12:33:35.845863+0000","last_clean":"2023-10-14T12:33:35.845863+0000","last_became_active":"2023-10-14T12:33:31.863150+0000","last_became_peered":"2023-10-14T12:33:31.863150+0000","last_unstale":"2023-10-14T12:33:35.845863+0000","last_undegraded":"2023-10-14T12:33:35.845863+0000","last_fullsized":"2023-10-14T12:33:35.845863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.845900+0000","last_change":"2023-10-14T12:33:31.866438+0000","last_active":"2023-10-14T12:33:35.845900+0000","last_peered":"2023-10-14T12:33:35.845900+0000","last_clean":"2023-10-14T12:33:35.845900+0000","last_became_active":"2023-10-14T12:33:31.866147+0000","last_became_peered":"2023-10-14T12:33:31.866147+0000","last_unstale":"2023-10-14T12:33:35.845900+0000","last_undegraded":"2023-10-14T12:33:35.845900+0000","last_fullsized":"2023-10-14T12:33:35.845900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839597+0000","last_change":"2023-10-14T12:33:31.829329+0000","last_active":"2023-10-14T12:33:35.839597+0000","last_peered":"2023-10-14T12:33:35.839597+0000","last_clean":"2023-10-14T12:33:35.839597+0000","last_became_active":"2023-10-14T12:33:31.828803+0000","last_became_peered":"2023-10-14T12:33:31.828803+0000","last_unstale":"2023-10-14T12:33:35.839597+0000","last_undegraded":"2023-10-14T12:33:35.839597+0000","last_fullsized":"2023-10-14T12:33:35.839597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:34.169023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844063+0000","last_change":"2023-10-14T12:33:31.817287+0000","last_active":"2023-10-14T12:33:35.844063+0000","last_peered":"2023-10-14T12:33:35.844063+0000","last_clean":"2023-10-14T12:33:35.844063+0000","last_became_active":"2023-10-14T12:33:31.817007+0000","last_became_peered":"2023-10-14T12:33:31.817007+0000","last_unstale":"2023-10-14T12:33:35.844063+0000","last_undegraded":"2023-10-14T12:33:35.844063+0000","last_fullsized":"2023-10-14T12:33:35.844063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852024+0000","last_change":"2023-10-14T12:33:31.818967+0000","last_active":"2023-10-14T12:33:35.852024+0000","last_peered":"2023-10-14T12:33:35.852024+0000","last_clean":"2023-10-14T12:33:35.852024+0000","last_became_active":"2023-10-14T12:33:31.818735+0000","last_became_peered":"2023-10-14T12:33:31.818735+0000","last_unstale":"2023-10-14T12:33:35.852024+0000","last_undegraded":"2023-10-14T12:33:35.852024+0000","last_fullsized":"2023-10-14T12:33:35.852024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:42.240740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854372+0000","last_change":"2023-10-14T12:33:31.834837+0000","last_active":"2023-10-14T12:33:35.854372+0000","last_peered":"2023-10-14T12:33:35.854372+0000","last_clean":"2023-10-14T12:33:35.854372+0000","last_became_active":"2023-10-14T12:33:31.834576+0000","last_became_peered":"2023-10-14T12:33:31.834576+0000","last_unstale":"2023-10-14T12:33:35.854372+0000","last_undegraded":"2023-10-14T12:33:35.854372+0000","last_fullsized":"2023-10-14T12:33:35.854372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847198+0000","last_change":"2023-10-14T12:33:31.865491+0000","last_active":"2023-10-14T12:33:35.847198+0000","last_peered":"2023-10-14T12:33:35.847198+0000","last_clean":"2023-10-14T12:33:35.847198+0000","last_became_active":"2023-10-14T12:33:31.865142+0000","last_became_peered":"2023-10-14T12:33:31.865142+0000","last_unstale":"2023-10-14T12:33:35.847198+0000","last_undegraded":"2023-10-14T12:33:35.847198+0000","last_fullsized":"2023-10-14T12:33:35.847198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848563+0000","last_change":"2023-10-14T12:33:31.861934+0000","last_active":"2023-10-14T12:33:35.848563+0000","last_peered":"2023-10-14T12:33:35.848563+0000","last_clean":"2023-10-14T12:33:35.848563+0000","last_became_active":"2023-10-14T12:33:31.861682+0000","last_became_peered":"2023-10-14T12:33:31.861682+0000","last_unstale":"2023-10-14T12:33:35.848563+0000","last_undegraded":"2023-10-14T12:33:35.848563+0000","last_fullsized":"2023-10-14T12:33:35.848563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:10.562723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.855911+0000","last_change":"2023-10-14T12:33:31.819647+0000","last_active":"2023-10-14T12:33:35.855911+0000","last_peered":"2023-10-14T12:33:35.855911+0000","last_clean":"2023-10-14T12:33:35.855911+0000","last_became_active":"2023-10-14T12:33:31.817659+0000","last_became_peered":"2023-10-14T12:33:31.817659+0000","last_unstale":"2023-10-14T12:33:35.855911+0000","last_undegraded":"2023-10-14T12:33:35.855911+0000","last_fullsized":"2023-10-14T12:33:35.855911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:54.849594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839113+0000","last_change":"2023-10-14T12:33:31.823287+0000","last_active":"2023-10-14T12:33:35.839113+0000","last_peered":"2023-10-14T12:33:35.839113+0000","last_clean":"2023-10-14T12:33:35.839113+0000","last_became_active":"2023-10-14T12:33:31.823062+0000","last_became_peered":"2023-10-14T12:33:31.823062+0000","last_unstale":"2023-10-14T12:33:35.839113+0000","last_undegraded":"2023-10-14T12:33:35.839113+0000","last_fullsized":"2023-10-14T12:33:35.839113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027435+0000","last_change":"2023-10-14T12:33:35.856495+0000","last_active":"2023-10-14T12:33:38.027435+0000","last_peered":"2023-10-14T12:33:38.027435+0000","last_clean":"2023-10-14T12:33:38.027435+0000","last_became_active":"2023-10-14T12:33:35.856098+0000","last_became_peered":"2023-10-14T12:33:35.856098+0000","last_unstale":"2023-10-14T12:33:38.027435+0000","last_undegraded":"2023-10-14T12:33:38.027435+0000","last_fullsized":"2023-10-14T12:33:38.027435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:37:19.985088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852656+0000","last_change":"2023-10-14T12:33:30.830266+0000","last_active":"2023-10-14T12:33:35.852656+0000","last_peered":"2023-10-14T12:33:35.852656+0000","last_clean":"2023-10-14T12:33:35.852656+0000","last_became_active":"2023-10-14T12:33:30.829974+0000","last_became_peered":"2023-10-14T12:33:30.829974+0000","last_unstale":"2023-10-14T12:33:35.852656+0000","last_undegraded":"2023-10-14T12:33:35.852656+0000","last_fullsized":"2023-10-14T12:33:35.852656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843869+0000","last_change":"2023-10-14T12:33:31.823407+0000","last_active":"2023-10-14T12:33:35.843869+0000","last_peered":"2023-10-14T12:33:35.843869+0000","last_clean":"2023-10-14T12:33:35.843869+0000","last_became_active":"2023-10-14T12:33:31.823134+0000","last_became_peered":"2023-10-14T12:33:31.823134+0000","last_unstale":"2023-10-14T12:33:35.843869+0000","last_undegraded":"2023-10-14T12:33:35.843869+0000","last_fullsized":"2023-10-14T12:33:35.843869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846110+0000","last_change":"2023-10-14T12:33:35.860480+0000","last_active":"2023-10-14T12:33:36.846110+0000","last_peered":"2023-10-14T12:33:36.846110+0000","last_clean":"2023-10-14T12:33:36.846110+0000","last_became_active":"2023-10-14T12:33:35.860054+0000","last_became_peered":"2023-10-14T12:33:35.860054+0000","last_unstale":"2023-10-14T12:33:36.846110+0000","last_undegraded":"2023-10-14T12:33:36.846110+0000","last_fullsized":"2023-10-14T12:33:36.846110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:46.147663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843810+0000","last_change":"2023-10-14T12:33:30.828686+0000","last_active":"2023-10-14T12:33:35.843810+0000","last_peered":"2023-10-14T12:33:35.843810+0000","last_clean":"2023-10-14T12:33:35.843810+0000","last_became_active":"2023-10-14T12:33:30.828358+0000","last_became_peered":"2023-10-14T12:33:30.828358+0000","last_unstale":"2023-10-14T12:33:35.843810+0000","last_undegraded":"2023-10-14T12:33:35.843810+0000","last_fullsized":"2023-10-14T12:33:35.843810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852396+0000","last_change":"2023-10-14T12:33:31.863657+0000","last_active":"2023-10-14T12:33:35.852396+0000","last_peered":"2023-10-14T12:33:35.852396+0000","last_clean":"2023-10-14T12:33:35.852396+0000","last_became_active":"2023-10-14T12:33:31.863270+0000","last_became_peered":"2023-10-14T12:33:31.863270+0000","last_unstale":"2023-10-14T12:33:35.852396+0000","last_undegraded":"2023-10-14T12:33:35.852396+0000","last_fullsized":"2023-10-14T12:33:35.852396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846369+0000","last_change":"2023-10-14T12:33:35.860669+0000","last_active":"2023-10-14T12:33:36.846369+0000","last_peered":"2023-10-14T12:33:36.846369+0000","last_clean":"2023-10-14T12:33:36.846369+0000","last_became_active":"2023-10-14T12:33:35.860172+0000","last_became_peered":"2023-10-14T12:33:35.860172+0000","last_unstale":"2023-10-14T12:33:36.846369+0000","last_undegraded":"2023-10-14T12:33:36.846369+0000","last_fullsized":"2023-10-14T12:33:36.846369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:34.560475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838805+0000","last_change":"2023-10-14T12:33:30.823902+0000","last_active":"2023-10-14T12:33:35.838805+0000","last_peered":"2023-10-14T12:33:35.838805+0000","last_clean":"2023-10-14T12:33:35.838805+0000","last_became_active":"2023-10-14T12:33:30.823644+0000","last_became_peered":"2023-10-14T12:33:30.823644+0000","last_unstale":"2023-10-14T12:33:35.838805+0000","last_undegraded":"2023-10-14T12:33:35.838805+0000","last_fullsized":"2023-10-14T12:33:35.838805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:29.522892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847636+0000","last_change":"2023-10-14T12:33:31.865659+0000","last_active":"2023-10-14T12:33:35.847636+0000","last_peered":"2023-10-14T12:33:35.847636+0000","last_clean":"2023-10-14T12:33:35.847636+0000","last_became_active":"2023-10-14T12:33:31.865277+0000","last_became_peered":"2023-10-14T12:33:31.865277+0000","last_unstale":"2023-10-14T12:33:35.847636+0000","last_undegraded":"2023-10-14T12:33:35.847636+0000","last_fullsized":"2023-10-14T12:33:35.847636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:15.636750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846392+0000","last_change":"2023-10-14T12:33:35.854228+0000","last_active":"2023-10-14T12:33:36.846392+0000","last_peered":"2023-10-14T12:33:36.846392+0000","last_clean":"2023-10-14T12:33:36.846392+0000","last_became_active":"2023-10-14T12:33:35.853491+0000","last_became_peered":"2023-10-14T12:33:35.853491+0000","last_unstale":"2023-10-14T12:33:36.846392+0000","last_undegraded":"2023-10-14T12:33:36.846392+0000","last_fullsized":"2023-10-14T12:33:36.846392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:41.319662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838457+0000","last_change":"2023-10-14T12:33:30.829300+0000","last_active":"2023-10-14T12:33:35.838457+0000","last_peered":"2023-10-14T12:33:35.838457+0000","last_clean":"2023-10-14T12:33:35.838457+0000","last_became_active":"2023-10-14T12:33:30.829047+0000","last_became_peered":"2023-10-14T12:33:30.829047+0000","last_unstale":"2023-10-14T12:33:35.838457+0000","last_undegraded":"2023-10-14T12:33:35.838457+0000","last_fullsized":"2023-10-14T12:33:35.838457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:41.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848050+0000","last_change":"2023-10-14T12:33:31.866122+0000","last_active":"2023-10-14T12:33:35.848050+0000","last_peered":"2023-10-14T12:33:35.848050+0000","last_clean":"2023-10-14T12:33:35.848050+0000","last_became_active":"2023-10-14T12:33:31.865828+0000","last_became_peered":"2023-10-14T12:33:31.865828+0000","last_unstale":"2023-10-14T12:33:35.848050+0000","last_undegraded":"2023-10-14T12:33:35.848050+0000","last_fullsized":"2023-10-14T12:33:35.848050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:13.669993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027681+0000","last_change":"2023-10-14T12:33:35.866746+0000","last_active":"2023-10-14T12:33:38.027681+0000","last_peered":"2023-10-14T12:33:38.027681+0000","last_clean":"2023-10-14T12:33:38.027681+0000","last_became_active":"2023-10-14T12:33:35.866256+0000","last_became_peered":"2023-10-14T12:33:35.866256+0000","last_unstale":"2023-10-14T12:33:38.027681+0000","last_undegraded":"2023-10-14T12:33:38.027681+0000","last_fullsized":"2023-10-14T12:33:38.027681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:45:51.637024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844274+0000","last_change":"2023-10-14T12:33:30.816017+0000","last_active":"2023-10-14T12:33:35.844274+0000","last_peered":"2023-10-14T12:33:35.844274+0000","last_clean":"2023-10-14T12:33:35.844274+0000","last_became_active":"2023-10-14T12:33:30.815728+0000","last_became_peered":"2023-10-14T12:33:30.815728+0000","last_unstale":"2023-10-14T12:33:35.844274+0000","last_undegraded":"2023-10-14T12:33:35.844274+0000","last_fullsized":"2023-10-14T12:33:35.844274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:23.740058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838523+0000","last_change":"2023-10-14T12:33:31.830404+0000","last_active":"2023-10-14T12:33:35.838523+0000","last_peered":"2023-10-14T12:33:35.838523+0000","last_clean":"2023-10-14T12:33:35.838523+0000","last_became_active":"2023-10-14T12:33:31.830125+0000","last_became_peered":"2023-10-14T12:33:31.830125+0000","last_unstale":"2023-10-14T12:33:35.838523+0000","last_undegraded":"2023-10-14T12:33:35.838523+0000","last_fullsized":"2023-10-14T12:33:35.838523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:13.312142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.318744+0000","last_change":"2023-10-14T12:33:35.865486+0000","last_active":"2023-10-14T12:33:37.318744+0000","last_peered":"2023-10-14T12:33:37.318744+0000","last_clean":"2023-10-14T12:33:37.318744+0000","last_became_active":"2023-10-14T12:33:35.865104+0000","last_became_peered":"2023-10-14T12:33:35.865104+0000","last_unstale":"2023-10-14T12:33:37.318744+0000","last_undegraded":"2023-10-14T12:33:37.318744+0000","last_fullsized":"2023-10-14T12:33:37.318744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:46.272679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846748+0000","last_change":"2023-10-14T12:33:30.818159+0000","last_active":"2023-10-14T12:33:35.846748+0000","last_peered":"2023-10-14T12:33:35.846748+0000","last_clean":"2023-10-14T12:33:35.846748+0000","last_became_active":"2023-10-14T12:33:30.817845+0000","last_became_peered":"2023-10-14T12:33:30.817845+0000","last_unstale":"2023-10-14T12:33:35.846748+0000","last_undegraded":"2023-10-14T12:33:35.846748+0000","last_fullsized":"2023-10-14T12:33:35.846748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851619+0000","last_change":"2023-10-14T12:33:31.833662+0000","last_active":"2023-10-14T12:33:35.851619+0000","last_peered":"2023-10-14T12:33:35.851619+0000","last_clean":"2023-10-14T12:33:35.851619+0000","last_became_active":"2023-10-14T12:33:31.833398+0000","last_became_peered":"2023-10-14T12:33:31.833398+0000","last_unstale":"2023-10-14T12:33:35.851619+0000","last_undegraded":"2023-10-14T12:33:35.851619+0000","last_fullsized":"2023-10-14T12:33:35.851619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.841255+0000","last_change":"2023-10-14T12:33:35.866463+0000","last_active":"2023-10-14T12:33:36.841255+0000","last_peered":"2023-10-14T12:33:36.841255+0000","last_clean":"2023-10-14T12:33:36.841255+0000","last_became_active":"2023-10-14T12:33:35.866062+0000","last_became_peered":"2023-10-14T12:33:35.866062+0000","last_unstale":"2023-10-14T12:33:36.841255+0000","last_undegraded":"2023-10-14T12:33:36.841255+0000","last_fullsized":"2023-10-14T12:33:36.841255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847361+0000","last_change":"2023-10-14T12:33:30.821259+0000","last_active":"2023-10-14T12:33:35.847361+0000","last_peered":"2023-10-14T12:33:35.847361+0000","last_clean":"2023-10-14T12:33:35.847361+0000","last_became_active":"2023-10-14T12:33:30.820962+0000","last_became_peered":"2023-10-14T12:33:30.820962+0000","last_unstale":"2023-10-14T12:33:35.847361+0000","last_undegraded":"2023-10-14T12:33:35.847361+0000","last_fullsized":"2023-10-14T12:33:35.847361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844696+0000","last_change":"2023-10-14T12:33:31.821784+0000","last_active":"2023-10-14T12:33:35.844696+0000","last_peered":"2023-10-14T12:33:35.844696+0000","last_clean":"2023-10-14T12:33:35.844696+0000","last_became_active":"2023-10-14T12:33:31.821472+0000","last_became_peered":"2023-10-14T12:33:31.821472+0000","last_unstale":"2023-10-14T12:33:35.844696+0000","last_undegraded":"2023-10-14T12:33:35.844696+0000","last_fullsized":"2023-10-14T12:33:35.844696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025944+0000","last_change":"2023-10-14T12:33:35.861224+0000","last_active":"2023-10-14T12:33:38.025944+0000","last_peered":"2023-10-14T12:33:38.025944+0000","last_clean":"2023-10-14T12:33:38.025944+0000","last_became_active":"2023-10-14T12:33:35.860816+0000","last_became_peered":"2023-10-14T12:33:35.860816+0000","last_unstale":"2023-10-14T12:33:38.025944+0000","last_undegraded":"2023-10-14T12:33:38.025944+0000","last_fullsized":"2023-10-14T12:33:38.025944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:23.073737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847265+0000","last_change":"2023-10-14T12:33:30.826762+0000","last_active":"2023-10-14T12:33:35.847265+0000","last_peered":"2023-10-14T12:33:35.847265+0000","last_clean":"2023-10-14T12:33:35.847265+0000","last_became_active":"2023-10-14T12:33:30.826477+0000","last_became_peered":"2023-10-14T12:33:30.826477+0000","last_unstale":"2023-10-14T12:33:35.847265+0000","last_undegraded":"2023-10-14T12:33:35.847265+0000","last_fullsized":"2023-10-14T12:33:35.847265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854580+0000","last_change":"2023-10-14T12:33:31.817507+0000","last_active":"2023-10-14T12:33:35.854580+0000","last_peered":"2023-10-14T12:33:35.854580+0000","last_clean":"2023-10-14T12:33:35.854580+0000","last_became_active":"2023-10-14T12:33:31.817121+0000","last_became_peered":"2023-10-14T12:33:31.817121+0000","last_unstale":"2023-10-14T12:33:35.854580+0000","last_undegraded":"2023-10-14T12:33:35.854580+0000","last_fullsized":"2023-10-14T12:33:35.854580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027281+0000","last_change":"2023-10-14T12:33:35.856441+0000","last_active":"2023-10-14T12:33:38.027281+0000","last_peered":"2023-10-14T12:33:38.027281+0000","last_clean":"2023-10-14T12:33:38.027281+0000","last_became_active":"2023-10-14T12:33:35.856034+0000","last_became_peered":"2023-10-14T12:33:35.856034+0000","last_unstale":"2023-10-14T12:33:38.027281+0000","last_undegraded":"2023-10-14T12:33:38.027281+0000","last_fullsized":"2023-10-14T12:33:38.027281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:56.042282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846794+0000","last_change":"2023-10-14T12:33:30.827702+0000","last_active":"2023-10-14T12:33:35.846794+0000","last_peered":"2023-10-14T12:33:35.846794+0000","last_clean":"2023-10-14T12:33:35.846794+0000","last_became_active":"2023-10-14T12:33:30.827300+0000","last_became_peered":"2023-10-14T12:33:30.827300+0000","last_unstale":"2023-10-14T12:33:35.846794+0000","last_undegraded":"2023-10-14T12:33:35.846794+0000","last_fullsized":"2023-10-14T12:33:35.846794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848452+0000","last_change":"2023-10-14T12:33:31.865300+0000","last_active":"2023-10-14T12:33:35.848452+0000","last_peered":"2023-10-14T12:33:35.848452+0000","last_clean":"2023-10-14T12:33:35.848452+0000","last_became_active":"2023-10-14T12:33:31.865011+0000","last_became_peered":"2023-10-14T12:33:31.865011+0000","last_unstale":"2023-10-14T12:33:35.848452+0000","last_undegraded":"2023-10-14T12:33:35.848452+0000","last_fullsized":"2023-10-14T12:33:35.848452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:21.583926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027294+0000","last_change":"2023-10-14T12:33:35.862519+0000","last_active":"2023-10-14T12:33:38.027294+0000","last_peered":"2023-10-14T12:33:38.027294+0000","last_clean":"2023-10-14T12:33:38.027294+0000","last_became_active":"2023-10-14T12:33:35.861926+0000","last_became_peered":"2023-10-14T12:33:35.861926+0000","last_unstale":"2023-10-14T12:33:38.027294+0000","last_undegraded":"2023-10-14T12:33:38.027294+0000","last_fullsized":"2023-10-14T12:33:38.027294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:27.584701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848363+0000","last_change":"2023-10-14T12:33:30.826679+0000","last_active":"2023-10-14T12:33:35.848363+0000","last_peered":"2023-10-14T12:33:35.848363+0000","last_clean":"2023-10-14T12:33:35.848363+0000","last_became_active":"2023-10-14T12:33:30.826407+0000","last_became_peered":"2023-10-14T12:33:30.826407+0000","last_unstale":"2023-10-14T12:33:35.848363+0000","last_undegraded":"2023-10-14T12:33:35.848363+0000","last_fullsized":"2023-10-14T12:33:35.848363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:48.937270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852489+0000","last_change":"2023-10-14T12:33:31.866686+0000","last_active":"2023-10-14T12:33:35.852489+0000","last_peered":"2023-10-14T12:33:35.852489+0000","last_clean":"2023-10-14T12:33:35.852489+0000","last_became_active":"2023-10-14T12:33:31.866296+0000","last_became_peered":"2023-10-14T12:33:31.866296+0000","last_unstale":"2023-10-14T12:33:35.852489+0000","last_undegraded":"2023-10-14T12:33:35.852489+0000","last_fullsized":"2023-10-14T12:33:35.852489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846622+0000","last_change":"2023-10-14T12:33:35.860504+0000","last_active":"2023-10-14T12:33:36.846622+0000","last_peered":"2023-10-14T12:33:36.846622+0000","last_clean":"2023-10-14T12:33:36.846622+0000","last_became_active":"2023-10-14T12:33:35.860105+0000","last_became_peered":"2023-10-14T12:33:35.860105+0000","last_unstale":"2023-10-14T12:33:36.846622+0000","last_undegraded":"2023-10-14T12:33:36.846622+0000","last_fullsized":"2023-10-14T12:33:36.846622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:29.627124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854796+0000","last_change":"2023-10-14T12:33:30.828734+0000","last_active":"2023-10-14T12:33:35.854796+0000","last_peered":"2023-10-14T12:33:35.854796+0000","last_clean":"2023-10-14T12:33:35.854796+0000","last_became_active":"2023-10-14T12:33:30.827180+0000","last_became_peered":"2023-10-14T12:33:30.827180+0000","last_unstale":"2023-10-14T12:33:35.854796+0000","last_undegraded":"2023-10-14T12:33:35.854796+0000","last_fullsized":"2023-10-14T12:33:35.854796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:17.918071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839536+0000","last_change":"2023-10-14T12:33:31.829359+0000","last_active":"2023-10-14T12:33:35.839536+0000","last_peered":"2023-10-14T12:33:35.839536+0000","last_clean":"2023-10-14T12:33:35.839536+0000","last_became_active":"2023-10-14T12:33:31.828972+0000","last_became_peered":"2023-10-14T12:33:31.828972+0000","last_unstale":"2023-10-14T12:33:35.839536+0000","last_undegraded":"2023-10-14T12:33:35.839536+0000","last_fullsized":"2023-10-14T12:33:35.839536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:35.674331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025766+0000","last_change":"2023-10-14T12:33:35.857105+0000","last_active":"2023-10-14T12:33:38.025766+0000","last_peered":"2023-10-14T12:33:38.025766+0000","last_clean":"2023-10-14T12:33:38.025766+0000","last_became_active":"2023-10-14T12:33:35.856756+0000","last_became_peered":"2023-10-14T12:33:35.856756+0000","last_unstale":"2023-10-14T12:33:38.025766+0000","last_undegraded":"2023-10-14T12:33:38.025766+0000","last_fullsized":"2023-10-14T12:33:38.025766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:41.635415+0000","last_change":"2023-10-14T12:33:30.825111+0000","last_active":"2023-10-14T12:33:41.635415+0000","last_peered":"2023-10-14T12:33:41.635415+0000","last_clean":"2023-10-14T12:33:41.635415+0000","last_became_active":"2023-10-14T12:33:30.824768+0000","last_became_peered":"2023-10-14T12:33:30.824768+0000","last_unstale":"2023-10-14T12:33:41.635415+0000","last_undegraded":"2023-10-14T12:33:41.635415+0000","last_fullsized":"2023-10-14T12:33:41.635415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:09.427953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839014+0000","last_change":"2023-10-14T12:33:31.822451+0000","last_active":"2023-10-14T12:33:35.839014+0000","last_peered":"2023-10-14T12:33:35.839014+0000","last_clean":"2023-10-14T12:33:35.839014+0000","last_became_active":"2023-10-14T12:33:31.822131+0000","last_became_peered":"2023-10-14T12:33:31.822131+0000","last_unstale":"2023-10-14T12:33:35.839014+0000","last_undegraded":"2023-10-14T12:33:35.839014+0000","last_fullsized":"2023-10-14T12:33:35.839014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:24.848048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.319564+0000","last_change":"2023-10-14T12:33:35.864107+0000","last_active":"2023-10-14T12:33:37.319564+0000","last_peered":"2023-10-14T12:33:37.319564+0000","last_clean":"2023-10-14T12:33:37.319564+0000","last_became_active":"2023-10-14T12:33:35.863602+0000","last_became_peered":"2023-10-14T12:33:35.863602+0000","last_unstale":"2023-10-14T12:33:37.319564+0000","last_undegraded":"2023-10-14T12:33:37.319564+0000","last_fullsized":"2023-10-14T12:33:37.319564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:50:27.584701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851934+0000","last_change":"2023-10-14T12:33:30.830335+0000","last_active":"2023-10-14T12:33:35.851934+0000","last_peered":"2023-10-14T12:33:35.851934+0000","last_clean":"2023-10-14T12:33:35.851934+0000","last_became_active":"2023-10-14T12:33:30.829756+0000","last_became_peered":"2023-10-14T12:33:30.829756+0000","last_unstale":"2023-10-14T12:33:35.851934+0000","last_undegraded":"2023-10-14T12:33:35.851934+0000","last_fullsized":"2023-10-14T12:33:35.851934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:49.417513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852109+0000","last_change":"2023-10-14T12:33:31.822308+0000","last_active":"2023-10-14T12:33:35.852109+0000","last_peered":"2023-10-14T12:33:35.852109+0000","last_clean":"2023-10-14T12:33:35.852109+0000","last_became_active":"2023-10-14T12:33:31.822055+0000","last_became_peered":"2023-10-14T12:33:31.822055+0000","last_unstale":"2023-10-14T12:33:35.852109+0000","last_undegraded":"2023-10-14T12:33:35.852109+0000","last_fullsized":"2023-10-14T12:33:35.852109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:10.433597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027505+0000","last_change":"2023-10-14T12:33:35.869237+0000","last_active":"2023-10-14T12:33:38.027505+0000","last_peered":"2023-10-14T12:33:38.027505+0000","last_clean":"2023-10-14T12:33:38.027505+0000","last_became_active":"2023-10-14T12:33:35.866485+0000","last_became_peered":"2023-10-14T12:33:35.866485+0000","last_unstale":"2023-10-14T12:33:38.027505+0000","last_undegraded":"2023-10-14T12:33:38.027505+0000","last_fullsized":"2023-10-14T12:33:38.027505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:51:59.414054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847188+0000","last_change":"2023-10-14T12:33:30.826101+0000","last_active":"2023-10-14T12:33:35.847188+0000","last_peered":"2023-10-14T12:33:35.847188+0000","last_clean":"2023-10-14T12:33:35.847188+0000","last_became_active":"2023-10-14T12:33:30.825904+0000","last_became_peered":"2023-10-14T12:33:30.825904+0000","last_unstale":"2023-10-14T12:33:35.847188+0000","last_undegraded":"2023-10-14T12:33:35.847188+0000","last_fullsized":"2023-10-14T12:33:35.847188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:34.109444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839117+0000","last_change":"2023-10-14T12:33:31.829811+0000","last_active":"2023-10-14T12:33:35.839117+0000","last_peered":"2023-10-14T12:33:35.839117+0000","last_clean":"2023-10-14T12:33:35.839117+0000","last_became_active":"2023-10-14T12:33:31.829557+0000","last_became_peered":"2023-10-14T12:33:31.829557+0000","last_unstale":"2023-10-14T12:33:35.839117+0000","last_undegraded":"2023-10-14T12:33:35.839117+0000","last_fullsized":"2023-10-14T12:33:35.839117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:21.583926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027964+0000","last_change":"2023-10-14T12:33:35.866238+0000","last_active":"2023-10-14T12:33:38.027964+0000","last_peered":"2023-10-14T12:33:38.027964+0000","last_clean":"2023-10-14T12:33:38.027964+0000","last_became_active":"2023-10-14T12:33:35.865766+0000","last_became_peered":"2023-10-14T12:33:35.865766+0000","last_unstale":"2023-10-14T12:33:38.027964+0000","last_undegraded":"2023-10-14T12:33:38.027964+0000","last_fullsized":"2023-10-14T12:33:38.027964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:29:39.610994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846622+0000","last_change":"2023-10-14T12:33:30.818254+0000","last_active":"2023-10-14T12:33:35.846622+0000","last_peered":"2023-10-14T12:33:35.846622+0000","last_clean":"2023-10-14T12:33:35.846622+0000","last_became_active":"2023-10-14T12:33:30.817968+0000","last_became_peered":"2023-10-14T12:33:30.817968+0000","last_unstale":"2023-10-14T12:33:35.846622+0000","last_undegraded":"2023-10-14T12:33:35.846622+0000","last_fullsized":"2023-10-14T12:33:35.846622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:02:34.668687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847416+0000","last_change":"2023-10-14T12:33:31.822035+0000","last_active":"2023-10-14T12:33:35.847416+0000","last_peered":"2023-10-14T12:33:35.847416+0000","last_clean":"2023-10-14T12:33:35.847416+0000","last_became_active":"2023-10-14T12:33:31.821751+0000","last_became_peered":"2023-10-14T12:33:31.821751+0000","last_unstale":"2023-10-14T12:33:35.847416+0000","last_undegraded":"2023-10-14T12:33:35.847416+0000","last_fullsized":"2023-10-14T12:33:35.847416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:30.730899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025739+0000","last_change":"2023-10-14T12:33:35.864410+0000","last_active":"2023-10-14T12:33:38.025739+0000","last_peered":"2023-10-14T12:33:38.025739+0000","last_clean":"2023-10-14T12:33:38.025739+0000","last_became_active":"2023-10-14T12:33:35.863490+0000","last_became_peered":"2023-10-14T12:33:35.863490+0000","last_unstale":"2023-10-14T12:33:38.025739+0000","last_undegraded":"2023-10-14T12:33:38.025739+0000","last_fullsized":"2023-10-14T12:33:38.025739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854376+0000","last_change":"2023-10-14T12:33:30.825658+0000","last_active":"2023-10-14T12:33:35.854376+0000","last_peered":"2023-10-14T12:33:35.854376+0000","last_clean":"2023-10-14T12:33:35.854376+0000","last_became_active":"2023-10-14T12:33:30.825377+0000","last_became_peered":"2023-10-14T12:33:30.825377+0000","last_unstale":"2023-10-14T12:33:35.854376+0000","last_undegraded":"2023-10-14T12:33:35.854376+0000","last_fullsized":"2023-10-14T12:33:35.854376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:45.725924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839717+0000","last_change":"2023-10-14T12:33:31.829114+0000","last_active":"2023-10-14T12:33:35.839717+0000","last_peered":"2023-10-14T12:33:35.839717+0000","last_clean":"2023-10-14T12:33:35.839717+0000","last_became_active":"2023-10-14T12:33:31.828836+0000","last_became_peered":"2023-10-14T12:33:31.828836+0000","last_unstale":"2023-10-14T12:33:35.839717+0000","last_undegraded":"2023-10-14T12:33:35.839717+0000","last_fullsized":"2023-10-14T12:33:35.839717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846100+0000","last_change":"2023-10-14T12:33:35.861113+0000","last_active":"2023-10-14T12:33:36.846100+0000","last_peered":"2023-10-14T12:33:36.846100+0000","last_clean":"2023-10-14T12:33:36.846100+0000","last_became_active":"2023-10-14T12:33:35.860576+0000","last_became_peered":"2023-10-14T12:33:35.860576+0000","last_unstale":"2023-10-14T12:33:36.846100+0000","last_undegraded":"2023-10-14T12:33:36.846100+0000","last_fullsized":"2023-10-14T12:33:36.846100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:01.926300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838546+0000","last_change":"2023-10-14T12:33:30.831073+0000","last_active":"2023-10-14T12:33:35.838546+0000","last_peered":"2023-10-14T12:33:35.838546+0000","last_clean":"2023-10-14T12:33:35.838546+0000","last_became_active":"2023-10-14T12:33:30.830742+0000","last_became_peered":"2023-10-14T12:33:30.830742+0000","last_unstale":"2023-10-14T12:33:35.838546+0000","last_undegraded":"2023-10-14T12:33:35.838546+0000","last_fullsized":"2023-10-14T12:33:35.838546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:20:45.725924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839426+0000","last_change":"2023-10-14T12:33:31.827984+0000","last_active":"2023-10-14T12:33:35.839426+0000","last_peered":"2023-10-14T12:33:35.839426+0000","last_clean":"2023-10-14T12:33:35.839426+0000","last_became_active":"2023-10-14T12:33:31.827707+0000","last_became_peered":"2023-10-14T12:33:31.827707+0000","last_unstale":"2023-10-14T12:33:35.839426+0000","last_undegraded":"2023-10-14T12:33:35.839426+0000","last_fullsized":"2023-10-14T12:33:35.839426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:15.636750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025631+0000","last_change":"2023-10-14T12:33:35.859968+0000","last_active":"2023-10-14T12:33:38.025631+0000","last_peered":"2023-10-14T12:33:38.025631+0000","last_clean":"2023-10-14T12:33:38.025631+0000","last_became_active":"2023-10-14T12:33:35.859542+0000","last_became_peered":"2023-10-14T12:33:35.859542+0000","last_unstale":"2023-10-14T12:33:38.025631+0000","last_undegraded":"2023-10-14T12:33:38.025631+0000","last_fullsized":"2023-10-14T12:33:38.025631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:28.879987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854731+0000","last_change":"2023-10-14T12:33:30.829611+0000","last_active":"2023-10-14T12:33:35.854731+0000","last_peered":"2023-10-14T12:33:35.854731+0000","last_clean":"2023-10-14T12:33:35.854731+0000","last_became_active":"2023-10-14T12:33:30.829317+0000","last_became_peered":"2023-10-14T12:33:30.829317+0000","last_unstale":"2023-10-14T12:33:35.854731+0000","last_undegraded":"2023-10-14T12:33:35.854731+0000","last_fullsized":"2023-10-14T12:33:35.854731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847512+0000","last_change":"2023-10-14T12:33:31.867826+0000","last_active":"2023-10-14T12:33:35.847512+0000","last_peered":"2023-10-14T12:33:35.847512+0000","last_clean":"2023-10-14T12:33:35.847512+0000","last_became_active":"2023-10-14T12:33:31.867531+0000","last_became_peered":"2023-10-14T12:33:31.867531+0000","last_unstale":"2023-10-14T12:33:35.847512+0000","last_undegraded":"2023-10-14T12:33:35.847512+0000","last_fullsized":"2023-10-14T12:33:35.847512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:41:19.041798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026385+0000","last_change":"2023-10-14T12:33:35.860655+0000","last_active":"2023-10-14T12:33:38.026385+0000","last_peered":"2023-10-14T12:33:38.026385+0000","last_clean":"2023-10-14T12:33:38.026385+0000","last_became_active":"2023-10-14T12:33:35.859946+0000","last_became_peered":"2023-10-14T12:33:35.859946+0000","last_unstale":"2023-10-14T12:33:38.026385+0000","last_undegraded":"2023-10-14T12:33:38.026385+0000","last_fullsized":"2023-10-14T12:33:38.026385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:17.701932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847196+0000","last_change":"2023-10-14T12:33:30.828530+0000","last_active":"2023-10-14T12:33:35.847196+0000","last_peered":"2023-10-14T12:33:35.847196+0000","last_clean":"2023-10-14T12:33:35.847196+0000","last_became_active":"2023-10-14T12:33:30.828070+0000","last_became_peered":"2023-10-14T12:33:30.828070+0000","last_unstale":"2023-10-14T12:33:35.847196+0000","last_undegraded":"2023-10-14T12:33:35.847196+0000","last_fullsized":"2023-10-14T12:33:35.847196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:29.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.841114+0000","last_change":"2023-10-14T12:33:31.828949+0000","last_active":"2023-10-14T12:33:35.841114+0000","last_peered":"2023-10-14T12:33:35.841114+0000","last_clean":"2023-10-14T12:33:35.841114+0000","last_became_active":"2023-10-14T12:33:31.828658+0000","last_became_peered":"2023-10-14T12:33:31.828658+0000","last_unstale":"2023-10-14T12:33:35.841114+0000","last_undegraded":"2023-10-14T12:33:35.841114+0000","last_fullsized":"2023-10-14T12:33:35.841114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:24.745702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026150+0000","last_change":"2023-10-14T12:33:35.860287+0000","last_active":"2023-10-14T12:33:38.026150+0000","last_peered":"2023-10-14T12:33:38.026150+0000","last_clean":"2023-10-14T12:33:38.026150+0000","last_became_active":"2023-10-14T12:33:35.859467+0000","last_became_peered":"2023-10-14T12:33:35.859467+0000","last_unstale":"2023-10-14T12:33:38.026150+0000","last_undegraded":"2023-10-14T12:33:38.026150+0000","last_fullsized":"2023-10-14T12:33:38.026150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854284+0000","last_change":"2023-10-14T12:33:31.820322+0000","last_active":"2023-10-14T12:33:35.854284+0000","last_peered":"2023-10-14T12:33:35.854284+0000","last_clean":"2023-10-14T12:33:35.854284+0000","last_became_active":"2023-10-14T12:33:31.820087+0000","last_became_peered":"2023-10-14T12:33:31.820087+0000","last_unstale":"2023-10-14T12:33:35.854284+0000","last_undegraded":"2023-10-14T12:33:35.854284+0000","last_fullsized":"2023-10-14T12:33:35.854284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:42:45.477157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854363+0000","last_change":"2023-10-14T12:33:30.821383+0000","last_active":"2023-10-14T12:33:35.854363+0000","last_peered":"2023-10-14T12:33:35.854363+0000","last_clean":"2023-10-14T12:33:35.854363+0000","last_became_active":"2023-10-14T12:33:30.821096+0000","last_became_peered":"2023-10-14T12:33:30.821096+0000","last_unstale":"2023-10-14T12:33:35.854363+0000","last_undegraded":"2023-10-14T12:33:35.854363+0000","last_fullsized":"2023-10-14T12:33:35.854363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:23.650329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.840950+0000","last_change":"2023-10-14T12:33:35.858076+0000","last_active":"2023-10-14T12:33:36.840950+0000","last_peered":"2023-10-14T12:33:36.840950+0000","last_clean":"2023-10-14T12:33:36.840950+0000","last_became_active":"2023-10-14T12:33:35.857526+0000","last_became_peered":"2023-10-14T12:33:35.857526+0000","last_unstale":"2023-10-14T12:33:36.840950+0000","last_undegraded":"2023-10-14T12:33:36.840950+0000","last_fullsized":"2023-10-14T12:33:36.840950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:14.594662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.843234+0000","last_change":"2023-10-14T12:33:31.868186+0000","last_active":"2023-10-14T12:33:35.843234+0000","last_peered":"2023-10-14T12:33:35.843234+0000","last_clean":"2023-10-14T12:33:35.843234+0000","last_became_active":"2023-10-14T12:33:31.867909+0000","last_became_peered":"2023-10-14T12:33:31.867909+0000","last_unstale":"2023-10-14T12:33:35.843234+0000","last_undegraded":"2023-10-14T12:33:35.843234+0000","last_fullsized":"2023-10-14T12:33:35.843234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847138+0000","last_change":"2023-10-14T12:33:30.828058+0000","last_active":"2023-10-14T12:33:35.847138+0000","last_peered":"2023-10-14T12:33:35.847138+0000","last_clean":"2023-10-14T12:33:35.847138+0000","last_became_active":"2023-10-14T12:33:30.827816+0000","last_became_peered":"2023-10-14T12:33:30.827816+0000","last_unstale":"2023-10-14T12:33:35.847138+0000","last_undegraded":"2023-10-14T12:33:35.847138+0000","last_fullsized":"2023-10-14T12:33:35.847138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:40:23.650329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839385+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:33:35.839385+0000","last_peered":"2023-10-14T12:33:35.839385+0000","last_clean":"2023-10-14T12:33:35.839385+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:33:35.839385+0000","last_undegraded":"2023-10-14T12:33:35.839385+0000","last_fullsized":"2023-10-14T12:33:35.839385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025827+0000","last_change":"2023-10-14T12:33:35.864687+0000","last_active":"2023-10-14T12:33:38.025827+0000","last_peered":"2023-10-14T12:33:38.025827+0000","last_clean":"2023-10-14T12:33:38.025827+0000","last_became_active":"2023-10-14T12:33:35.864048+0000","last_became_peered":"2023-10-14T12:33:35.864048+0000","last_unstale":"2023-10-14T12:33:38.025827+0000","last_undegraded":"2023-10-14T12:33:38.025827+0000","last_fullsized":"2023-10-14T12:33:38.025827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:17.701932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.849606+0000","last_change":"2023-10-14T12:33:31.833047+0000","last_active":"2023-10-14T12:33:35.849606+0000","last_peered":"2023-10-14T12:33:35.849606+0000","last_clean":"2023-10-14T12:33:35.849606+0000","last_became_active":"2023-10-14T12:33:31.832727+0000","last_became_peered":"2023-10-14T12:33:31.832727+0000","last_unstale":"2023-10-14T12:33:35.849606+0000","last_undegraded":"2023-10-14T12:33:35.849606+0000","last_fullsized":"2023-10-14T12:33:35.849606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839488+0000","last_change":"2023-10-14T12:33:30.825584+0000","last_active":"2023-10-14T12:33:35.839488+0000","last_peered":"2023-10-14T12:33:35.839488+0000","last_clean":"2023-10-14T12:33:35.839488+0000","last_became_active":"2023-10-14T12:33:30.825306+0000","last_became_peered":"2023-10-14T12:33:30.825306+0000","last_unstale":"2023-10-14T12:33:35.839488+0000","last_undegraded":"2023-10-14T12:33:35.839488+0000","last_fullsized":"2023-10-14T12:33:35.839488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:22:31.176353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025810+0000","last_change":"2023-10-14T12:33:35.869042+0000","last_active":"2023-10-14T12:33:38.025810+0000","last_peered":"2023-10-14T12:33:38.025810+0000","last_clean":"2023-10-14T12:33:38.025810+0000","last_became_active":"2023-10-14T12:33:35.866286+0000","last_became_peered":"2023-10-14T12:33:35.866286+0000","last_unstale":"2023-10-14T12:33:38.025810+0000","last_undegraded":"2023-10-14T12:33:38.025810+0000","last_fullsized":"2023-10-14T12:33:38.025810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838691+0000","last_change":"2023-10-14T12:33:30.830475+0000","last_active":"2023-10-14T12:33:35.838691+0000","last_peered":"2023-10-14T12:33:35.838691+0000","last_clean":"2023-10-14T12:33:35.838691+0000","last_became_active":"2023-10-14T12:33:30.830146+0000","last_became_peered":"2023-10-14T12:33:30.830146+0000","last_unstale":"2023-10-14T12:33:35.838691+0000","last_undegraded":"2023-10-14T12:33:35.838691+0000","last_fullsized":"2023-10-14T12:33:35.838691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:41.110080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854835+0000","last_change":"2023-10-14T12:33:31.820598+0000","last_active":"2023-10-14T12:33:35.854835+0000","last_peered":"2023-10-14T12:33:35.854835+0000","last_clean":"2023-10-14T12:33:35.854835+0000","last_became_active":"2023-10-14T12:33:31.820407+0000","last_became_peered":"2023-10-14T12:33:31.820407+0000","last_unstale":"2023-10-14T12:33:35.854835+0000","last_undegraded":"2023-10-14T12:33:35.854835+0000","last_fullsized":"2023-10-14T12:33:35.854835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.027136+0000","last_change":"2023-10-14T12:33:35.862298+0000","last_active":"2023-10-14T12:33:38.027136+0000","last_peered":"2023-10-14T12:33:38.027136+0000","last_clean":"2023-10-14T12:33:38.027136+0000","last_became_active":"2023-10-14T12:33:35.861343+0000","last_became_peered":"2023-10-14T12:33:35.861343+0000","last_unstale":"2023-10-14T12:33:38.027136+0000","last_undegraded":"2023-10-14T12:33:38.027136+0000","last_fullsized":"2023-10-14T12:33:38.027136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:08:15.108008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854868+0000","last_change":"2023-10-14T12:33:30.822607+0000","last_active":"2023-10-14T12:33:35.854868+0000","last_peered":"2023-10-14T12:33:35.854868+0000","last_clean":"2023-10-14T12:33:35.854868+0000","last_became_active":"2023-10-14T12:33:30.822335+0000","last_became_peered":"2023-10-14T12:33:30.822335+0000","last_unstale":"2023-10-14T12:33:35.854868+0000","last_undegraded":"2023-10-14T12:33:35.854868+0000","last_fullsized":"2023-10-14T12:33:35.854868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:53.843950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.842317+0000","last_change":"2023-10-14T12:33:31.819508+0000","last_active":"2023-10-14T12:33:35.842317+0000","last_peered":"2023-10-14T12:33:35.842317+0000","last_clean":"2023-10-14T12:33:35.842317+0000","last_became_active":"2023-10-14T12:33:31.819245+0000","last_became_peered":"2023-10-14T12:33:31.819245+0000","last_unstale":"2023-10-14T12:33:35.842317+0000","last_undegraded":"2023-10-14T12:33:35.842317+0000","last_fullsized":"2023-10-14T12:33:35.842317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846081+0000","last_change":"2023-10-14T12:33:35.852496+0000","last_active":"2023-10-14T12:33:36.846081+0000","last_peered":"2023-10-14T12:33:36.846081+0000","last_clean":"2023-10-14T12:33:36.846081+0000","last_became_active":"2023-10-14T12:33:35.852067+0000","last_became_peered":"2023-10-14T12:33:35.852067+0000","last_unstale":"2023-10-14T12:33:36.846081+0000","last_undegraded":"2023-10-14T12:33:36.846081+0000","last_fullsized":"2023-10-14T12:33:36.846081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:22.810399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846693+0000","last_change":"2023-10-14T12:33:30.823983+0000","last_active":"2023-10-14T12:33:35.846693+0000","last_peered":"2023-10-14T12:33:35.846693+0000","last_clean":"2023-10-14T12:33:35.846693+0000","last_became_active":"2023-10-14T12:33:30.823708+0000","last_became_peered":"2023-10-14T12:33:30.823708+0000","last_unstale":"2023-10-14T12:33:35.846693+0000","last_undegraded":"2023-10-14T12:33:35.846693+0000","last_fullsized":"2023-10-14T12:33:35.846693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:21.825878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.852271+0000","last_change":"2023-10-14T12:33:31.818663+0000","last_active":"2023-10-14T12:33:35.852271+0000","last_peered":"2023-10-14T12:33:35.852271+0000","last_clean":"2023-10-14T12:33:35.852271+0000","last_became_active":"2023-10-14T12:33:31.818315+0000","last_became_peered":"2023-10-14T12:33:31.818315+0000","last_unstale":"2023-10-14T12:33:35.852271+0000","last_undegraded":"2023-10-14T12:33:35.852271+0000","last_fullsized":"2023-10-14T12:33:35.852271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846628+0000","last_change":"2023-10-14T12:33:35.861468+0000","last_active":"2023-10-14T12:33:36.846628+0000","last_peered":"2023-10-14T12:33:36.846628+0000","last_clean":"2023-10-14T12:33:36.846628+0000","last_became_active":"2023-10-14T12:33:35.861024+0000","last_became_peered":"2023-10-14T12:33:35.861024+0000","last_unstale":"2023-10-14T12:33:36.846628+0000","last_undegraded":"2023-10-14T12:33:36.846628+0000","last_fullsized":"2023-10-14T12:33:36.846628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:32.157229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838156+0000","last_change":"2023-10-14T12:33:30.828550+0000","last_active":"2023-10-14T12:33:35.838156+0000","last_peered":"2023-10-14T12:33:35.838156+0000","last_clean":"2023-10-14T12:33:35.838156+0000","last_became_active":"2023-10-14T12:33:30.828270+0000","last_became_peered":"2023-10-14T12:33:30.828270+0000","last_unstale":"2023-10-14T12:33:35.838156+0000","last_undegraded":"2023-10-14T12:33:35.838156+0000","last_fullsized":"2023-10-14T12:33:35.838156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:25:49.417513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.840140+0000","last_change":"2023-10-14T12:33:31.827714+0000","last_active":"2023-10-14T12:33:35.840140+0000","last_peered":"2023-10-14T12:33:35.840140+0000","last_clean":"2023-10-14T12:33:35.840140+0000","last_became_active":"2023-10-14T12:33:31.827425+0000","last_became_peered":"2023-10-14T12:33:31.827425+0000","last_unstale":"2023-10-14T12:33:35.840140+0000","last_undegraded":"2023-10-14T12:33:35.840140+0000","last_fullsized":"2023-10-14T12:33:35.840140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:22.831522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.026298+0000","last_change":"2023-10-14T12:33:35.862529+0000","last_active":"2023-10-14T12:33:38.026298+0000","last_peered":"2023-10-14T12:33:38.026298+0000","last_clean":"2023-10-14T12:33:38.026298+0000","last_became_active":"2023-10-14T12:33:35.862060+0000","last_became_peered":"2023-10-14T12:33:35.862060+0000","last_unstale":"2023-10-14T12:33:38.026298+0000","last_undegraded":"2023-10-14T12:33:38.026298+0000","last_fullsized":"2023-10-14T12:33:38.026298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:07:19.668689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854468+0000","last_change":"2023-10-14T12:33:30.820328+0000","last_active":"2023-10-14T12:33:35.854468+0000","last_peered":"2023-10-14T12:33:35.854468+0000","last_clean":"2023-10-14T12:33:35.854468+0000","last_became_active":"2023-10-14T12:33:30.820025+0000","last_became_peered":"2023-10-14T12:33:30.820025+0000","last_unstale":"2023-10-14T12:33:35.854468+0000","last_undegraded":"2023-10-14T12:33:35.854468+0000","last_fullsized":"2023-10-14T12:33:35.854468+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:41.235095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844808+0000","last_change":"2023-10-14T12:33:31.818199+0000","last_active":"2023-10-14T12:33:35.844808+0000","last_peered":"2023-10-14T12:33:35.844808+0000","last_clean":"2023-10-14T12:33:35.844808+0000","last_became_active":"2023-10-14T12:33:31.817925+0000","last_became_peered":"2023-10-14T12:33:31.817925+0000","last_unstale":"2023-10-14T12:33:35.844808+0000","last_undegraded":"2023-10-14T12:33:35.844808+0000","last_fullsized":"2023-10-14T12:33:35.844808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846730+0000","last_change":"2023-10-14T12:33:35.861719+0000","last_active":"2023-10-14T12:33:36.846730+0000","last_peered":"2023-10-14T12:33:36.846730+0000","last_clean":"2023-10-14T12:33:36.846730+0000","last_became_active":"2023-10-14T12:33:35.861312+0000","last_became_peered":"2023-10-14T12:33:35.861312+0000","last_unstale":"2023-10-14T12:33:36.846730+0000","last_undegraded":"2023-10-14T12:33:36.846730+0000","last_fullsized":"2023-10-14T12:33:36.846730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:41:28.879987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.856801+0000","last_change":"2023-10-14T12:33:30.825142+0000","last_active":"2023-10-14T12:33:35.856801+0000","last_peered":"2023-10-14T12:33:35.856801+0000","last_clean":"2023-10-14T12:33:35.856801+0000","last_became_active":"2023-10-14T12:33:30.824853+0000","last_became_peered":"2023-10-14T12:33:30.824853+0000","last_unstale":"2023-10-14T12:33:35.856801+0000","last_undegraded":"2023-10-14T12:33:35.856801+0000","last_fullsized":"2023-10-14T12:33:35.856801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:48:12.306498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844382+0000","last_change":"2023-10-14T12:33:31.821965+0000","last_active":"2023-10-14T12:33:35.844382+0000","last_peered":"2023-10-14T12:33:35.844382+0000","last_clean":"2023-10-14T12:33:35.844382+0000","last_became_active":"2023-10-14T12:33:31.821689+0000","last_became_peered":"2023-10-14T12:33:31.821689+0000","last_unstale":"2023-10-14T12:33:35.844382+0000","last_undegraded":"2023-10-14T12:33:35.844382+0000","last_fullsized":"2023-10-14T12:33:35.844382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.846686+0000","last_change":"2023-10-14T12:33:35.864185+0000","last_active":"2023-10-14T12:33:36.846686+0000","last_peered":"2023-10-14T12:33:36.846686+0000","last_clean":"2023-10-14T12:33:36.846686+0000","last_became_active":"2023-10-14T12:33:35.863769+0000","last_became_peered":"2023-10-14T12:33:35.863769+0000","last_unstale":"2023-10-14T12:33:36.846686+0000","last_undegraded":"2023-10-14T12:33:36.846686+0000","last_fullsized":"2023-10-14T12:33:36.846686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:32.317702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.839226+0000","last_change":"2023-10-14T12:33:30.823464+0000","last_active":"2023-10-14T12:33:35.839226+0000","last_peered":"2023-10-14T12:33:35.839226+0000","last_clean":"2023-10-14T12:33:35.839226+0000","last_became_active":"2023-10-14T12:33:30.823177+0000","last_became_peered":"2023-10-14T12:33:30.823177+0000","last_unstale":"2023-10-14T12:33:35.839226+0000","last_undegraded":"2023-10-14T12:33:35.839226+0000","last_fullsized":"2023-10-14T12:33:35.839226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:46:29.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846843+0000","last_change":"2023-10-14T12:33:31.828060+0000","last_active":"2023-10-14T12:33:35.846843+0000","last_peered":"2023-10-14T12:33:35.846843+0000","last_clean":"2023-10-14T12:33:35.846843+0000","last_became_active":"2023-10-14T12:33:31.827687+0000","last_became_peered":"2023-10-14T12:33:31.827687+0000","last_unstale":"2023-10-14T12:33:35.846843+0000","last_undegraded":"2023-10-14T12:33:35.846843+0000","last_fullsized":"2023-10-14T12:33:35.846843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:56:42.115724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:36.840897+0000","last_change":"2023-10-14T12:33:35.865932+0000","last_active":"2023-10-14T12:33:36.840897+0000","last_peered":"2023-10-14T12:33:36.840897+0000","last_clean":"2023-10-14T12:33:36.840897+0000","last_became_active":"2023-10-14T12:33:35.865529+0000","last_became_peered":"2023-10-14T12:33:35.865529+0000","last_unstale":"2023-10-14T12:33:36.840897+0000","last_undegraded":"2023-10-14T12:33:36.840897+0000","last_fullsized":"2023-10-14T12:33:36.840897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.856213+0000","last_change":"2023-10-14T12:33:30.828503+0000","last_active":"2023-10-14T12:33:35.856213+0000","last_peered":"2023-10-14T12:33:35.856213+0000","last_clean":"2023-10-14T12:33:35.856213+0000","last_became_active":"2023-10-14T12:33:30.828211+0000","last_became_peered":"2023-10-14T12:33:30.828211+0000","last_unstale":"2023-10-14T12:33:35.856213+0000","last_undegraded":"2023-10-14T12:33:35.856213+0000","last_fullsized":"2023-10-14T12:33:35.856213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:21.825878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838912+0000","last_change":"2023-10-14T12:33:31.866962+0000","last_active":"2023-10-14T12:33:35.838912+0000","last_peered":"2023-10-14T12:33:35.838912+0000","last_clean":"2023-10-14T12:33:35.838912+0000","last_became_active":"2023-10-14T12:33:31.866696+0000","last_became_peered":"2023-10-14T12:33:31.866696+0000","last_unstale":"2023-10-14T12:33:35.838912+0000","last_undegraded":"2023-10-14T12:33:35.838912+0000","last_fullsized":"2023-10-14T12:33:35.838912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:10.562723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:38.025680+0000","last_change":"2023-10-14T12:33:35.866856+0000","last_active":"2023-10-14T12:33:38.025680+0000","last_peered":"2023-10-14T12:33:38.025680+0000","last_clean":"2023-10-14T12:33:38.025680+0000","last_became_active":"2023-10-14T12:33:35.865775+0000","last_became_peered":"2023-10-14T12:33:35.865775+0000","last_unstale":"2023-10-14T12:33:38.025680+0000","last_undegraded":"2023-10-14T12:33:38.025680+0000","last_fullsized":"2023-10-14T12:33:38.025680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:56:25.615864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854778+0000","last_change":"2023-10-14T12:33:30.824177+0000","last_active":"2023-10-14T12:33:35.854778+0000","last_peered":"2023-10-14T12:33:35.854778+0000","last_clean":"2023-10-14T12:33:35.854778+0000","last_became_active":"2023-10-14T12:33:30.823858+0000","last_became_peered":"2023-10-14T12:33:30.823858+0000","last_unstale":"2023-10-14T12:33:35.854778+0000","last_undegraded":"2023-10-14T12:33:35.854778+0000","last_fullsized":"2023-10-14T12:33:35.854778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:56:09.427953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847722+0000","last_change":"2023-10-14T12:33:31.867990+0000","last_active":"2023-10-14T12:33:35.847722+0000","last_peered":"2023-10-14T12:33:35.847722+0000","last_clean":"2023-10-14T12:33:35.847722+0000","last_became_active":"2023-10-14T12:33:31.867711+0000","last_became_peered":"2023-10-14T12:33:31.867711+0000","last_unstale":"2023-10-14T12:33:35.847722+0000","last_undegraded":"2023-10-14T12:33:35.847722+0000","last_fullsized":"2023-10-14T12:33:35.847722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:29:28.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-14T12:33:37.319023+0000","last_change":"2023-10-14T12:33:35.852643+0000","last_active":"2023-10-14T12:33:37.319023+0000","last_peered":"2023-10-14T12:33:37.319023+0000","last_clean":"2023-10-14T12:33:37.319023+0000","last_became_active":"2023-10-14T12:33:35.852237+0000","last_became_peered":"2023-10-14T12:33:35.852237+0000","last_unstale":"2023-10-14T12:33:37.319023+0000","last_undegraded":"2023-10-14T12:33:37.319023+0000","last_fullsized":"2023-10-14T12:33:37.319023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:34.829190+0000","last_clean_scrub_stamp":"2023-10-14T12:33:34.829190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:56.042282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.855802+0000","last_change":"2023-10-14T12:33:30.819872+0000","last_active":"2023-10-14T12:33:35.855802+0000","last_peered":"2023-10-14T12:33:35.855802+0000","last_clean":"2023-10-14T12:33:35.855802+0000","last_became_active":"2023-10-14T12:33:30.819553+0000","last_became_peered":"2023-10-14T12:33:30.819553+0000","last_unstale":"2023-10-14T12:33:35.855802+0000","last_undegraded":"2023-10-14T12:33:35.855802+0000","last_fullsized":"2023-10-14T12:33:35.855802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:29.791607+0000","last_clean_scrub_stamp":"2023-10-14T12:33:29.791607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:23.740058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.838889+0000","last_change":"2023-10-14T12:33:31.833122+0000","last_active":"2023-10-14T12:33:35.838889+0000","last_peered":"2023-10-14T12:33:35.838889+0000","last_clean":"2023-10-14T12:33:35.838889+0000","last_became_active":"2023-10-14T12:33:31.832825+0000","last_became_peered":"2023-10-14T12:33:31.832825+0000","last_unstale":"2023-10-14T12:33:35.838889+0000","last_undegraded":"2023-10-14T12:33:35.838889+0000","last_fullsized":"2023-10-14T12:33:35.838889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:43:13.669993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847506+0000","last_change":"2023-10-14T12:33:31.822399+0000","last_active":"2023-10-14T12:33:35.847506+0000","last_peered":"2023-10-14T12:33:35.847506+0000","last_clean":"2023-10-14T12:33:35.847506+0000","last_became_active":"2023-10-14T12:33:31.822073+0000","last_became_peered":"2023-10-14T12:33:31.822073+0000","last_unstale":"2023-10-14T12:33:35.847506+0000","last_undegraded":"2023-10-14T12:33:35.847506+0000","last_fullsized":"2023-10-14T12:33:35.847506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854508+0000","last_change":"2023-10-14T12:33:31.859894+0000","last_active":"2023-10-14T12:33:35.854508+0000","last_peered":"2023-10-14T12:33:35.854508+0000","last_clean":"2023-10-14T12:33:35.854508+0000","last_became_active":"2023-10-14T12:33:31.859679+0000","last_became_peered":"2023-10-14T12:33:31.859679+0000","last_unstale":"2023-10-14T12:33:35.854508+0000","last_undegraded":"2023-10-14T12:33:35.854508+0000","last_fullsized":"2023-10-14T12:33:35.854508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:56:34.169023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847296+0000","last_change":"2023-10-14T12:33:31.867239+0000","last_active":"2023-10-14T12:33:35.847296+0000","last_peered":"2023-10-14T12:33:35.847296+0000","last_clean":"2023-10-14T12:33:35.847296+0000","last_became_active":"2023-10-14T12:33:31.866961+0000","last_became_peered":"2023-10-14T12:33:31.866961+0000","last_unstale":"2023-10-14T12:33:35.847296+0000","last_undegraded":"2023-10-14T12:33:35.847296+0000","last_fullsized":"2023-10-14T12:33:35.847296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851705+0000","last_change":"2023-10-14T12:33:31.822450+0000","last_active":"2023-10-14T12:33:35.851705+0000","last_peered":"2023-10-14T12:33:35.851705+0000","last_clean":"2023-10-14T12:33:35.851705+0000","last_became_active":"2023-10-14T12:33:31.822248+0000","last_became_peered":"2023-10-14T12:33:31.822248+0000","last_unstale":"2023-10-14T12:33:35.851705+0000","last_undegraded":"2023-10-14T12:33:35.851705+0000","last_fullsized":"2023-10-14T12:33:35.851705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:04:49.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.844108+0000","last_change":"2023-10-14T12:33:31.829535+0000","last_active":"2023-10-14T12:33:35.844108+0000","last_peered":"2023-10-14T12:33:35.844108+0000","last_clean":"2023-10-14T12:33:35.844108+0000","last_became_active":"2023-10-14T12:33:31.829266+0000","last_became_peered":"2023-10-14T12:33:31.829266+0000","last_unstale":"2023-10-14T12:33:35.844108+0000","last_undegraded":"2023-10-14T12:33:35.844108+0000","last_fullsized":"2023-10-14T12:33:35.844108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:53:35.115089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.854698+0000","last_change":"2023-10-14T12:33:31.817303+0000","last_active":"2023-10-14T12:33:35.854698+0000","last_peered":"2023-10-14T12:33:35.854698+0000","last_clean":"2023-10-14T12:33:35.854698+0000","last_became_active":"2023-10-14T12:33:31.817008+0000","last_became_peered":"2023-10-14T12:33:31.817008+0000","last_unstale":"2023-10-14T12:33:35.854698+0000","last_undegraded":"2023-10-14T12:33:35.854698+0000","last_fullsized":"2023-10-14T12:33:35.854698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.846113+0000","last_change":"2023-10-14T12:33:31.821532+0000","last_active":"2023-10-14T12:33:35.846113+0000","last_peered":"2023-10-14T12:33:35.846113+0000","last_clean":"2023-10-14T12:33:35.846113+0000","last_became_active":"2023-10-14T12:33:31.821205+0000","last_became_peered":"2023-10-14T12:33:31.821205+0000","last_unstale":"2023-10-14T12:33:35.846113+0000","last_undegraded":"2023-10-14T12:33:35.846113+0000","last_fullsized":"2023-10-14T12:33:35.846113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:45:30.528537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.842791+0000","last_change":"2023-10-14T12:33:31.832580+0000","last_active":"2023-10-14T12:33:35.842791+0000","last_peered":"2023-10-14T12:33:35.842791+0000","last_clean":"2023-10-14T12:33:35.842791+0000","last_became_active":"2023-10-14T12:33:31.832277+0000","last_became_peered":"2023-10-14T12:33:31.832277+0000","last_unstale":"2023-10-14T12:33:35.842791+0000","last_undegraded":"2023-10-14T12:33:35.842791+0000","last_fullsized":"2023-10-14T12:33:35.842791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:07:57.894362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.848235+0000","last_change":"2023-10-14T12:33:31.865900+0000","last_active":"2023-10-14T12:33:35.848235+0000","last_peered":"2023-10-14T12:33:35.848235+0000","last_clean":"2023-10-14T12:33:35.848235+0000","last_became_active":"2023-10-14T12:33:31.865207+0000","last_became_peered":"2023-10-14T12:33:31.865207+0000","last_unstale":"2023-10-14T12:33:35.848235+0000","last_undegraded":"2023-10-14T12:33:35.848235+0000","last_fullsized":"2023-10-14T12:33:35.848235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:25.595186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847269+0000","last_change":"2023-10-14T12:33:31.832616+0000","last_active":"2023-10-14T12:33:35.847269+0000","last_peered":"2023-10-14T12:33:35.847269+0000","last_clean":"2023-10-14T12:33:35.847269+0000","last_became_active":"2023-10-14T12:33:31.832363+0000","last_became_peered":"2023-10-14T12:33:31.832363+0000","last_unstale":"2023-10-14T12:33:35.847269+0000","last_undegraded":"2023-10-14T12:33:35.847269+0000","last_fullsized":"2023-10-14T12:33:35.847269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:57:28.285763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847336+0000","last_change":"2023-10-14T12:33:31.866907+0000","last_active":"2023-10-14T12:33:35.847336+0000","last_peered":"2023-10-14T12:33:35.847336+0000","last_clean":"2023-10-14T12:33:35.847336+0000","last_became_active":"2023-10-14T12:33:31.866600+0000","last_became_peered":"2023-10-14T12:33:31.866600+0000","last_unstale":"2023-10-14T12:33:35.847336+0000","last_undegraded":"2023-10-14T12:33:35.847336+0000","last_fullsized":"2023-10-14T12:33:35.847336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:37.287724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.851789+0000","last_change":"2023-10-14T12:33:31.822750+0000","last_active":"2023-10-14T12:33:35.851789+0000","last_peered":"2023-10-14T12:33:35.851789+0000","last_clean":"2023-10-14T12:33:35.851789+0000","last_became_active":"2023-10-14T12:33:31.822413+0000","last_became_peered":"2023-10-14T12:33:31.822413+0000","last_unstale":"2023-10-14T12:33:35.851789+0000","last_undegraded":"2023-10-14T12:33:35.851789+0000","last_fullsized":"2023-10-14T12:33:35.851789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:18.923716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-14T12:33:35.847017+0000","last_change":"2023-10-14T12:33:31.831194+0000","last_active":"2023-10-14T12:33:35.847017+0000","last_peered":"2023-10-14T12:33:35.847017+0000","last_clean":"2023-10-14T12:33:35.847017+0000","last_became_active":"2023-10-14T12:33:31.830888+0000","last_became_peered":"2023-10-14T12:33:31.830888+0000","last_unstale":"2023-10-14T12:33:35.847017+0000","last_undegraded":"2023-10-14T12:33:35.847017+0000","last_fullsized":"2023-10-14T12:33:35.847017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:30.797251+0000","last_clean_scrub_stamp":"2023-10-14T12:33:30.797251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:18.778460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:33:54.351 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T12:33:54.351 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T12:33:54.351 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T12:33:54.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T12:33:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.501+0000 7fecd6b8a700 1 Processor -- start 2023-10-14T12:33:54.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.501+0000 7fecd6b8a700 1 -- start start 2023-10-14T12:33:54.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7fecd6b8a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fecd0140800 0x7fecd00b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7fecd6b8a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecd00b5770 0x7fecd0140be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7fecd6b8a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd00b4da0 con 0x7fecd0141120 2023-10-14T12:33:54.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7fecd6b8a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd0141c10 con 0x7fecd00b5770 2023-10-14T12:33:54.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7fecd6b8a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00b4820 con 0x7fecd0140800 2023-10-14T12:33:54.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7feccffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecd00b5770 0x7fecd0140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7feccffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecd00b5770 0x7fecd0140be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47010/0 (socket says 172.21.15.72:47010) 2023-10-14T12:33:54.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7feccffff700 1 -- 172.21.15.72:0/584737614 learned_addr learned my addr 172.21.15.72:0/584737614 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:54.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7fecd4926700 1 --2- 172.21.15.72:0/584737614 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fecd0140800 0x7fecd00b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7feccffff700 1 -- 172.21.15.72:0/584737614 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fecd0140800 msgr2=0x7fecd00b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:54.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.502+0000 7feccffff700 1 --2- 172.21.15.72:0/584737614 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fecd0140800 0x7fecd00b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7feccffff700 1 -- 172.21.15.72:0/584737614 >> v1:172.21.15.123:6789/0 conn(0x7fecd0141120 legacy=0x7fecd006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7feccffff700 1 -- 172.21.15.72:0/584737614 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0141650 con 0x7fecd00b5770 2023-10-14T12:33:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7feccffff700 1 --2- 172.21.15.72:0/584737614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd00b5770 0x7fecd0140be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0098f0 tx=0x7fecbc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2696c2b84d391c11 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7feccf7fe700 1 -- 172.21.15.72:0/584737614 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc011830 con 0x7fecd00b5770 2023-10-14T12:33:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7feccf7fe700 1 -- 172.21.15.72:0/584737614 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc011990 con 0x7fecd00b5770 2023-10-14T12:33:54.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7feccf7fe700 1 -- 172.21.15.72:0/584737614 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc011d20 con 0x7fecd00b5770 2023-10-14T12:33:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7fecd6b8a700 1 -- 172.21.15.72:0/584737614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd00b5770 msgr2=0x7fecd0140be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7fecd6b8a700 1 --2- 172.21.15.72:0/584737614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd00b5770 0x7fecd0140be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0098f0 tx=0x7fecbc009c00 comp rx=0 tx=0).stop 2023-10-14T12:33:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7fecd6b8a700 1 -- 172.21.15.72:0/584737614 shutdown_connections 2023-10-14T12:33:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7fecd6b8a700 1 --2- 172.21.15.72:0/584737614 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fecd0140800 0x7fecd00b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7fecd6b8a700 1 --2- 172.21.15.72:0/584737614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd00b5770 0x7fecd0140be0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7fecd6b8a700 1 -- 172.21.15.72:0/584737614 >> 172.21.15.72:0/584737614 conn(0x7fecd00b1620 msgr2=0x7fecd00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7fecd6b8a700 1 -- 172.21.15.72:0/584737614 shutdown_connections 2023-10-14T12:33:54.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.503+0000 7fecd6b8a700 1 -- 172.21.15.72:0/584737614 wait complete. 2023-10-14T12:33:54.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.505+0000 7fecd6b8a700 1 Processor -- start 2023-10-14T12:33:54.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.505+0000 7fecd6b8a700 1 -- start start 2023-10-14T12:33:54.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.505+0000 7fecd6b8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd0140800 0x7fecd0156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.505+0000 7fecd6b8a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecd0141120 0x7fecd0159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.505+0000 7fecd6b8a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fecd0157880 0x7fecd0133ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.505+0000 7fecd6b8a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd01582d0 con 0x7fecd0140800 2023-10-14T12:33:54.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.505+0000 7fecd6b8a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd01585b0 con 0x7fecd0141120 2023-10-14T12:33:54.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.505+0000 7fecd6b8a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0158890 con 0x7fecd0157880 2023-10-14T12:33:54.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd4926700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd0140800 0x7fecd0156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd4926700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd0140800 0x7fecd0156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47012/0 (socket says 172.21.15.72:47012) 2023-10-14T12:33:54.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd4926700 1 -- 172.21.15.72:0/3634386381 learned_addr learned my addr 172.21.15.72:0/3634386381 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:54.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd4926700 1 -- 172.21.15.72:0/3634386381 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fecd0157880 msgr2=0x7fecd0133ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd4926700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fecd0157880 0x7fecd0133ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7feccffff700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecd0141120 0x7fecd0159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd4926700 1 -- 172.21.15.72:0/3634386381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecd0141120 msgr2=0x7fecd0159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd4926700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecd0141120 0x7fecd0159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd4926700 1 -- 172.21.15.72:0/3634386381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc009550 con 0x7fecd0140800 2023-10-14T12:33:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd4926700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd0140800 0x7fecd0156cd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e9b0 tx=0x7fecc400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7feccd7fa700 1 -- 172.21.15.72:0/3634386381 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4009710 con 0x7fecd0140800 2023-10-14T12:33:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7feccd7fa700 1 -- 172.21.15.72:0/3634386381 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc400c850 con 0x7fecd0140800 2023-10-14T12:33:54.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd0158b70 con 0x7fecd0140800 2023-10-14T12:33:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7feccd7fa700 1 -- 172.21.15.72:0/3634386381 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc400cbc0 con 0x7fecd0140800 2023-10-14T12:33:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.506+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd0157210 con 0x7fecd0140800 2023-10-14T12:33:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.507+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd01591c0 con 0x7fecd0140800 2023-10-14T12:33:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.507+0000 7feccd7fa700 1 -- 172.21.15.72:0/3634386381 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fecc400cd20 con 0x7fecd0140800 2023-10-14T12:33:54.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.508+0000 7feccd7fa700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fecb406af00 0x7fecb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.508+0000 7feccd7fa700 1 -- 172.21.15.72:0/3634386381 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fecc40899c0 con 0x7fecd0140800 2023-10-14T12:33:54.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.508+0000 7feccffff700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fecb406af00 0x7fecb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.508+0000 7feccffff700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fecb406af00 0x7fecb406d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fecd00ae970 tx=0x7fecbc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:54.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.512+0000 7feccd7fa700 1 -- 172.21.15.72:0/3634386381 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fecc4054780 con 0x7fecd0140800 2023-10-14T12:33:54.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.748+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fecd004ebb0 con 0x7fecd0140800 2023-10-14T12:33:54.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.748+0000 7feccd7fa700 1 -- 172.21.15.72:0/3634386381 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fecc4021040 con 0x7fecd0140800 2023-10-14T12:33:54.750 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:54.751 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T12:33:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fecb406af00 msgr2=0x7fecb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fecb406af00 0x7fecb406d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fecd00ae970 tx=0x7fecbc008030 comp rx=0 tx=0).stop 2023-10-14T12:33:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd0140800 msgr2=0x7fecd0156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd0140800 0x7fecd0156cd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e9b0 tx=0x7fecc400ed70 comp rx=0 tx=0).stop 2023-10-14T12:33:54.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 shutdown_connections 2023-10-14T12:33:54.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fecb406af00 0x7fecb406d3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fecd0157880 0x7fecd0133ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd0140800 0x7fecd0156cd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 --2- 172.21.15.72:0/3634386381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fecd0141120 0x7fecd0159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 >> 172.21.15.72:0/3634386381 conn(0x7fecd00b1620 msgr2=0x7fecd006f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:54.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 shutdown_connections 2023-10-14T12:33:54.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.750+0000 7fecd6b8a700 1 -- 172.21.15.72:0/3634386381 wait complete. 2023-10-14T12:33:54.764 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T12:33:54.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.885+0000 7f363b12a700 1 Processor -- start 2023-10-14T12:33:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.885+0000 7f363b12a700 1 -- start start 2023-10-14T12:33:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f363b12a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36340ce4e0 0x7f36340cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f363b12a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36340cef20 0x7f36340cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f363b12a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36340cc060 con 0x7f36341523b0 2023-10-14T12:33:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f363b12a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36340cf8d0 con 0x7f36340ce4e0 2023-10-14T12:33:54.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f363b12a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36340cda20 con 0x7f36340cef20 2023-10-14T12:33:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f3633fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36340ce4e0 0x7f36340cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f3638ec6700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f36341523b0 0x7f363415c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53320/0 (socket says 172.21.15.72:53320) 2023-10-14T12:33:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f3638ec6700 1 -- 172.21.15.72:0/2818421980 learned_addr learned my addr 172.21.15.72:0/2818421980 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f36396c7700 1 --2- 172.21.15.72:0/2818421980 >> v2:172.21.15.123:3300/0 conn(0x7f36340cef20 0x7f36340cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f3633fff700 1 -- 172.21.15.72:0/2818421980 >> v2:172.21.15.123:3300/0 conn(0x7f36340cef20 msgr2=0x7f36340cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f3633fff700 1 --2- 172.21.15.72:0/2818421980 >> v2:172.21.15.123:3300/0 conn(0x7f36340cef20 0x7f36340cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f3633fff700 1 -- 172.21.15.72:0/2818421980 >> v1:172.21.15.72:6789/0 conn(0x7f36341523b0 legacy=0x7f363415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f36337fe700 1 -- 172.21.15.72:0/2818421980 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167739855 0 0) 0x7f36340cc060 con 0x7f36341523b0 2023-10-14T12:33:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f3633fff700 1 -- 172.21.15.72:0/2818421980 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340cdd00 con 0x7f36340ce4e0 2023-10-14T12:33:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.886+0000 7f3633fff700 1 --2- 172.21.15.72:0/2818421980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340ce4e0 0x7f36340cb9a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f36340ccf10 tx=0x7f3620009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e082b617ccb5e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f36337fe700 1 -- 172.21.15.72:0/2818421980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620011830 con 0x7f36340ce4e0 2023-10-14T12:33:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f36337fe700 1 -- 172.21.15.72:0/2818421980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3620011990 con 0x7f36340ce4e0 2023-10-14T12:33:54.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f36337fe700 1 -- 172.21.15.72:0/2818421980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620011d20 con 0x7f36340ce4e0 2023-10-14T12:33:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f363b12a700 1 -- 172.21.15.72:0/2818421980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340ce4e0 msgr2=0x7f36340cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f363b12a700 1 --2- 172.21.15.72:0/2818421980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340ce4e0 0x7f36340cb9a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f36340ccf10 tx=0x7f3620009b20 comp rx=0 tx=0).stop 2023-10-14T12:33:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f363b12a700 1 -- 172.21.15.72:0/2818421980 shutdown_connections 2023-10-14T12:33:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f363b12a700 1 --2- 172.21.15.72:0/2818421980 >> v2:172.21.15.123:3300/0 conn(0x7f36340cef20 0x7f36340cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f363b12a700 1 --2- 172.21.15.72:0/2818421980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340ce4e0 0x7f36340cb9a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f363b12a700 1 -- 172.21.15.72:0/2818421980 >> 172.21.15.72:0/2818421980 conn(0x7f3634070460 msgr2=0x7f3634070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f363b12a700 1 -- 172.21.15.72:0/2818421980 shutdown_connections 2023-10-14T12:33:54.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.887+0000 7f363b12a700 1 -- 172.21.15.72:0/2818421980 wait complete. 2023-10-14T12:33:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.888+0000 7f363b12a700 1 Processor -- start 2023-10-14T12:33:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.888+0000 7f363b12a700 1 -- start start 2023-10-14T12:33:54.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.889+0000 7f363b12a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36340ce4e0 0x7f3634150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.889+0000 7f363b12a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340cef20 0x7f36340c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.889+0000 7f363b12a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36341523b0 0x7f36340c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.889+0000 7f363b12a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36341512e0 con 0x7f36340cef20 2023-10-14T12:33:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.889+0000 7f363b12a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363415d420 con 0x7f36340ce4e0 2023-10-14T12:33:54.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.889+0000 7f363b12a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363415d700 con 0x7f36341523b0 2023-10-14T12:33:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.889+0000 7f3633fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340cef20 0x7f36340c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.889+0000 7f3633fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340cef20 0x7f36340c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47028/0 (socket says 172.21.15.72:47028) 2023-10-14T12:33:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.889+0000 7f3633fff700 1 -- 172.21.15.72:0/332489508 learned_addr learned my addr 172.21.15.72:0/332489508 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f3638ec6700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36340ce4e0 0x7f3634150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f36396c7700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36341523b0 0x7f36340c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f3633fff700 1 -- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36341523b0 msgr2=0x7f36340c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f3633fff700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36341523b0 0x7f36340c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f3633fff700 1 -- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36340ce4e0 msgr2=0x7f3634150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f3633fff700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36340ce4e0 0x7f3634150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:54.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f3633fff700 1 -- 172.21.15.72:0/332489508 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36200094a0 con 0x7f36340cef20 2023-10-14T12:33:54.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f3638ec6700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36340ce4e0 0x7f3634150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:54.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f36396c7700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36341523b0 0x7f36340c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:54.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f3633fff700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340cef20 0x7f36340c50e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3620013000 tx=0x7f3620004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:54.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f36317fa700 1 -- 172.21.15.72:0/332489508 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200038a0 con 0x7f36340cef20 2023-10-14T12:33:54.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f36317fa700 1 -- 172.21.15.72:0/332489508 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362001f070 con 0x7f36340cef20 2023-10-14T12:33:54.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3634150db0 con 0x7f36340cef20 2023-10-14T12:33:54.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f36317fa700 1 -- 172.21.15.72:0/332489508 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620003c20 con 0x7f36340cef20 2023-10-14T12:33:54.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.890+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363415f870 con 0x7f36340cef20 2023-10-14T12:33:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.891+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363404ebb0 con 0x7f36340cef20 2023-10-14T12:33:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.891+0000 7f36317fa700 1 -- 172.21.15.72:0/332489508 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f362001a430 con 0x7f36340cef20 2023-10-14T12:33:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.892+0000 7f36317fa700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f361806af00 0x7f361806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.892+0000 7f36317fa700 1 -- 172.21.15.72:0/332489508 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3620021070 con 0x7f36340cef20 2023-10-14T12:33:54.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.892+0000 7f3638ec6700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f361806af00 0x7f361806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.892+0000 7f3638ec6700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f361806af00 0x7f361806d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3628000f60 tx=0x7f3628009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:54.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:54.896+0000 7f36317fa700 1 -- 172.21.15.72:0/332489508 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36200560a0 con 0x7f36340cef20 2023-10-14T12:33:55.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.086+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f363415d840 con 0x7f36340cef20 2023-10-14T12:33:55.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.088+0000 7f36317fa700 1 -- 172.21.15.72:0/332489508 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f36200596c0 con 0x7f36340cef20 2023-10-14T12:33:55.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:55.090 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:55.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f361806af00 msgr2=0x7f361806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f361806af00 0x7f361806d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3628000f60 tx=0x7f3628009040 comp rx=0 tx=0).stop 2023-10-14T12:33:55.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340cef20 msgr2=0x7f36340c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340cef20 0x7f36340c50e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3620013000 tx=0x7f3620004750 comp rx=0 tx=0).stop 2023-10-14T12:33:55.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 shutdown_connections 2023-10-14T12:33:55.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f361806af00 0x7f361806d3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f36341523b0 0x7f36340c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36340ce4e0 0x7f3634150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 --2- 172.21.15.72:0/332489508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36340cef20 0x7f36340c50e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 >> 172.21.15.72:0/332489508 conn(0x7f3634070460 msgr2=0x7f3634159600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:55.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 shutdown_connections 2023-10-14T12:33:55.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.090+0000 7f363b12a700 1 -- 172.21.15.72:0/332489508 wait complete. 2023-10-14T12:33:55.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:33:55.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:33:55.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.228+0000 7fd4f6747700 1 Processor -- start 2023-10-14T12:33:55.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.228+0000 7fd4f6747700 1 -- start start 2023-10-14T12:33:55.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.228+0000 7fd4f6747700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4f006b370 0x7fd4f015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.228+0000 7fd4f6747700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4f006a820 0x7fd4f006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.228+0000 7fd4f6747700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f0161360 con 0x7fd4f00cdd30 2023-10-14T12:33:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.228+0000 7fd4f6747700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f006b750 con 0x7fd4f006a820 2023-10-14T12:33:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.228+0000 7fd4f6747700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f015e300 con 0x7fd4f006b370 2023-10-14T12:33:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4ef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4f006a820 0x7fd4f006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4ef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4f006a820 0x7fd4f006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47034/0 (socket says 172.21.15.72:47034) 2023-10-14T12:33:55.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4f4ce4700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd4f00cdd30 0x7fd4f01617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53338/0 (socket says 172.21.15.72:53338) 2023-10-14T12:33:55.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4ef7fe700 1 -- 172.21.15.72:0/3294810332 learned_addr learned my addr 172.21.15.72:0/3294810332 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:55.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4effff700 1 --2- 172.21.15.72:0/3294810332 >> v2:172.21.15.123:3300/0 conn(0x7fd4f006b370 0x7fd4f015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4ef7fe700 1 -- 172.21.15.72:0/3294810332 >> v2:172.21.15.123:3300/0 conn(0x7fd4f006b370 msgr2=0x7fd4f015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4ef7fe700 1 --2- 172.21.15.72:0/3294810332 >> v2:172.21.15.123:3300/0 conn(0x7fd4f006b370 0x7fd4f015dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4ef7fe700 1 -- 172.21.15.72:0/3294810332 >> v1:172.21.15.72:6789/0 conn(0x7fd4f00cdd30 legacy=0x7fd4f01617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4ef7fe700 1 -- 172.21.15.72:0/3294810332 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f015e5e0 con 0x7fd4f006a820 2023-10-14T12:33:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4eeffd700 1 -- 172.21.15.72:0/3294810332 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777051505 0 0) 0x7fd4f0161360 con 0x7fd4f00cdd30 2023-10-14T12:33:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4ef7fe700 1 --2- 172.21.15.72:0/3294810332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 0x7fd4f006d5b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd4f006d450 tx=0x7fd4e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b522bd87a309e6a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4eeffd700 1 -- 172.21.15.72:0/3294810332 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4011830 con 0x7fd4f006a820 2023-10-14T12:33:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4eeffd700 1 -- 172.21.15.72:0/3294810332 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e4011990 con 0x7fd4f006a820 2023-10-14T12:33:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.229+0000 7fd4eeffd700 1 -- 172.21.15.72:0/3294810332 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4011d20 con 0x7fd4f006a820 2023-10-14T12:33:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.230+0000 7fd4f6747700 1 -- 172.21.15.72:0/3294810332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 msgr2=0x7fd4f006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.230+0000 7fd4f6747700 1 --2- 172.21.15.72:0/3294810332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 0x7fd4f006d5b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd4f006d450 tx=0x7fd4e4009bd0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.230+0000 7fd4f6747700 1 -- 172.21.15.72:0/3294810332 shutdown_connections 2023-10-14T12:33:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.230+0000 7fd4f6747700 1 --2- 172.21.15.72:0/3294810332 >> v2:172.21.15.123:3300/0 conn(0x7fd4f006b370 0x7fd4f015dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.230+0000 7fd4f6747700 1 --2- 172.21.15.72:0/3294810332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 0x7fd4f006d5b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.230+0000 7fd4f6747700 1 -- 172.21.15.72:0/3294810332 >> 172.21.15.72:0/3294810332 conn(0x7fd4f00ccbe0 msgr2=0x7fd4f00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.230+0000 7fd4f6747700 1 -- 172.21.15.72:0/3294810332 shutdown_connections 2023-10-14T12:33:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.230+0000 7fd4f6747700 1 -- 172.21.15.72:0/3294810332 wait complete. 2023-10-14T12:33:55.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.231+0000 7fd4f6747700 1 Processor -- start 2023-10-14T12:33:55.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.231+0000 7fd4f6747700 1 -- start start 2023-10-14T12:33:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4f6747700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 0x7fd4f00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4f6747700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4f006b370 0x7fd4f00b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4f6747700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4f00cdd30 0x7fd4f015ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4f6747700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f00b5f10 con 0x7fd4f006a820 2023-10-14T12:33:55.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4f6747700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f0155b10 con 0x7fd4f006b370 2023-10-14T12:33:55.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4f6747700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f00acaf0 con 0x7fd4f00cdd30 2023-10-14T12:33:55.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 0x7fd4f00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 0x7fd4f00b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47040/0 (socket says 172.21.15.72:47040) 2023-10-14T12:33:55.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4effff700 1 -- 172.21.15.72:0/2085579764 learned_addr learned my addr 172.21.15.72:0/2085579764 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:55.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4ef7fe700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4f006b370 0x7fd4f00b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4f4ce4700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4f00cdd30 0x7fd4f015ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4effff700 1 -- 172.21.15.72:0/2085579764 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4f00cdd30 msgr2=0x7fd4f015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4effff700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4f00cdd30 0x7fd4f015ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4effff700 1 -- 172.21.15.72:0/2085579764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4f006b370 msgr2=0x7fd4f00b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4effff700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4f006b370 0x7fd4f00b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4effff700 1 -- 172.21.15.72:0/2085579764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4009550 con 0x7fd4f006a820 2023-10-14T12:33:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.232+0000 7fd4ef7fe700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4f006b370 0x7fd4f00b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.233+0000 7fd4effff700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 0x7fd4f00b4eb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000e870 tx=0x7fd4e000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.233+0000 7fd4ecff9700 1 -- 172.21.15.72:0/2085579764 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0009590 con 0x7fd4f006a820 2023-10-14T12:33:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.233+0000 7fd4ecff9700 1 -- 172.21.15.72:0/2085579764 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e000ee70 con 0x7fd4f006a820 2023-10-14T12:33:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.233+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f00b53f0 con 0x7fd4f006a820 2023-10-14T12:33:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.233+0000 7fd4ecff9700 1 -- 172.21.15.72:0/2085579764 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e000ca50 con 0x7fd4f006a820 2023-10-14T12:33:55.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.233+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f00b5950 con 0x7fd4f006a820 2023-10-14T12:33:55.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.234+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f0072d10 con 0x7fd4f006a820 2023-10-14T12:33:55.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.234+0000 7fd4ecff9700 1 -- 172.21.15.72:0/2085579764 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd4e000cbb0 con 0x7fd4f006a820 2023-10-14T12:33:55.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.235+0000 7fd4ecff9700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd4dc06af00 0x7fd4dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.235+0000 7fd4ef7fe700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd4dc06af00 0x7fd4dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.235+0000 7fd4ecff9700 1 -- 172.21.15.72:0/2085579764 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4e00898f0 con 0x7fd4f006a820 2023-10-14T12:33:55.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.235+0000 7fd4ef7fe700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd4dc06af00 0x7fd4dc06d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4f006d450 tx=0x7fd4e4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:55.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.239+0000 7fd4ecff9700 1 -- 172.21.15.72:0/2085579764 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4e0054610 con 0x7fd4f006a820 2023-10-14T12:33:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.430+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4f00ac8c0 con 0x7fd4f006a820 2023-10-14T12:33:55.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.430+0000 7fd4ecff9700 1 -- 172.21.15.72:0/2085579764 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4f00ac8c0 con 0x7fd4f006a820 2023-10-14T12:33:55.432 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:33:55.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.432+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd4dc06af00 msgr2=0x7fd4dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.432+0000 7fd4f6747700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd4dc06af00 0x7fd4dc06d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4f006d450 tx=0x7fd4e4008030 comp rx=0 tx=0).stop 2023-10-14T12:33:55.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.432+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 msgr2=0x7fd4f00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.432+0000 7fd4f6747700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 0x7fd4f00b4eb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000e870 tx=0x7fd4e000ec30 comp rx=0 tx=0).stop 2023-10-14T12:33:55.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.432+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 shutdown_connections 2023-10-14T12:33:55.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.432+0000 7fd4f6747700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd4dc06af00 0x7fd4dc06d3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.432+0000 7fd4f6747700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd4f00cdd30 0x7fd4f015ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.432+0000 7fd4f6747700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4f006a820 0x7fd4f00b4eb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.433+0000 7fd4f6747700 1 --2- 172.21.15.72:0/2085579764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4f006b370 0x7fd4f00b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.433+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 >> 172.21.15.72:0/2085579764 conn(0x7fd4f00ccbe0 msgr2=0x7fd4f00b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:55.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.433+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 shutdown_connections 2023-10-14T12:33:55.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.433+0000 7fd4f6747700 1 -- 172.21.15.72:0/2085579764 wait complete. 2023-10-14T12:33:55.446 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:33:55.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.571+0000 7f1b8ec21700 1 Processor -- start 2023-10-14T12:33:55.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.571+0000 7f1b8ec21700 1 -- start start 2023-10-14T12:33:55.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b8ec21700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b880b33f0 0x7f1b8806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b8ec21700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b880cd770 0x7f1b880b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b8ec21700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b88070620 con 0x7f1b8815b4e0 2023-10-14T12:33:55.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b8ec21700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b88070900 con 0x7f1b880b33f0 2023-10-14T12:33:55.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b8ec21700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88070be0 con 0x7f1b880cd770 2023-10-14T12:33:55.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b8c9bd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1b8815b4e0 0x7f1b880b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53348/0 (socket says 172.21.15.72:53348) 2023-10-14T12:33:55.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b8c9bd700 1 -- 172.21.15.72:0/2592269245 learned_addr learned my addr 172.21.15.72:0/2592269245 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:55.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049251725 0 0) 0x7f1b88070620 con 0x7f1b8815b4e0 2023-10-14T12:33:55.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b780035b0 con 0x7f1b8815b4e0 2023-10-14T12:33:55.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b8d1be700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b880cd770 0x7f1b880b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b87fff700 1 --2- 172.21.15.72:0/2592269245 >> v2:172.21.15.123:3300/0 conn(0x7f1b880b33f0 0x7f1b8806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1319960562 0 0) 0x7f1b780035b0 con 0x7f1b8815b4e0 2023-10-14T12:33:55.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b880cd770 msgr2=0x7f1b880b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:55.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b880cd770 0x7f1b880b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 >> v2:172.21.15.123:3300/0 conn(0x7f1b880b33f0 msgr2=0x7f1b8806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:55.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 --2- 172.21.15.72:0/2592269245 >> v2:172.21.15.123:3300/0 conn(0x7f1b880b33f0 0x7f1b8806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88070ec0 con 0x7f1b8815b4e0 2023-10-14T12:33:55.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b8d1be700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b880cd770 0x7f1b880b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:55.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f1b7c001670 con 0x7f1b8815b4e0 2023-10-14T12:33:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 >> v1:172.21.15.72:6789/0 conn(0x7f1b8815b4e0 legacy=0x7f1b880b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b78003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.572+0000 7f1b877fe700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b880cd770 0x7f1b78004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b877fe700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b78004d90 0x7f1b78005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88070900 con 0x7f1b78003a00 2023-10-14T12:33:55.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88070be0 con 0x7f1b78004d90 2023-10-14T12:33:55.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7800bac0 con 0x7f1b880cd770 2023-10-14T12:33:55.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b87fff700 1 --2- 172.21.15.72:0/2592269245 >> v2:172.21.15.123:3300/0 conn(0x7f1b880b33f0 0x7f1b8806f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:55.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b8c9bd700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b78003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b8d1be700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b78004d90 0x7f1b78005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b87fff700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b880cd770 0x7f1b78004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b8c9bd700 1 -- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b880cd770 msgr2=0x7f1b78004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:55.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b8c9bd700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b880cd770 0x7f1b78004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b8c9bd700 1 -- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b78004d90 msgr2=0x7f1b78005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:55.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b8c9bd700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b78004d90 0x7f1b78005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b8c9bd700 1 -- 172.21.15.72:0/2592269245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b780035b0 con 0x7f1b78003a00 2023-10-14T12:33:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b8d1be700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b78004d90 0x7f1b78005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b8c9bd700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b78003e20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c240 tx=0x7f1b78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2da17b52d5b077 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c007c10 con 0x7f1b78003a00 2023-10-14T12:33:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c00ce00 con 0x7f1b78003a00 2023-10-14T12:33:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.573+0000 7f1b877fe700 1 -- 172.21.15.72:0/2592269245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c005ba0 con 0x7f1b78003a00 2023-10-14T12:33:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.574+0000 7f1b8ec21700 1 -- 172.21.15.72:0/2592269245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 msgr2=0x7f1b78003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.574+0000 7f1b8ec21700 1 --2- 172.21.15.72:0/2592269245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b78003e20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c240 tx=0x7f1b78005880 comp rx=0 tx=0).stop 2023-10-14T12:33:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.574+0000 7f1b8d1be700 1 -- 172.21.15.72:0/2592269245 reap_dead start 2023-10-14T12:33:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.574+0000 7f1b8ec21700 1 -- 172.21.15.72:0/2592269245 shutdown_connections 2023-10-14T12:33:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.574+0000 7f1b8ec21700 1 -- 172.21.15.72:0/2592269245 >> 172.21.15.72:0/2592269245 conn(0x7f1b880cdce0 msgr2=0x7f1b880ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.574+0000 7f1b8ec21700 1 -- 172.21.15.72:0/2592269245 shutdown_connections 2023-10-14T12:33:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.574+0000 7f1b8ec21700 1 -- 172.21.15.72:0/2592269245 wait complete. 2023-10-14T12:33:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.575+0000 7f1b8ec21700 1 Processor -- start 2023-10-14T12:33:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.575+0000 7f1b8ec21700 1 -- start start 2023-10-14T12:33:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8ec21700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b8814c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8ec21700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b881e6ce0 0x7f1b881e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8ec21700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b881e25a0 0x7f1b881e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8ec21700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b881e5150 con 0x7f1b78003a00 2023-10-14T12:33:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8ec21700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b881e76a0 con 0x7f1b881e25a0 2023-10-14T12:33:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8ec21700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88149ea0 con 0x7f1b881e6ce0 2023-10-14T12:33:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8c9bd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b8814c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8c9bd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b8814c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47060/0 (socket says 172.21.15.72:47060) 2023-10-14T12:33:55.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8c9bd700 1 -- 172.21.15.72:0/37015452 learned_addr learned my addr 172.21.15.72:0/37015452 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:55.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b87fff700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b881e6ce0 0x7f1b881e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8d1be700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b881e25a0 0x7f1b881e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8c9bd700 1 -- 172.21.15.72:0/37015452 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b881e6ce0 msgr2=0x7f1b881e7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8c9bd700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b881e6ce0 0x7f1b881e7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8c9bd700 1 -- 172.21.15.72:0/37015452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b881e25a0 msgr2=0x7f1b881e2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8c9bd700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b881e25a0 0x7f1b881e2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8c9bd700 1 -- 172.21.15.72:0/37015452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b881e44d0 con 0x7f1b78003a00 2023-10-14T12:33:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b8c9bd700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b8814c7f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c830 tx=0x7f1b7c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:55.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b857fa700 1 -- 172.21.15.72:0/37015452 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c001630 con 0x7f1b78003a00 2023-10-14T12:33:55.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.576+0000 7f1b857fa700 1 -- 172.21.15.72:0/37015452 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c0070d0 con 0x7f1b78003a00 2023-10-14T12:33:55.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.577+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b881e47b0 con 0x7f1b78003a00 2023-10-14T12:33:55.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.577+0000 7f1b857fa700 1 -- 172.21.15.72:0/37015452 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c007480 con 0x7f1b78003a00 2023-10-14T12:33:55.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.577+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b881e4d70 con 0x7f1b78003a00 2023-10-14T12:33:55.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.577+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b880ccf60 con 0x7f1b78003a00 2023-10-14T12:33:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.578+0000 7f1b857fa700 1 -- 172.21.15.72:0/37015452 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1b7c019030 con 0x7f1b78003a00 2023-10-14T12:33:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.578+0000 7f1b857fa700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b6c06af00 0x7f1b6c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.578+0000 7f1b857fa700 1 -- 172.21.15.72:0/37015452 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b7c08ae30 con 0x7f1b78003a00 2023-10-14T12:33:55.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.578+0000 7f1b87fff700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b6c06af00 0x7f1b6c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.579+0000 7f1b87fff700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b6c06af00 0x7f1b6c06d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b881e4350 tx=0x7f1b74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:55.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.583+0000 7f1b857fa700 1 -- 172.21.15.72:0/37015452 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b7c055c00 con 0x7f1b78003a00 2023-10-14T12:33:55.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.772+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b8804ebb0 con 0x7f1b78003a00 2023-10-14T12:33:55.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.773+0000 7f1b857fa700 1 -- 172.21.15.72:0/37015452 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b7c059220 con 0x7f1b78003a00 2023-10-14T12:33:55.775 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:33:55.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b6c06af00 msgr2=0x7f1b6c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b6c06af00 0x7f1b6c06d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b881e4350 tx=0x7f1b74008040 comp rx=0 tx=0).stop 2023-10-14T12:33:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 msgr2=0x7f1b8814c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b8814c7f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c830 tx=0x7f1b7c001a00 comp rx=0 tx=0).stop 2023-10-14T12:33:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 shutdown_connections 2023-10-14T12:33:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b6c06af00 0x7f1b6c06d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b881e25a0 0x7f1b881e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b78003a00 0x7f1b8814c7f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 --2- 172.21.15.72:0/37015452 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b881e6ce0 0x7f1b881e7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 >> 172.21.15.72:0/37015452 conn(0x7f1b880cdce0 msgr2=0x7f1b880cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 shutdown_connections 2023-10-14T12:33:55.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.775+0000 7f1b8ec21700 1 -- 172.21.15.72:0/37015452 wait complete. 2023-10-14T12:33:55.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:33:55.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.913+0000 7ff480554700 1 Processor -- start 2023-10-14T12:33:55.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.913+0000 7ff480554700 1 -- start start 2023-10-14T12:33:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.914+0000 7ff480554700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4780cd770 0x7ff47806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.914+0000 7ff480554700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478070620 con 0x7ff47815b4e0 2023-10-14T12:33:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.914+0000 7ff480554700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478070900 con 0x7ff4780b33f0 2023-10-14T12:33:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.914+0000 7ff480554700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff478070be0 con 0x7ff4780cd770 2023-10-14T12:33:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.914+0000 7ff47e2f0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff47815b4e0 0x7ff4780b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53368/0 (socket says 172.21.15.72:53368) 2023-10-14T12:33:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.914+0000 7ff47e2f0700 1 -- 172.21.15.72:0/550160943 learned_addr learned my addr 172.21.15.72:0/550160943 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:55.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.914+0000 7ff47eaf1700 1 --2- 172.21.15.72:0/550160943 >> v2:172.21.15.123:3300/0 conn(0x7ff4780cd770 0x7ff47806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.914+0000 7ff47d2ee700 1 -- 172.21.15.72:0/550160943 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837179237 0 0) 0x7ff478070620 con 0x7ff47815b4e0 2023-10-14T12:33:55.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.915+0000 7ff47d2ee700 1 -- 172.21.15.72:0/550160943 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4640035b0 con 0x7ff47815b4e0 2023-10-14T12:33:55.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.915+0000 7ff47d2ee700 1 -- 172.21.15.72:0/550160943 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701086948 0 0) 0x7ff4640035b0 con 0x7ff47815b4e0 2023-10-14T12:33:55.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.915+0000 7ff47eaf1700 1 -- 172.21.15.72:0/550160943 >> v1:172.21.15.123:6789/0 conn(0x7ff4780b33f0 legacy=0x7ff4780b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.915+0000 7ff47eaf1700 1 -- 172.21.15.72:0/550160943 >> v1:172.21.15.72:6789/0 conn(0x7ff47815b4e0 legacy=0x7ff4780b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.915+0000 7ff47eaf1700 1 -- 172.21.15.72:0/550160943 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478070ec0 con 0x7ff4780cd770 2023-10-14T12:33:55.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.915+0000 7ff47eaf1700 1 --2- 172.21.15.72:0/550160943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4780cd770 0x7ff47806f280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff470009d90 tx=0x7ff47000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4b7f3843ecbe80 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:55.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.915+0000 7ff47d2ee700 1 -- 172.21.15.72:0/550160943 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47000e070 con 0x7ff4780cd770 2023-10-14T12:33:55.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.915+0000 7ff47d2ee700 1 -- 172.21.15.72:0/550160943 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470003a20 con 0x7ff4780cd770 2023-10-14T12:33:55.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.915+0000 7ff47d2ee700 1 -- 172.21.15.72:0/550160943 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468001670 con 0x7ff4780cd770 2023-10-14T12:33:55.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.916+0000 7ff480554700 1 -- 172.21.15.72:0/550160943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4780cd770 msgr2=0x7ff47806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.916+0000 7ff480554700 1 --2- 172.21.15.72:0/550160943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4780cd770 0x7ff47806f280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff470009d90 tx=0x7ff47000b330 comp rx=0 tx=0).stop 2023-10-14T12:33:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.916+0000 7ff480554700 1 -- 172.21.15.72:0/550160943 shutdown_connections 2023-10-14T12:33:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.916+0000 7ff480554700 1 --2- 172.21.15.72:0/550160943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4780cd770 0x7ff47806f280 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.916+0000 7ff480554700 1 -- 172.21.15.72:0/550160943 >> 172.21.15.72:0/550160943 conn(0x7ff4780cdce0 msgr2=0x7ff4780ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:55.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.916+0000 7ff480554700 1 -- 172.21.15.72:0/550160943 shutdown_connections 2023-10-14T12:33:55.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.916+0000 7ff480554700 1 -- 172.21.15.72:0/550160943 wait complete. 2023-10-14T12:33:55.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.917+0000 7ff480554700 1 Processor -- start 2023-10-14T12:33:55.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.917+0000 7ff480554700 1 -- start start 2023-10-14T12:33:55.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff480554700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4780b33f0 0x7ff478158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff480554700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4780cd770 0x7ff4780ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff480554700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff47815b4e0 0x7ff4780ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff480554700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4781e4f30 con 0x7ff47815b4e0 2023-10-14T12:33:55.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff480554700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4781e4320 con 0x7ff4780b33f0 2023-10-14T12:33:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff480554700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4781e4600 con 0x7ff4780cd770 2023-10-14T12:33:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47eaf1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff47815b4e0 0x7ff4780ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47eaf1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff47815b4e0 0x7ff4780ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47078/0 (socket says 172.21.15.72:47078) 2023-10-14T12:33:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47eaf1700 1 -- 172.21.15.72:0/3804845227 learned_addr learned my addr 172.21.15.72:0/3804845227 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47e2f0700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4780b33f0 0x7ff478158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47daef700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4780cd770 0x7ff4780ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47eaf1700 1 -- 172.21.15.72:0/3804845227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4780cd770 msgr2=0x7ff4780ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47eaf1700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4780cd770 0x7ff4780ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47eaf1700 1 -- 172.21.15.72:0/3804845227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4780b33f0 msgr2=0x7ff478158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47eaf1700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4780b33f0 0x7ff478158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:55.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47eaf1700 1 -- 172.21.15.72:0/3804845227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470009a70 con 0x7ff47815b4e0 2023-10-14T12:33:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff47eaf1700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff47815b4e0 0x7ff4780ca890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff4780b3920 tx=0x7ff470004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff46effd700 1 -- 172.21.15.72:0/3804845227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470004540 con 0x7ff47815b4e0 2023-10-14T12:33:55.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4781e48e0 con 0x7ff47815b4e0 2023-10-14T12:33:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff46effd700 1 -- 172.21.15.72:0/3804845227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4700046c0 con 0x7ff47815b4e0 2023-10-14T12:33:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff478158840 con 0x7ff47815b4e0 2023-10-14T12:33:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.918+0000 7ff46effd700 1 -- 172.21.15.72:0/3804845227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47001d470 con 0x7ff47815b4e0 2023-10-14T12:33:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.919+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4600052f0 con 0x7ff47815b4e0 2023-10-14T12:33:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.920+0000 7ff46effd700 1 -- 172.21.15.72:0/3804845227 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff47001d5d0 con 0x7ff47815b4e0 2023-10-14T12:33:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.920+0000 7ff46effd700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff45c06af00 0x7ff45c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:55.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.920+0000 7ff47e2f0700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff45c06af00 0x7ff45c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:55.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.920+0000 7ff46effd700 1 -- 172.21.15.72:0/3804845227 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff47008b570 con 0x7ff47815b4e0 2023-10-14T12:33:55.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.921+0000 7ff47e2f0700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff45c06af00 0x7ff45c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff4680011e0 tx=0x7ff468001da0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:55.925+0000 7ff46effd700 1 -- 172.21.15.72:0/3804845227 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff470059dd0 con 0x7ff47815b4e0 2023-10-14T12:33:56.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.112+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff460005b20 con 0x7ff47815b4e0 2023-10-14T12:33:56.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.112+0000 7ff46effd700 1 -- 172.21.15.72:0/3804845227 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff470059960 con 0x7ff47815b4e0 2023-10-14T12:33:56.114 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:33:56.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff45c06af00 msgr2=0x7ff45c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff45c06af00 0x7ff45c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff4680011e0 tx=0x7ff468001da0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff47815b4e0 msgr2=0x7ff4780ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff47815b4e0 0x7ff4780ca890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff4780b3920 tx=0x7ff470004ad0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 shutdown_connections 2023-10-14T12:33:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff45c06af00 0x7ff45c06d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff47815b4e0 0x7ff4780ca890 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4780b33f0 0x7ff478158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 --2- 172.21.15.72:0/3804845227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff4780cd770 0x7ff4780ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 >> 172.21.15.72:0/3804845227 conn(0x7ff4780cdce0 msgr2=0x7ff4780c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 shutdown_connections 2023-10-14T12:33:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.114+0000 7ff480554700 1 -- 172.21.15.72:0/3804845227 wait complete. 2023-10-14T12:33:56.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:33:56.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.249+0000 7f9ee7c7f700 1 Processor -- start 2023-10-14T12:33:56.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.250+0000 7f9ee7c7f700 1 -- start start 2023-10-14T12:33:56.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.250+0000 7f9ee7c7f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee006dcc0 0x7f9ee00cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.250+0000 7f9ee7c7f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee00cba90 con 0x7f9ee015a250 2023-10-14T12:33:56.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.250+0000 7f9ee7c7f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee015ee40 con 0x7f9ee015dec0 2023-10-14T12:33:56.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.250+0000 7f9ee7c7f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00cb510 con 0x7f9ee006dcc0 2023-10-14T12:33:56.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.250+0000 7f9ee5a1b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9ee015a250 0x7f9ee00717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53382/0 (socket says 172.21.15.72:53382) 2023-10-14T12:33:56.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.250+0000 7f9ee5a1b700 1 -- 172.21.15.72:0/3859186564 learned_addr learned my addr 172.21.15.72:0/3859186564 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:56.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee621c700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee006dcc0 0x7f9ee00cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613934962 0 0) 0x7f9ee00cba90 con 0x7f9ee015a250 2023-10-14T12:33:56.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ecc0035b0 con 0x7f9ee015a250 2023-10-14T12:33:56.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868695726 0 0) 0x7f9ee015ee40 con 0x7f9ee015dec0 2023-10-14T12:33:56.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee00cba90 con 0x7f9ee015dec0 2023-10-14T12:33:56.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2088452534 0 0) 0x7f9ecc0035b0 con 0x7f9ee015a250 2023-10-14T12:33:56.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee006dcc0 msgr2=0x7f9ee00cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:56.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee006dcc0 0x7f9ee00cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 >> v1:172.21.15.123:6789/0 conn(0x7f9ee015dec0 legacy=0x7f9ee006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee015e880 con 0x7f9ee015a250 2023-10-14T12:33:56.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f9ed0001670 con 0x7f9ee015a250 2023-10-14T12:33:56.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 >> v1:172.21.15.72:6789/0 conn(0x7f9ee015a250 legacy=0x7f9ee00717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ecc003bc0 0x7f9ecc003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ecc004850 0x7f9ecc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ecc005210 0x7f9ecc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00cb510 con 0x7f9ecc003bc0 2023-10-14T12:33:56.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc00c000 con 0x7f9ecc004850 2023-10-14T12:33:56.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc00c1c0 con 0x7f9ecc005210 2023-10-14T12:33:56.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee621c700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee006dcc0 0x7f9ee00cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:56.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee5a1b700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ecc003bc0 0x7f9ecc003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee521a700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ecc004850 0x7f9ecc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee621c700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ecc005210 0x7f9ecc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee5a1b700 1 -- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ecc005210 msgr2=0x7f9ecc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee5a1b700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ecc005210 0x7f9ecc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee5a1b700 1 -- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ecc004850 msgr2=0x7f9ecc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee5a1b700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ecc004850 0x7f9ecc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.251+0000 7f9ee5a1b700 1 -- 172.21.15.72:0/3859186564 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0035b0 con 0x7f9ecc003bc0 2023-10-14T12:33:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee5a1b700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ecc003bc0 0x7f9ecc003fc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000c240 tx=0x7f9ecc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f7357b99d462da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed000cd80 con 0x7f9ecc003bc0 2023-10-14T12:33:56.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed0005960 con 0x7f9ecc003bc0 2023-10-14T12:33:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee4a19700 1 -- 172.21.15.72:0/3859186564 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed0005d10 con 0x7f9ecc003bc0 2023-10-14T12:33:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/3859186564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ecc003bc0 msgr2=0x7f9ecc003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee7c7f700 1 --2- 172.21.15.72:0/3859186564 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ecc003bc0 0x7f9ecc003fc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ed000c240 tx=0x7f9ecc005880 comp rx=0 tx=0).stop 2023-10-14T12:33:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee621c700 1 -- 172.21.15.72:0/3859186564 reap_dead start 2023-10-14T12:33:56.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/3859186564 shutdown_connections 2023-10-14T12:33:56.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/3859186564 >> 172.21.15.72:0/3859186564 conn(0x7f9ee00ccbe0 msgr2=0x7f9ee00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:56.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/3859186564 shutdown_connections 2023-10-14T12:33:56.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.252+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/3859186564 wait complete. 2023-10-14T12:33:56.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee7c7f700 1 Processor -- start 2023-10-14T12:33:56.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee7c7f700 1 -- start start 2023-10-14T12:33:56.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee7c7f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ecc003bc0 0x7f9ee00c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee7c7f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee00cc190 0x7f9ee00c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee7c7f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee00cc610 0x7f9ee00b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee7c7f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00c5a20 con 0x7f9ee00cc610 2023-10-14T12:33:56.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee7c7f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00c4e10 con 0x7f9ecc003bc0 2023-10-14T12:33:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee7c7f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00c50f0 con 0x7f9ee00cc190 2023-10-14T12:33:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee621c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee00cc610 0x7f9ee00b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee621c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee00cc610 0x7f9ee00b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47098/0 (socket says 172.21.15.72:47098) 2023-10-14T12:33:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee621c700 1 -- 172.21.15.72:0/122665651 learned_addr learned my addr 172.21.15.72:0/122665651 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:56.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee5a1b700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ecc003bc0 0x7f9ee00c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.254+0000 7f9ee521a700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee00cc190 0x7f9ee00c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ee621c700 1 -- 172.21.15.72:0/122665651 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee00cc190 msgr2=0x7f9ee00c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ee621c700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee00cc190 0x7f9ee00c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ee621c700 1 -- 172.21.15.72:0/122665651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ecc003bc0 msgr2=0x7f9ee00c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ee621c700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ecc003bc0 0x7f9ee00c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ee621c700 1 -- 172.21.15.72:0/122665651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00c53d0 con 0x7f9ee00cc610 2023-10-14T12:33:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ee621c700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee00cc610 0x7f9ee00b2da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9ee006d480 tx=0x7f9ed80116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ed67fc700 1 -- 172.21.15.72:0/122665651 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800e070 con 0x7f9ee00cc610 2023-10-14T12:33:56.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ed67fc700 1 -- 172.21.15.72:0/122665651 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8011c40 con 0x7f9ee00cc610 2023-10-14T12:33:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee00c56b0 con 0x7f9ee00cc610 2023-10-14T12:33:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ed67fc700 1 -- 172.21.15.72:0/122665651 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8011df0 con 0x7f9ee00cc610 2023-10-14T12:33:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.255+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee014d450 con 0x7f9ee00cc610 2023-10-14T12:33:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.256+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee00c5840 con 0x7f9ee00cc610 2023-10-14T12:33:56.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.256+0000 7f9ed67fc700 1 -- 172.21.15.72:0/122665651 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9ed8003a20 con 0x7f9ee00cc610 2023-10-14T12:33:56.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.257+0000 7f9ed67fc700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9ec406af00 0x7f9ec406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.257+0000 7f9ee5a1b700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9ec406af00 0x7f9ec406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.257+0000 7f9ed67fc700 1 -- 172.21.15.72:0/122665651 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ed808a030 con 0x7f9ee00cc610 2023-10-14T12:33:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.257+0000 7f9ee5a1b700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9ec406af00 0x7f9ec406d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed0007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:56.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.261+0000 7f9ed67fc700 1 -- 172.21.15.72:0/122665651 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9ed8054df0 con 0x7f9ee00cc610 2023-10-14T12:33:56.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.449+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9ee004ebb0 con 0x7f9ee00cc610 2023-10-14T12:33:56.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.449+0000 7f9ed67fc700 1 -- 172.21.15.72:0/122665651 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9ed8058410 con 0x7f9ee00cc610 2023-10-14T12:33:56.451 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:33:56.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9ec406af00 msgr2=0x7f9ec406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9ec406af00 0x7f9ec406d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed0007f90 comp rx=0 tx=0).stop 2023-10-14T12:33:56.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee00cc610 msgr2=0x7f9ee00b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee00cc610 0x7f9ee00b2da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9ee006d480 tx=0x7f9ed80116e0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 shutdown_connections 2023-10-14T12:33:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9ec406af00 0x7f9ec406d3c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ee00cc610 0x7f9ee00b2da0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ecc003bc0 0x7f9ee00c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 --2- 172.21.15.72:0/122665651 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9ee00cc190 0x7f9ee00c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.451+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 >> 172.21.15.72:0/122665651 conn(0x7f9ee00ccbe0 msgr2=0x7f9ee00afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.452+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 shutdown_connections 2023-10-14T12:33:56.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.452+0000 7f9ee7c7f700 1 -- 172.21.15.72:0/122665651 wait complete. 2023-10-14T12:33:56.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:33:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.585+0000 7f1b2ff64700 1 Processor -- start 2023-10-14T12:33:56.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.586+0000 7f1b2ff64700 1 -- start start 2023-10-14T12:33:56.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.586+0000 7f1b2ff64700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b2806a820 0x7f1b280cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2ff64700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b280ca7d0 0x7f1b28071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2ff64700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b280cfeb0 con 0x7f1b2815e7f0 2023-10-14T12:33:56.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2ff64700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b280ce410 con 0x7f1b280ca7d0 2023-10-14T12:33:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2ff64700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2815ec50 con 0x7f1b2806a820 2023-10-14T12:33:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2e501700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b280ca7d0 0x7f1b28071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2e501700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b280ca7d0 0x7f1b28071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47106/0 (socket says 172.21.15.72:47106) 2023-10-14T12:33:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2e501700 1 -- 172.21.15.72:0/1620602110 learned_addr learned my addr 172.21.15.72:0/1620602110 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:56.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2e501700 1 -- 172.21.15.72:0/1620602110 >> v2:172.21.15.123:3300/0 conn(0x7f1b2806a820 msgr2=0x7f1b280cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2dd00700 1 --2- 172.21.15.72:0/1620602110 >> v2:172.21.15.123:3300/0 conn(0x7f1b2806a820 0x7f1b280cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2e501700 1 --2- 172.21.15.72:0/1620602110 >> v2:172.21.15.123:3300/0 conn(0x7f1b2806a820 0x7f1b280cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2e501700 1 -- 172.21.15.72:0/1620602110 >> v1:172.21.15.123:6789/0 conn(0x7f1b2815e7f0 legacy=0x7f1b2806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2e501700 1 -- 172.21.15.72:0/1620602110 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280af9d0 con 0x7f1b280ca7d0 2023-10-14T12:33:56.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2dd00700 1 --2- 172.21.15.72:0/1620602110 >> v2:172.21.15.123:3300/0 conn(0x7f1b2806a820 0x7f1b280cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2e501700 1 --2- 172.21.15.72:0/1620602110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b280ca7d0 0x7f1b28071ea0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1b28067df0 tx=0x7f1b2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2cfd3aaa98cfcc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2ccfe700 1 -- 172.21.15.72:0/1620602110 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2000e070 con 0x7f1b280ca7d0 2023-10-14T12:33:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2ccfe700 1 -- 172.21.15.72:0/1620602110 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20003a70 con 0x7f1b280ca7d0 2023-10-14T12:33:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.587+0000 7f1b2ccfe700 1 -- 172.21.15.72:0/1620602110 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20003e20 con 0x7f1b280ca7d0 2023-10-14T12:33:56.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.588+0000 7f1b2ff64700 1 -- 172.21.15.72:0/1620602110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b280ca7d0 msgr2=0x7f1b28071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.588+0000 7f1b2ff64700 1 --2- 172.21.15.72:0/1620602110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b280ca7d0 0x7f1b28071ea0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1b28067df0 tx=0x7f1b2000b330 comp rx=0 tx=0).stop 2023-10-14T12:33:56.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.588+0000 7f1b2ff64700 1 -- 172.21.15.72:0/1620602110 shutdown_connections 2023-10-14T12:33:56.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.588+0000 7f1b2ff64700 1 --2- 172.21.15.72:0/1620602110 >> v2:172.21.15.123:3300/0 conn(0x7f1b2806a820 0x7f1b280cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.588+0000 7f1b2ff64700 1 --2- 172.21.15.72:0/1620602110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b280ca7d0 0x7f1b28071ea0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.588+0000 7f1b2ff64700 1 -- 172.21.15.72:0/1620602110 >> 172.21.15.72:0/1620602110 conn(0x7f1b280d0180 msgr2=0x7f1b280d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:56.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.588+0000 7f1b2ff64700 1 -- 172.21.15.72:0/1620602110 shutdown_connections 2023-10-14T12:33:56.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.588+0000 7f1b2ff64700 1 -- 172.21.15.72:0/1620602110 wait complete. 2023-10-14T12:33:56.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.589+0000 7f1b2ff64700 1 Processor -- start 2023-10-14T12:33:56.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.589+0000 7f1b2ff64700 1 -- start start 2023-10-14T12:33:56.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2ff64700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2806a820 0x7f1b280c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2ff64700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b280ca7d0 0x7f1b280c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2ff64700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2815e7f0 0x7f1b281601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2ff64700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b280c9b90 con 0x7f1b2806a820 2023-10-14T12:33:56.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2ff64700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b280c9e70 con 0x7f1b2815e7f0 2023-10-14T12:33:56.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2ff64700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b280acf90 con 0x7f1b280ca7d0 2023-10-14T12:33:56.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2dd00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2806a820 0x7f1b280c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2dd00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2806a820 0x7f1b280c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47108/0 (socket says 172.21.15.72:47108) 2023-10-14T12:33:56.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2dd00700 1 -- 172.21.15.72:0/353995805 learned_addr learned my addr 172.21.15.72:0/353995805 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:56.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2e501700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2815e7f0 0x7f1b281601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2d4ff700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b280ca7d0 0x7f1b280c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2dd00700 1 -- 172.21.15.72:0/353995805 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b280ca7d0 msgr2=0x7f1b280c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2dd00700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b280ca7d0 0x7f1b280c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2dd00700 1 -- 172.21.15.72:0/353995805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2815e7f0 msgr2=0x7f1b281601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2dd00700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2815e7f0 0x7f1b281601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2dd00700 1 -- 172.21.15.72:0/353995805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b20009b30 con 0x7f1b2806a820 2023-10-14T12:33:56.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.590+0000 7f1b2dd00700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2806a820 0x7f1b280c7980 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c750 tx=0x7f1b1800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:56.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.591+0000 7f1b1e7fc700 1 -- 172.21.15.72:0/353995805 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18011800 con 0x7f1b2806a820 2023-10-14T12:33:56.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.591+0000 7f1b1e7fc700 1 -- 172.21.15.72:0/353995805 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b18011960 con 0x7f1b2806a820 2023-10-14T12:33:56.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.591+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b280ad270 con 0x7f1b2806a820 2023-10-14T12:33:56.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.591+0000 7f1b1e7fc700 1 -- 172.21.15.72:0/353995805 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18011cd0 con 0x7f1b2806a820 2023-10-14T12:33:56.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.591+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b280c9960 con 0x7f1b2806a820 2023-10-14T12:33:56.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.591+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b280acdf0 con 0x7f1b2806a820 2023-10-14T12:33:56.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.592+0000 7f1b1e7fc700 1 -- 172.21.15.72:0/353995805 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1b18021350 con 0x7f1b2806a820 2023-10-14T12:33:56.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.592+0000 7f1b1e7fc700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b0c06af00 0x7f1b0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.592+0000 7f1b1e7fc700 1 -- 172.21.15.72:0/353995805 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b180896b0 con 0x7f1b2806a820 2023-10-14T12:33:56.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.592+0000 7f1b2d4ff700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b0c06af00 0x7f1b0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.593+0000 7f1b2d4ff700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b0c06af00 0x7f1b0c06d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b280673f0 tx=0x7f1b240090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:56.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.597+0000 7f1b1e7fc700 1 -- 172.21.15.72:0/353995805 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b280acdf0 con 0x7f1b2806a820 2023-10-14T12:33:56.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.828+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b280acdf0 con 0x7f1b2806a820 2023-10-14T12:33:56.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.829+0000 7f1b1e7fc700 1 -- 172.21.15.72:0/353995805 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f1b280acdf0 con 0x7f1b2806a820 2023-10-14T12:33:56.830 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:56.831 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:47.920500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:33:56.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b0c06af00 msgr2=0x7f1b0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b0c06af00 0x7f1b0c06d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b280673f0 tx=0x7f1b240090e0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2806a820 msgr2=0x7f1b280c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2806a820 0x7f1b280c7980 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800c750 tx=0x7f1b1800ca60 comp rx=0 tx=0).stop 2023-10-14T12:33:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 shutdown_connections 2023-10-14T12:33:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b0c06af00 0x7f1b0c06d3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2815e7f0 0x7f1b281601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b2806a820 0x7f1b280c7980 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 --2- 172.21.15.72:0/353995805 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1b280ca7d0 0x7f1b280c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 >> 172.21.15.72:0/353995805 conn(0x7f1b280d0180 msgr2=0x7f1b28159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 shutdown_connections 2023-10-14T12:33:56.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.831+0000 7f1b2ff64700 1 -- 172.21.15.72:0/353995805 wait complete. 2023-10-14T12:33:56.835 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-10-14T12:33:56.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:56.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.962+0000 7f1d2258f700 1 Processor -- start 2023-10-14T12:33:56.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.962+0000 7f1d2258f700 1 -- start start 2023-10-14T12:33:56.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.963+0000 7f1d2258f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1d1c06a820 0x7f1d1c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.963+0000 7f1d2258f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d1c15e7f0 0x7f1d1c06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.963+0000 7f1d2258f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c0cfeb0 con 0x7f1d1c0ca7d0 2023-10-14T12:33:56.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.963+0000 7f1d2258f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0ce410 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.963+0000 7f1d2258f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c15ec50 con 0x7f1d1c06a820 2023-10-14T12:33:56.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.963+0000 7f1d1b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d1c15e7f0 0x7f1d1c06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.963+0000 7f1d20b2c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1d1c0ca7d0 0x7f1d1c071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53418/0 (socket says 172.21.15.72:53418) 2023-10-14T12:33:56.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.963+0000 7f1d20b2c700 1 -- 172.21.15.72:0/2051484384 learned_addr learned my addr 172.21.15.72:0/2051484384 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:56.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1bfff700 1 --2- 172.21.15.72:0/2051484384 >> v2:172.21.15.123:3300/0 conn(0x7f1d1c06a820 0x7f1d1c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1b7fe700 1 -- 172.21.15.72:0/2051484384 >> v2:172.21.15.123:3300/0 conn(0x7f1d1c06a820 msgr2=0x7f1d1c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:56.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1b7fe700 1 --2- 172.21.15.72:0/2051484384 >> v2:172.21.15.123:3300/0 conn(0x7f1d1c06a820 0x7f1d1c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1b7fe700 1 -- 172.21.15.72:0/2051484384 >> v1:172.21.15.72:6789/0 conn(0x7f1d1c0ca7d0 legacy=0x7f1d1c071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1b7fe700 1 -- 172.21.15.72:0/2051484384 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0af9d0 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1bfff700 1 --2- 172.21.15.72:0/2051484384 >> v2:172.21.15.123:3300/0 conn(0x7f1d1c06a820 0x7f1d1c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:33:56.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1b7fe700 1 --2- 172.21.15.72:0/2051484384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 0x7f1d1c06ac00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c067df0 tx=0x7f1d04009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a92e15bf7e0443 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:56.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1affd700 1 -- 172.21.15.72:0/2051484384 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011830 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1affd700 1 -- 172.21.15.72:0/2051484384 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d04011990 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d1affd700 1 -- 172.21.15.72:0/2051484384 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011d20 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d2258f700 1 -- 172.21.15.72:0/2051484384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 msgr2=0x7f1d1c06ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d2258f700 1 --2- 172.21.15.72:0/2051484384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 0x7f1d1c06ac00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c067df0 tx=0x7f1d04009b20 comp rx=0 tx=0).stop 2023-10-14T12:33:56.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d2258f700 1 -- 172.21.15.72:0/2051484384 shutdown_connections 2023-10-14T12:33:56.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.964+0000 7f1d2258f700 1 --2- 172.21.15.72:0/2051484384 >> v2:172.21.15.123:3300/0 conn(0x7f1d1c06a820 0x7f1d1c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.965+0000 7f1d2258f700 1 --2- 172.21.15.72:0/2051484384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 0x7f1d1c06ac00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.965+0000 7f1d2258f700 1 -- 172.21.15.72:0/2051484384 >> 172.21.15.72:0/2051484384 conn(0x7f1d1c0d0180 msgr2=0x7f1d1c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:56.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.965+0000 7f1d2258f700 1 -- 172.21.15.72:0/2051484384 shutdown_connections 2023-10-14T12:33:56.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.965+0000 7f1d2258f700 1 -- 172.21.15.72:0/2051484384 wait complete. 2023-10-14T12:33:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.966+0000 7f1d2258f700 1 Processor -- start 2023-10-14T12:33:56.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.966+0000 7f1d2258f700 1 -- start start 2023-10-14T12:33:56.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d2258f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c06a820 0x7f1d1c155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d2258f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d1c0ca7d0 0x7f1d1c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d2258f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 0x7f1d1c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d2258f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0ad630 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d2258f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c15bf80 con 0x7f1d1c06a820 2023-10-14T12:33:56.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d2258f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0ad840 con 0x7f1d1c0ca7d0 2023-10-14T12:33:56.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d20b2c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 0x7f1d1c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d20b2c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 0x7f1d1c15cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47124/0 (socket says 172.21.15.72:47124) 2023-10-14T12:33:56.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d20b2c700 1 -- 172.21.15.72:0/3042484689 learned_addr learned my addr 172.21.15.72:0/3042484689 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:56.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d1bfff700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c06a820 0x7f1d1c155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d1b7fe700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d1c0ca7d0 0x7f1d1c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d20b2c700 1 -- 172.21.15.72:0/3042484689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d1c0ca7d0 msgr2=0x7f1d1c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d20b2c700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d1c0ca7d0 0x7f1d1c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d20b2c700 1 -- 172.21.15.72:0/3042484689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c06a820 msgr2=0x7f1d1c155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:56.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d20b2c700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c06a820 0x7f1d1c155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:56.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d20b2c700 1 -- 172.21.15.72:0/3042484689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d040094a0 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d1b7fe700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d1c0ca7d0 0x7f1d1c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:56.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d20b2c700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 0x7f1d1c15cb80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400cb10 tx=0x7f1d1400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:56.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d18ff9700 1 -- 172.21.15.72:0/3042484689 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400aaa0 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d18ff9700 1 -- 172.21.15.72:0/3042484689 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1400ac00 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c0adb20 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d18ff9700 1 -- 172.21.15.72:0/3042484689 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14012400 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.967+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c0ae0e0 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.968+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c04ebb0 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.969+0000 7f1d18ff9700 1 -- 172.21.15.72:0/3042484689 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d14007d50 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.969+0000 7f1d18ff9700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af00 0x7f1cfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:56.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.969+0000 7f1d18ff9700 1 -- 172.21.15.72:0/3042484689 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d14089200 con 0x7f1d1c15e7f0 2023-10-14T12:33:56.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.969+0000 7f1d1bfff700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af00 0x7f1cfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:56.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.970+0000 7f1d1bfff700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af00 0x7f1cfc06d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c006fd0 tx=0x7f1d0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:56.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:56.974+0000 7f1d18ff9700 1 -- 172.21.15.72:0/3042484689 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d14053fc0 con 0x7f1d1c15e7f0 2023-10-14T12:33:57.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.167+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d1c15aec0 con 0x7f1d1c15e7f0 2023-10-14T12:33:57.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.168+0000 7f1d18ff9700 1 -- 172.21.15.72:0/3042484689 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f1d140575e0 con 0x7f1d1c15e7f0 2023-10-14T12:33:57.169 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:57.170 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:57.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af00 msgr2=0x7f1cfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af00 0x7f1cfc06d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c006fd0 tx=0x7f1d0c008040 comp rx=0 tx=0).stop 2023-10-14T12:33:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 msgr2=0x7f1d1c15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 0x7f1d1c15cb80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d1400cb10 tx=0x7f1d1400ce20 comp rx=0 tx=0).stop 2023-10-14T12:33:57.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 shutdown_connections 2023-10-14T12:33:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1cfc06af00 0x7f1cfc06d3c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d1c15e7f0 0x7f1d1c15cb80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d1c06a820 0x7f1d1c155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 --2- 172.21.15.72:0/3042484689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d1c0ca7d0 0x7f1d1c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 >> 172.21.15.72:0/3042484689 conn(0x7f1d1c0d0180 msgr2=0x7f1d1c071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:57.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 shutdown_connections 2023-10-14T12:33:57.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.170+0000 7f1d2258f700 1 -- 172.21.15.72:0/3042484689 wait complete. 2023-10-14T12:33:57.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:33:57.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:33:57.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.305+0000 7f82d2290700 1 Processor -- start 2023-10-14T12:33:57.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.305+0000 7f82d2290700 1 -- start start 2023-10-14T12:33:57.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82d2290700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82cc06b370 0x7f82cc15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82d2290700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 0x7f82cc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82d2290700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc161360 con 0x7f82cc0cdd30 2023-10-14T12:33:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82d2290700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc06b750 con 0x7f82cc06b370 2023-10-14T12:33:57.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82d2290700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc15e300 con 0x7f82cc06a820 2023-10-14T12:33:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82cbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82cc06b370 0x7f82cc15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82d082d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f82cc0cdd30 0x7f82cc1617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53432/0 (socket says 172.21.15.72:53432) 2023-10-14T12:33:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82d082d700 1 -- 172.21.15.72:0/709310206 learned_addr learned my addr 172.21.15.72:0/709310206 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82cb7fe700 1 --2- 172.21.15.72:0/709310206 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 0x7f82cc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82cbfff700 1 -- 172.21.15.72:0/709310206 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 msgr2=0x7f82cc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:57.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82cbfff700 1 --2- 172.21.15.72:0/709310206 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 0x7f82cc06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82cbfff700 1 -- 172.21.15.72:0/709310206 >> v1:172.21.15.72:6789/0 conn(0x7f82cc0cdd30 legacy=0x7f82cc1617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82cbfff700 1 -- 172.21.15.72:0/709310206 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc15e5e0 con 0x7f82cc06b370 2023-10-14T12:33:57.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82caffd700 1 -- 172.21.15.72:0/709310206 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319809524 0 0) 0x7f82cc161360 con 0x7f82cc0cdd30 2023-10-14T12:33:57.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82cbfff700 1 --2- 172.21.15.72:0/709310206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 0x7f82cc15dcb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009840 tx=0x7f82c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2efc68fcbee8ee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.306+0000 7f82caffd700 1 -- 172.21.15.72:0/709310206 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0011830 con 0x7f82cc06b370 2023-10-14T12:33:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82caffd700 1 -- 172.21.15.72:0/709310206 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0011990 con 0x7f82cc06b370 2023-10-14T12:33:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82caffd700 1 -- 172.21.15.72:0/709310206 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0011d20 con 0x7f82cc06b370 2023-10-14T12:33:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82d2290700 1 -- 172.21.15.72:0/709310206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 msgr2=0x7f82cc15dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82d2290700 1 --2- 172.21.15.72:0/709310206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 0x7f82cc15dcb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f82c0009840 tx=0x7f82c0009b50 comp rx=0 tx=0).stop 2023-10-14T12:33:57.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82d2290700 1 -- 172.21.15.72:0/709310206 shutdown_connections 2023-10-14T12:33:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82d2290700 1 --2- 172.21.15.72:0/709310206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 0x7f82cc15dcb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82d2290700 1 --2- 172.21.15.72:0/709310206 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 0x7f82cc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82d2290700 1 -- 172.21.15.72:0/709310206 >> 172.21.15.72:0/709310206 conn(0x7f82cc0ccbe0 msgr2=0x7f82cc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82d2290700 1 -- 172.21.15.72:0/709310206 shutdown_connections 2023-10-14T12:33:57.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.307+0000 7f82d2290700 1 -- 172.21.15.72:0/709310206 wait complete. 2023-10-14T12:33:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.308+0000 7f82d2290700 1 Processor -- start 2023-10-14T12:33:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.308+0000 7f82d2290700 1 -- start start 2023-10-14T12:33:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.309+0000 7f82d2290700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 0x7f82cc1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.309+0000 7f82d2290700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 0x7f82cc0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.309+0000 7f82d2290700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82cc0cdd30 0x7f82cc0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.309+0000 7f82d2290700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc156df0 con 0x7f82cc06b370 2023-10-14T12:33:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.309+0000 7f82d2290700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0aca80 con 0x7f82cc0cdd30 2023-10-14T12:33:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.309+0000 7f82d2290700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0acd60 con 0x7f82cc06a820 2023-10-14T12:33:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.309+0000 7f82cb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 0x7f82cc0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.309+0000 7f82cb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 0x7f82cc0b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47138/0 (socket says 172.21.15.72:47138) 2023-10-14T12:33:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.309+0000 7f82cb7fe700 1 -- 172.21.15.72:0/493158351 learned_addr learned my addr 172.21.15.72:0/493158351 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82d082d700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82cc0cdd30 0x7f82cc0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82cbfff700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 0x7f82cc1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82cb7fe700 1 -- 172.21.15.72:0/493158351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 msgr2=0x7f82cc1562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82cb7fe700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 0x7f82cc1562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82cb7fe700 1 -- 172.21.15.72:0/493158351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82cc0cdd30 msgr2=0x7f82cc0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82cb7fe700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82cc0cdd30 0x7f82cc0b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82cb7fe700 1 -- 172.21.15.72:0/493158351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c00094a0 con 0x7f82cc06b370 2023-10-14T12:33:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82cb7fe700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 0x7f82cc0b0ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c7f0 tx=0x7f82bc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:57.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82c8ff9700 1 -- 172.21.15.72:0/493158351 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc004220 con 0x7f82cc06b370 2023-10-14T12:33:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82c8ff9700 1 -- 172.21.15.72:0/493158351 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc004380 con 0x7f82cc06b370 2023-10-14T12:33:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc0ad040 con 0x7f82cc06b370 2023-10-14T12:33:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82c8ff9700 1 -- 172.21.15.72:0/493158351 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0036a0 con 0x7f82cc06b370 2023-10-14T12:33:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.310+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc0ad600 con 0x7f82cc06b370 2023-10-14T12:33:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.311+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc072d10 con 0x7f82cc06b370 2023-10-14T12:33:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.312+0000 7f82c8ff9700 1 -- 172.21.15.72:0/493158351 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f82bc003800 con 0x7f82cc06b370 2023-10-14T12:33:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.312+0000 7f82c8ff9700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f82b806af00 0x7f82b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.312+0000 7f82cbfff700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f82b806af00 0x7f82b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.312+0000 7f82c8ff9700 1 -- 172.21.15.72:0/493158351 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82bc089740 con 0x7f82cc06b370 2023-10-14T12:33:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.312+0000 7f82cbfff700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f82b806af00 0x7f82b806d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f82c00090b0 tx=0x7f82c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:57.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.316+0000 7f82c8ff9700 1 -- 172.21.15.72:0/493158351 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82bc054670 con 0x7f82cc06b370 2023-10-14T12:33:57.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.505+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82cc04ebb0 con 0x7f82cc06b370 2023-10-14T12:33:57.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.505+0000 7f82c8ff9700 1 -- 172.21.15.72:0/493158351 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82bc057c90 con 0x7f82cc06b370 2023-10-14T12:33:57.507 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:33:57.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f82b806af00 msgr2=0x7f82b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f82b806af00 0x7f82b806d3c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f82c00090b0 tx=0x7f82c0008030 comp rx=0 tx=0).stop 2023-10-14T12:33:57.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 msgr2=0x7f82cc0b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 0x7f82cc0b0ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00c7f0 tx=0x7f82bc00cbb0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 shutdown_connections 2023-10-14T12:33:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f82b806af00 0x7f82b806d3c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82cc0cdd30 0x7f82cc0b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f82cc06a820 0x7f82cc1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 --2- 172.21.15.72:0/493158351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82cc06b370 0x7f82cc0b0ca0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 >> 172.21.15.72:0/493158351 conn(0x7f82cc0ccbe0 msgr2=0x7f82cc1573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:57.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 shutdown_connections 2023-10-14T12:33:57.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.507+0000 7f82d2290700 1 -- 172.21.15.72:0/493158351 wait complete. 2023-10-14T12:33:57.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:33:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.645+0000 7fd0877ce700 1 Processor -- start 2023-10-14T12:33:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.645+0000 7fd0877ce700 1 -- start start 2023-10-14T12:33:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd0877ce700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd08015e7a0 0x7fd0800cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd0877ce700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0800718f0 con 0x7fd0800ca7d0 2023-10-14T12:33:57.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd0877ce700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0800af3c0 con 0x7fd08006a820 2023-10-14T12:33:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd0877ce700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0800cff70 con 0x7fd08015e7a0 2023-10-14T12:33:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd085d6b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd0800ca7d0 0x7fd080071dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53446/0 (socket says 172.21.15.72:53446) 2023-10-14T12:33:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd085d6b700 1 -- 172.21.15.72:0/223277344 learned_addr learned my addr 172.21.15.72:0/223277344 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:57.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd084d69700 1 --2- 172.21.15.72:0/223277344 >> v2:172.21.15.123:3300/0 conn(0x7fd08015e7a0 0x7fd0800cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458819625 0 0) 0x7fd0800718f0 con 0x7fd0800ca7d0 2023-10-14T12:33:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd06c0035b0 con 0x7fd0800ca7d0 2023-10-14T12:33:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 82814754 0 0) 0x7fd06c0035b0 con 0x7fd0800ca7d0 2023-10-14T12:33:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 >> v2:172.21.15.123:3300/0 conn(0x7fd08015e7a0 msgr2=0x7fd0800cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:57.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 --2- 172.21.15.72:0/223277344 >> v2:172.21.15.123:3300/0 conn(0x7fd08015e7a0 0x7fd0800cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 >> v1:172.21.15.123:6789/0 conn(0x7fd08006a820 legacy=0x7fd08006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800af6a0 con 0x7fd0800ca7d0 2023-10-14T12:33:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7fd078001a40 con 0x7fd0800ca7d0 2023-10-14T12:33:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 >> v1:172.21.15.72:6789/0 conn(0x7fd0800ca7d0 legacy=0x7fd080071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd06c003a00 0x7fd06c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c004850 0x7fd06c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd06c005210 0x7fd06c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800cff70 con 0x7fd06c004850 2023-10-14T12:33:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c00c0b0 con 0x7fd06c005210 2023-10-14T12:33:57.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c00c270 con 0x7fd06c003a00 2023-10-14T12:33:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd084d69700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c004850 0x7fd06c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd085d6b700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd06c005210 0x7fd06c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.646+0000 7fd08556a700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd06c003a00 0x7fd06c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd084d69700 1 -- 172.21.15.72:0/223277344 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd06c003a00 msgr2=0x7fd06c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:57.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd084d69700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd06c003a00 0x7fd06c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd084d69700 1 -- 172.21.15.72:0/223277344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd06c005210 msgr2=0x7fd06c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd084d69700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd06c005210 0x7fd06c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd084d69700 1 -- 172.21.15.72:0/223277344 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c0035b0 con 0x7fd06c004850 2023-10-14T12:33:57.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd085d6b700 1 -- 172.21.15.72:0/223277344 reap_dead start 2023-10-14T12:33:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd084d69700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c004850 0x7fd06c004cd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd070009b60 tx=0x7fd06c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd77d22c55429ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000e6c0 con 0x7fd06c004850 2023-10-14T12:33:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07000e820 con 0x7fd06c004850 2023-10-14T12:33:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd077fff700 1 -- 172.21.15.72:0/223277344 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000eb90 con 0x7fd06c004850 2023-10-14T12:33:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd0877ce700 1 -- 172.21.15.72:0/223277344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c004850 msgr2=0x7fd06c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.647+0000 7fd0877ce700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c004850 0x7fd06c004cd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd070009b60 tx=0x7fd06c005880 comp rx=0 tx=0).stop 2023-10-14T12:33:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.648+0000 7fd0877ce700 1 -- 172.21.15.72:0/223277344 shutdown_connections 2023-10-14T12:33:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.648+0000 7fd0877ce700 1 --2- 172.21.15.72:0/223277344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd06c004850 0x7fd06c004cd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.648+0000 7fd0877ce700 1 -- 172.21.15.72:0/223277344 >> 172.21.15.72:0/223277344 conn(0x7fd0800d0180 msgr2=0x7fd0800d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.648+0000 7fd0877ce700 1 -- 172.21.15.72:0/223277344 shutdown_connections 2023-10-14T12:33:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.648+0000 7fd0877ce700 1 -- 172.21.15.72:0/223277344 wait complete. 2023-10-14T12:33:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.649+0000 7fd0877ce700 1 Processor -- start 2023-10-14T12:33:57.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.649+0000 7fd0877ce700 1 -- start start 2023-10-14T12:33:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.649+0000 7fd0877ce700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd06c004850 0x7fd0800b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.649+0000 7fd0877ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd080159740 0x7fd0801f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.649+0000 7fd0877ce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0801f3720 0x7fd0800ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd0877ce700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd080159bc0 con 0x7fd080159740 2023-10-14T12:33:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd0877ce700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0801f6d30 con 0x7fd0801f3720 2023-10-14T12:33:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd0877ce700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0801f7010 con 0x7fd06c004850 2023-10-14T12:33:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd084d69700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd080159740 0x7fd0801f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd084d69700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd080159740 0x7fd0801f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47156/0 (socket says 172.21.15.72:47156) 2023-10-14T12:33:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd084d69700 1 -- 172.21.15.72:0/3642918137 learned_addr learned my addr 172.21.15.72:0/3642918137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd08556a700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd06c004850 0x7fd0800b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd085d6b700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0801f3720 0x7fd0800ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd084d69700 1 -- 172.21.15.72:0/3642918137 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd06c004850 msgr2=0x7fd0800b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd084d69700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd06c004850 0x7fd0800b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd084d69700 1 -- 172.21.15.72:0/3642918137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0801f3720 msgr2=0x7fd0800ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd084d69700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0801f3720 0x7fd0800ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd084d69700 1 -- 172.21.15.72:0/3642918137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0801f72f0 con 0x7fd080159740 2023-10-14T12:33:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd084d69700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd080159740 0x7fd0801f64e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00c080 tx=0x7fd0700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:57.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd075ffb700 1 -- 172.21.15.72:0/3642918137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000e6c0 con 0x7fd080159740 2023-10-14T12:33:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd075ffb700 1 -- 172.21.15.72:0/3642918137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0700038c0 con 0x7fd080159740 2023-10-14T12:33:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0801f3200 con 0x7fd080159740 2023-10-14T12:33:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd075ffb700 1 -- 172.21.15.72:0/3642918137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070003c70 con 0x7fd080159740 2023-10-14T12:33:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.650+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0801f6a20 con 0x7fd080159740 2023-10-14T12:33:57.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.651+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0801f7480 con 0x7fd080159740 2023-10-14T12:33:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.652+0000 7fd075ffb700 1 -- 172.21.15.72:0/3642918137 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd070013470 con 0x7fd080159740 2023-10-14T12:33:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.652+0000 7fd075ffb700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06406af00 0x7fd06406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.652+0000 7fd075ffb700 1 -- 172.21.15.72:0/3642918137 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd07008b180 con 0x7fd080159740 2023-10-14T12:33:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.652+0000 7fd08556a700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06406af00 0x7fd06406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.653+0000 7fd08556a700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06406af00 0x7fd06406d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd07c000c00 tx=0x7fd07c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:57.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.657+0000 7fd075ffb700 1 -- 172.21.15.72:0/3642918137 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0700560f0 con 0x7fd080159740 2023-10-14T12:33:57.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.846+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0801f3570 con 0x7fd080159740 2023-10-14T12:33:57.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.847+0000 7fd075ffb700 1 -- 172.21.15.72:0/3642918137 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd070059710 con 0x7fd080159740 2023-10-14T12:33:57.849 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:33:57.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06406af00 msgr2=0x7fd06406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06406af00 0x7fd06406d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd07c000c00 tx=0x7fd07c009040 comp rx=0 tx=0).stop 2023-10-14T12:33:57.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd080159740 msgr2=0x7fd0801f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd080159740 0x7fd0801f64e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00c080 tx=0x7fd0700047c0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 shutdown_connections 2023-10-14T12:33:57.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd06406af00 0x7fd06406d3c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0801f3720 0x7fd0800ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd06c004850 0x7fd0800b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 --2- 172.21.15.72:0/3642918137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd080159740 0x7fd0801f64e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 >> 172.21.15.72:0/3642918137 conn(0x7fd0800d0180 msgr2=0x7fd08006d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:57.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 shutdown_connections 2023-10-14T12:33:57.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.849+0000 7fd0877ce700 1 -- 172.21.15.72:0/3642918137 wait complete. 2023-10-14T12:33:57.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:33:57.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.983+0000 7f931acaf700 1 Processor -- start 2023-10-14T12:33:57.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.983+0000 7f931acaf700 1 -- start start 2023-10-14T12:33:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f931acaf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931415d730 0x7f931406b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f931acaf700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f931406e400 0x7f93140cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f931acaf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93140cde90 con 0x7f93140cda40 2023-10-14T12:33:57.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f931acaf700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931406c220 con 0x7f931406e400 2023-10-14T12:33:57.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f931acaf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931406b770 con 0x7f931415d730 2023-10-14T12:33:57.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f931924c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f93140cda40 0x7f93141611c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53462/0 (socket says 172.21.15.72:53462) 2023-10-14T12:33:57.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f931924c700 1 -- 172.21.15.72:0/3216398510 learned_addr learned my addr 172.21.15.72:0/3216398510 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:57.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f9318a4b700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931415d730 0x7f931406b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f9313fff700 1 --2- 172.21.15.72:0/3216398510 >> v2:172.21.15.123:3300/0 conn(0x7f931406e400 0x7f93140cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937301435 0 0) 0x7f930c001490 con 0x7f93140cda40 2023-10-14T12:33:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.984+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93040035b0 con 0x7f93140cda40 2023-10-14T12:33:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2914264680 0 0) 0x7f93040035b0 con 0x7f93140cda40 2023-10-14T12:33:57.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931415d730 msgr2=0x7f931406b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931415d730 0x7f931406b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 >> v2:172.21.15.123:3300/0 conn(0x7f931406e400 msgr2=0x7f93140cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 --2- 172.21.15.72:0/3216398510 >> v2:172.21.15.123:3300/0 conn(0x7f931406e400 0x7f93140cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931406b980 con 0x7f93140cda40 2023-10-14T12:33:57.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f930c001b80 con 0x7f93140cda40 2023-10-14T12:33:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f9313fff700 1 --2- 172.21.15.72:0/3216398510 >> v2:172.21.15.123:3300/0 conn(0x7f931406e400 0x7f93140cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f9318a4b700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931415d730 0x7f931406b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:33:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 >> v1:172.21.15.72:6789/0 conn(0x7f93140cda40 legacy=0x7f93141611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931415d730 0x7f9304003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9304003f40 0x7f9304004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f9304005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931406c220 con 0x7f9304004d90 2023-10-14T12:33:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931406b770 con 0x7f9304003f40 2023-10-14T12:33:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930400ba10 con 0x7f931415d730 2023-10-14T12:33:57.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f931924c700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f9304005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f9318a4b700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931415d730 0x7f9304003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f9313fff700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9304003f40 0x7f9304004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f931924c700 1 -- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931415d730 msgr2=0x7f9304003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f931924c700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f931415d730 0x7f9304003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f931924c700 1 -- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9304003f40 msgr2=0x7f9304004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:57.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f931924c700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9304003f40 0x7f9304004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:57.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f931924c700 1 -- 172.21.15.72:0/3216398510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080094a0 con 0x7f9304004d90 2023-10-14T12:33:57.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f931924c700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f9304005210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f930c00a830 tx=0x7f9304005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1e256e4be1c262 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:57.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c012600 con 0x7f9304004d90 2023-10-14T12:33:57.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c012780 con 0x7f9304004d90 2023-10-14T12:33:57.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.985+0000 7f93137fe700 1 -- 172.21.15.72:0/3216398510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c012b30 con 0x7f9304004d90 2023-10-14T12:33:57.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.986+0000 7f931acaf700 1 -- 172.21.15.72:0/3216398510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 msgr2=0x7f9304005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:57.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.986+0000 7f931acaf700 1 --2- 172.21.15.72:0/3216398510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f9304005210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f930c00a830 tx=0x7f9304005880 comp rx=0 tx=0).stop 2023-10-14T12:33:57.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.986+0000 7f931924c700 1 -- 172.21.15.72:0/3216398510 reap_dead start 2023-10-14T12:33:57.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.986+0000 7f931acaf700 1 -- 172.21.15.72:0/3216398510 shutdown_connections 2023-10-14T12:33:57.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.986+0000 7f931acaf700 1 -- 172.21.15.72:0/3216398510 >> 172.21.15.72:0/3216398510 conn(0x7f93140b14b0 msgr2=0x7f93140b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:58.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.986+0000 7f931acaf700 1 -- 172.21.15.72:0/3216398510 shutdown_connections 2023-10-14T12:33:58.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.986+0000 7f931acaf700 1 -- 172.21.15.72:0/3216398510 wait complete. 2023-10-14T12:33:58.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.987+0000 7f931acaf700 1 Processor -- start 2023-10-14T12:33:58.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.987+0000 7f931acaf700 1 -- start start 2023-10-14T12:33:58.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f931acaf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f93140b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f931acaf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93141f3e30 0x7f93140c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f931acaf700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9314157a20 0x7f9314157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f931acaf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93141f7620 con 0x7f9304004d90 2023-10-14T12:33:58.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f931acaf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93141583e0 con 0x7f93141f3e30 2023-10-14T12:33:58.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f931acaf700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93141f69a0 con 0x7f9314157a20 2023-10-14T12:33:58.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f9318a4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f93140b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f9318a4b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f93140b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47172/0 (socket says 172.21.15.72:47172) 2023-10-14T12:33:58.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f9318a4b700 1 -- 172.21.15.72:0/787030532 learned_addr learned my addr 172.21.15.72:0/787030532 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:58.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f9313fff700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93141f3e30 0x7f93140c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.988+0000 7f931924c700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9314157a20 0x7f9314157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f9318a4b700 1 -- 172.21.15.72:0/787030532 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9314157a20 msgr2=0x7f9314157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f9318a4b700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9314157a20 0x7f9314157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f9318a4b700 1 -- 172.21.15.72:0/787030532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93141f3e30 msgr2=0x7f93140c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f9318a4b700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93141f3e30 0x7f93140c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f9318a4b700 1 -- 172.21.15.72:0/787030532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93141f6c80 con 0x7f9304004d90 2023-10-14T12:33:58.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f9318a4b700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f93140b4fd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9308011cd0 tx=0x7f9308009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:58.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f93117fa700 1 -- 172.21.15.72:0/787030532 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930800fa00 con 0x7f9304004d90 2023-10-14T12:33:58.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f93117fa700 1 -- 172.21.15.72:0/787030532 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930800fb60 con 0x7f9304004d90 2023-10-14T12:33:58.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93141f6f60 con 0x7f9304004d90 2023-10-14T12:33:58.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f93117fa700 1 -- 172.21.15.72:0/787030532 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308004020 con 0x7f9304004d90 2023-10-14T12:33:58.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.989+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93141f4290 con 0x7f9304004d90 2023-10-14T12:33:58.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.990+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93141f7760 con 0x7f9304004d90 2023-10-14T12:33:58.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.990+0000 7f93117fa700 1 -- 172.21.15.72:0/787030532 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9308004180 con 0x7f9304004d90 2023-10-14T12:33:58.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.991+0000 7f93117fa700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f92f806af30 0x7f92f806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.991+0000 7f93117fa700 1 -- 172.21.15.72:0/787030532 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9308089d70 con 0x7f9304004d90 2023-10-14T12:33:58.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.991+0000 7f9313fff700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f92f806af30 0x7f92f806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.991+0000 7f9313fff700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f92f806af30 0x7f92f806d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93140b5670 tx=0x7f9300009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:58.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:57.995+0000 7f93117fa700 1 -- 172.21.15.72:0/787030532 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f93141f7760 con 0x7f9304004d90 2023-10-14T12:33:58.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.184+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93141f7760 con 0x7f9304004d90 2023-10-14T12:33:58.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.184+0000 7f93117fa700 1 -- 172.21.15.72:0/787030532 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f93141f7760 con 0x7f9304004d90 2023-10-14T12:33:58.186 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.186+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f92f806af30 msgr2=0x7f92f806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.186+0000 7f931acaf700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f92f806af30 0x7f92f806d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93140b5670 tx=0x7f9300009210 comp rx=0 tx=0).stop 2023-10-14T12:33:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.186+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 msgr2=0x7f93140b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.187+0000 7f931acaf700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f93140b4fd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9308011cd0 tx=0x7f9308009ed0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.187+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 shutdown_connections 2023-10-14T12:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.187+0000 7f931acaf700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f92f806af30 0x7f92f806d3f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.187+0000 7f931acaf700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9314157a20 0x7f9314157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.187+0000 7f931acaf700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9304004d90 0x7f93140b4fd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.187+0000 7f931acaf700 1 --2- 172.21.15.72:0/787030532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93141f3e30 0x7f93140c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.187+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 >> 172.21.15.72:0/787030532 conn(0x7f93140b14b0 msgr2=0x7f93140aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.187+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 shutdown_connections 2023-10-14T12:33:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.187+0000 7f931acaf700 1 -- 172.21.15.72:0/787030532 wait complete. 2023-10-14T12:33:58.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:33:58.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.322+0000 7f5d092f2700 1 Processor -- start 2023-10-14T12:33:58.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.322+0000 7f5d092f2700 1 -- start start 2023-10-14T12:33:58.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d092f2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d0415d760 0x7f5d040b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d092f2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d0406b7e0 0x7f5d0406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d092f2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d040cf420 con 0x7f5d040ce0a0 2023-10-14T12:33:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d092f2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d040b95a0 con 0x7f5d0406b7e0 2023-10-14T12:33:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d092f2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0406c1b0 con 0x7f5d0415d760 2023-10-14T12:33:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d037fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5d0406b7e0 0x7f5d0406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d027fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5d040ce0a0 0x7f5d040cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53482/0 (socket says 172.21.15.72:53482) 2023-10-14T12:33:58.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d027fc700 1 -- 172.21.15.72:0/1059053802 learned_addr learned my addr 172.21.15.72:0/1059053802 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:58.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d02ffd700 1 --2- 172.21.15.72:0/1059053802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d0415d760 0x7f5d040b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d037fe700 1 -- 172.21.15.72:0/1059053802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d0415d760 msgr2=0x7f5d040b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:58.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d037fe700 1 --2- 172.21.15.72:0/1059053802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d0415d760 0x7f5d040b9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d037fe700 1 -- 172.21.15.72:0/1059053802 >> v1:172.21.15.72:6789/0 conn(0x7f5d040ce0a0 legacy=0x7f5d040cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d037fe700 1 -- 172.21.15.72:0/1059053802 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d040ce810 con 0x7f5d0406b7e0 2023-10-14T12:33:58.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d01ffb700 1 -- 172.21.15.72:0/1059053802 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117196363 0 0) 0x7f5d040cf420 con 0x7f5d040ce0a0 2023-10-14T12:33:58.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.323+0000 7f5d037fe700 1 --2- 172.21.15.72:0/1059053802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0406b7e0 0x7f5d0406bc70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009d90 tx=0x7f5cfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3c8f1c7cbea9fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:58.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d01ffb700 1 -- 172.21.15.72:0/1059053802 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00e070 con 0x7f5d0406b7e0 2023-10-14T12:33:58.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d01ffb700 1 -- 172.21.15.72:0/1059053802 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc00bbd0 con 0x7f5d0406b7e0 2023-10-14T12:33:58.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d01ffb700 1 -- 172.21.15.72:0/1059053802 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc012430 con 0x7f5d0406b7e0 2023-10-14T12:33:58.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d092f2700 1 -- 172.21.15.72:0/1059053802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0406b7e0 msgr2=0x7f5d0406bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d092f2700 1 --2- 172.21.15.72:0/1059053802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0406b7e0 0x7f5d0406bc70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009d90 tx=0x7f5cfc00b330 comp rx=0 tx=0).stop 2023-10-14T12:33:58.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d092f2700 1 -- 172.21.15.72:0/1059053802 shutdown_connections 2023-10-14T12:33:58.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d092f2700 1 --2- 172.21.15.72:0/1059053802 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0406b7e0 0x7f5d0406bc70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d092f2700 1 --2- 172.21.15.72:0/1059053802 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d0415d760 0x7f5d040b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d092f2700 1 -- 172.21.15.72:0/1059053802 >> 172.21.15.72:0/1059053802 conn(0x7f5d04072340 msgr2=0x7f5d04072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:58.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d092f2700 1 -- 172.21.15.72:0/1059053802 shutdown_connections 2023-10-14T12:33:58.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.324+0000 7f5d092f2700 1 -- 172.21.15.72:0/1059053802 wait complete. 2023-10-14T12:33:58.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.325+0000 7f5d092f2700 1 Processor -- start 2023-10-14T12:33:58.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.325+0000 7f5d092f2700 1 -- start start 2023-10-14T12:33:58.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d092f2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d0406b7e0 0x7f5d04160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d092f2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d040ce0a0 0x7f5d04150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d092f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0415d760 0x7f5d0415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d092f2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0415efa0 con 0x7f5d0415d760 2023-10-14T12:33:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d092f2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0415f280 con 0x7f5d0406b7e0 2023-10-14T12:33:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d092f2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0415f560 con 0x7f5d040ce0a0 2023-10-14T12:33:58.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0415d760 0x7f5d0415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0415d760 0x7f5d0415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47190/0 (socket says 172.21.15.72:47190) 2023-10-14T12:33:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d037fe700 1 -- 172.21.15.72:0/2132124148 learned_addr learned my addr 172.21.15.72:0/2132124148 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d02ffd700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d0406b7e0 0x7f5d04160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.326+0000 7f5d027fc700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d040ce0a0 0x7f5d04150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5d037fe700 1 -- 172.21.15.72:0/2132124148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d040ce0a0 msgr2=0x7f5d04150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5d037fe700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d040ce0a0 0x7f5d04150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5d037fe700 1 -- 172.21.15.72:0/2132124148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d0406b7e0 msgr2=0x7f5d04160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5d037fe700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d0406b7e0 0x7f5d04160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5d037fe700 1 -- 172.21.15.72:0/2132124148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc009a70 con 0x7f5d0415d760 2023-10-14T12:33:58.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5d02ffd700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d0406b7e0 0x7f5d04160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:33:58.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5d037fe700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0415d760 0x7f5d0415e500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d0406c4f0 tx=0x7f5cfc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:58.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5ceb7fe700 1 -- 172.21.15.72:0/2132124148 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc012430 con 0x7f5d0415d760 2023-10-14T12:33:58.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5ceb7fe700 1 -- 172.21.15.72:0/2132124148 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc020070 con 0x7f5d0415d760 2023-10-14T12:33:58.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0415f840 con 0x7f5d0415d760 2023-10-14T12:33:58.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5ceb7fe700 1 -- 172.21.15.72:0/2132124148 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc004280 con 0x7f5d0415d760 2023-10-14T12:33:58.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.327+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d04150dd0 con 0x7f5d0415d760 2023-10-14T12:33:58.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.328+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0415fd60 con 0x7f5d0415d760 2023-10-14T12:33:58.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.328+0000 7f5ceb7fe700 1 -- 172.21.15.72:0/2132124148 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5cfc0043e0 con 0x7f5d0415d760 2023-10-14T12:33:58.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.329+0000 7f5ceb7fe700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5cf006af00 0x7f5cf006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.329+0000 7f5ceb7fe700 1 -- 172.21.15.72:0/2132124148 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5cfc022070 con 0x7f5d0415d760 2023-10-14T12:33:58.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.329+0000 7f5d02ffd700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5cf006af00 0x7f5cf006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.329+0000 7f5d02ffd700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5cf006af00 0x7f5cf006d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007a50 tx=0x7f5cf8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:58.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.333+0000 7f5ceb7fe700 1 -- 172.21.15.72:0/2132124148 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d0415fd60 con 0x7f5d0415d760 2023-10-14T12:33:58.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.527+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5d0415fd60 con 0x7f5d0415d760 2023-10-14T12:33:58.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.527+0000 7f5ceb7fe700 1 -- 172.21.15.72:0/2132124148 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5d0415fd60 con 0x7f5d0415d760 2023-10-14T12:33:58.529 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:33:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5cf006af00 msgr2=0x7f5cf006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5cf006af00 0x7f5cf006d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8007a50 tx=0x7f5cf8008040 comp rx=0 tx=0).stop 2023-10-14T12:33:58.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0415d760 msgr2=0x7f5d0415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0415d760 0x7f5d0415e500 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5d0406c4f0 tx=0x7f5cfc004ad0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 shutdown_connections 2023-10-14T12:33:58.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5cf006af00 0x7f5cf006d3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d0415d760 0x7f5d0415e500 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d0406b7e0 0x7f5d04160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 --2- 172.21.15.72:0/2132124148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5d040ce0a0 0x7f5d04150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 >> 172.21.15.72:0/2132124148 conn(0x7f5d04072340 msgr2=0x7f5d040b7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:58.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 shutdown_connections 2023-10-14T12:33:58.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.529+0000 7f5d092f2700 1 -- 172.21.15.72:0/2132124148 wait complete. 2023-10-14T12:33:58.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:33:58.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.662+0000 7fe7fb170700 1 Processor -- start 2023-10-14T12:33:58.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.663+0000 7fe7fb170700 1 -- start start 2023-10-14T12:33:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.663+0000 7fe7fb170700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7f4152470 0x7fe7f40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.663+0000 7fe7fb170700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7f40b3410 0x7fe7f40b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.663+0000 7fe7fb170700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f4070d70 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.663+0000 7fe7fb170700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f4071200 con 0x7fe7f40b3410 2023-10-14T12:33:58.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.663+0000 7fe7fb170700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f40cbd80 con 0x7fe7f4152470 2023-10-14T12:33:58.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.663+0000 7fe7f970d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7f40b3410 0x7fe7f40b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.663+0000 7fe7f3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe7f40cb8d0 0x7fe7f40b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53494/0 (socket says 172.21.15.72:53494) 2023-10-14T12:33:58.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.663+0000 7fe7f3fff700 1 -- 172.21.15.72:0/3651936456 learned_addr learned my addr 172.21.15.72:0/3651936456 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:58.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f8f0c700 1 --2- 172.21.15.72:0/3651936456 >> v2:172.21.15.123:3300/0 conn(0x7fe7f4152470 0x7fe7f40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f970d700 1 -- 172.21.15.72:0/3651936456 >> v2:172.21.15.123:3300/0 conn(0x7fe7f4152470 msgr2=0x7fe7f40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:58.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f970d700 1 --2- 172.21.15.72:0/3651936456 >> v2:172.21.15.123:3300/0 conn(0x7fe7f4152470 0x7fe7f40cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f970d700 1 -- 172.21.15.72:0/3651936456 >> v1:172.21.15.72:6789/0 conn(0x7fe7f40cb8d0 legacy=0x7fe7f40b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f970d700 1 -- 172.21.15.72:0/3651936456 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f4070440 con 0x7fe7f40b3410 2023-10-14T12:33:58.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f37fe700 1 -- 172.21.15.72:0/3651936456 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656497286 0 0) 0x7fe7f4070d70 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f970d700 1 --2- 172.21.15.72:0/3651936456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40b3410 0x7fe7f40b60f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4071460 tx=0x7fe7ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806bbaf43fd135cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f37fe700 1 -- 172.21.15.72:0/3651936456 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec00e070 con 0x7fe7f40b3410 2023-10-14T12:33:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f37fe700 1 -- 172.21.15.72:0/3651936456 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ec00bbd0 con 0x7fe7f40b3410 2023-10-14T12:33:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.664+0000 7fe7f37fe700 1 -- 172.21.15.72:0/3651936456 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec012430 con 0x7fe7f40b3410 2023-10-14T12:33:58.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.665+0000 7fe7fb170700 1 -- 172.21.15.72:0/3651936456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40b3410 msgr2=0x7fe7f40b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.665+0000 7fe7fb170700 1 --2- 172.21.15.72:0/3651936456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40b3410 0x7fe7f40b60f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4071460 tx=0x7fe7ec00b330 comp rx=0 tx=0).stop 2023-10-14T12:33:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.665+0000 7fe7fb170700 1 -- 172.21.15.72:0/3651936456 shutdown_connections 2023-10-14T12:33:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.665+0000 7fe7fb170700 1 --2- 172.21.15.72:0/3651936456 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40b3410 0x7fe7f40b60f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.665+0000 7fe7fb170700 1 --2- 172.21.15.72:0/3651936456 >> v2:172.21.15.123:3300/0 conn(0x7fe7f4152470 0x7fe7f40cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.665+0000 7fe7fb170700 1 -- 172.21.15.72:0/3651936456 >> 172.21.15.72:0/3651936456 conn(0x7fe7f40cdd00 msgr2=0x7fe7f40ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:58.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.665+0000 7fe7fb170700 1 -- 172.21.15.72:0/3651936456 shutdown_connections 2023-10-14T12:33:58.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.665+0000 7fe7fb170700 1 -- 172.21.15.72:0/3651936456 wait complete. 2023-10-14T12:33:58.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.666+0000 7fe7fb170700 1 Processor -- start 2023-10-14T12:33:58.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.666+0000 7fe7fb170700 1 -- start start 2023-10-14T12:33:58.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7fb170700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b3410 0x7fe7f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7fb170700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40cb8d0 0x7fe7f40b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7fb170700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7f4152470 0x7fe7f40b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7fb170700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f40b65d0 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7fb170700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f41536e0 con 0x7fe7f40b3410 2023-10-14T12:33:58.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7fb170700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f4152ad0 con 0x7fe7f4152470 2023-10-14T12:33:58.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40cb8d0 0x7fe7f40b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40cb8d0 0x7fe7f40b3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47202/0 (socket says 172.21.15.72:47202) 2023-10-14T12:33:58.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f3fff700 1 -- 172.21.15.72:0/295467877 learned_addr learned my addr 172.21.15.72:0/295467877 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:58.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f8f0c700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b3410 0x7fe7f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f970d700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7f4152470 0x7fe7f40b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f3fff700 1 -- 172.21.15.72:0/295467877 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7f4152470 msgr2=0x7fe7f40b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f3fff700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7f4152470 0x7fe7f40b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f3fff700 1 -- 172.21.15.72:0/295467877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b3410 msgr2=0x7fe7f40b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f3fff700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b3410 0x7fe7f40b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f3fff700 1 -- 172.21.15.72:0/295467877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec009a70 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f3fff700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40cb8d0 0x7fe7f40b3fc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00011e0 tx=0x7fe7e000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:58.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f17fa700 1 -- 172.21.15.72:0/295467877 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0004c80 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7f17fa700 1 -- 172.21.15.72:0/295467877 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e0004e00 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.667+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f4152db0 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.668+0000 7fe7f17fa700 1 -- 172.21.15.72:0/295467877 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0007310 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.668+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f4153370 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.668+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f404ebb0 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.669+0000 7fe7f17fa700 1 -- 172.21.15.72:0/295467877 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe7e0007470 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.669+0000 7fe7f17fa700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7d806af00 0x7fe7d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:58.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.669+0000 7fe7f8f0c700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7d806af00 0x7fe7d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:58.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.669+0000 7fe7f17fa700 1 -- 172.21.15.72:0/295467877 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7e00896d0 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.670+0000 7fe7f8f0c700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7d806af00 0x7fe7d806d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009930 tx=0x7fe7e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:58.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.674+0000 7fe7f17fa700 1 -- 172.21.15.72:0/295467877 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7e0054400 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.906+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7f4153820 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.906+0000 7fe7f17fa700 1 -- 172.21.15.72:0/295467877 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fe7e0057a20 con 0x7fe7f40cb8d0 2023-10-14T12:33:58.908 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:58.908 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:47.920500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:33:58.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7d806af00 msgr2=0x7fe7d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7d806af00 0x7fe7d806d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8009930 tx=0x7fe7e8008040 comp rx=0 tx=0).stop 2023-10-14T12:33:58.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40cb8d0 msgr2=0x7fe7f40b3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:58.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40cb8d0 0x7fe7f40b3fc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe7e00011e0 tx=0x7fe7e000cae0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 shutdown_connections 2023-10-14T12:33:58.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7d806af00 0x7fe7d806d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7f4152470 0x7fe7f40b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f40b3410 0x7fe7f40b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 --2- 172.21.15.72:0/295467877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7f40cb8d0 0x7fe7f40b3fc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:58.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 >> 172.21.15.72:0/295467877 conn(0x7fe7f40cdd00 msgr2=0x7fe7f40ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:58.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 shutdown_connections 2023-10-14T12:33:58.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:58.908+0000 7fe7fb170700 1 -- 172.21.15.72:0/295467877 wait complete. 2023-10-14T12:33:58.912 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-10-14T12:33:58.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:33:59.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.039+0000 7f6bc3b56700 1 Processor -- start 2023-10-14T12:33:59.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.040+0000 7f6bc3b56700 1 -- start start 2023-10-14T12:33:59.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc3b56700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0b3410 0x7f6bbc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc3b56700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bbc15e390 0x7f6bbc15a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc3b56700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc15ebc0 con 0x7f6bbc1428c0 2023-10-14T12:33:59.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc3b56700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc161ce0 con 0x7f6bbc15e390 2023-10-14T12:33:59.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc3b56700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc162170 con 0x7f6bbc0b3410 2023-10-14T12:33:59.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc20f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bbc15e390 0x7f6bbc15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc20f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bbc15e390 0x7f6bbc15a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47212/0 (socket says 172.21.15.72:47212) 2023-10-14T12:33:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc20f3700 1 -- 172.21.15.72:0/2677872985 learned_addr learned my addr 172.21.15.72:0/2677872985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc10f1700 1 --2- 172.21.15.72:0/2677872985 >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0b3410 0x7f6bbc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc20f3700 1 -- 172.21.15.72:0/2677872985 >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0b3410 msgr2=0x7f6bbc15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:59.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc20f3700 1 --2- 172.21.15.72:0/2677872985 >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0b3410 0x7f6bbc15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc20f3700 1 -- 172.21.15.72:0/2677872985 >> v1:172.21.15.123:6789/0 conn(0x7f6bbc1428c0 legacy=0x7f6bbc0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc20f3700 1 -- 172.21.15.72:0/2677872985 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc1613b0 con 0x7f6bbc15e390 2023-10-14T12:33:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc20f3700 1 --2- 172.21.15.72:0/2677872985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc15e390 0x7f6bbc15a860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc1611e0 tx=0x7f6bb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4164a9ab69ecd61a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc08f0700 1 -- 172.21.15.72:0/2677872985 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400e070 con 0x7f6bbc15e390 2023-10-14T12:33:59.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc08f0700 1 -- 172.21.15.72:0/2677872985 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb400b9c0 con 0x7f6bbc15e390 2023-10-14T12:33:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.041+0000 7f6bc08f0700 1 -- 172.21.15.72:0/2677872985 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400bd70 con 0x7f6bbc15e390 2023-10-14T12:33:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.042+0000 7f6bc3b56700 1 -- 172.21.15.72:0/2677872985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc15e390 msgr2=0x7f6bbc15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.042+0000 7f6bc3b56700 1 --2- 172.21.15.72:0/2677872985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc15e390 0x7f6bbc15a860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc1611e0 tx=0x7f6bb400b330 comp rx=0 tx=0).stop 2023-10-14T12:33:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.042+0000 7f6bc3b56700 1 -- 172.21.15.72:0/2677872985 shutdown_connections 2023-10-14T12:33:59.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.042+0000 7f6bc3b56700 1 --2- 172.21.15.72:0/2677872985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc15e390 0x7f6bbc15a860 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.042+0000 7f6bc3b56700 1 --2- 172.21.15.72:0/2677872985 >> v2:172.21.15.123:3300/0 conn(0x7f6bbc0b3410 0x7f6bbc15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.042+0000 7f6bc3b56700 1 -- 172.21.15.72:0/2677872985 >> 172.21.15.72:0/2677872985 conn(0x7f6bbc0cdd00 msgr2=0x7f6bbc0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:59.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.042+0000 7f6bc3b56700 1 -- 172.21.15.72:0/2677872985 shutdown_connections 2023-10-14T12:33:59.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.042+0000 7f6bc3b56700 1 -- 172.21.15.72:0/2677872985 wait complete. 2023-10-14T12:33:59.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.043+0000 7f6bc3b56700 1 Processor -- start 2023-10-14T12:33:59.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.043+0000 7f6bc3b56700 1 -- start start 2023-10-14T12:33:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc3b56700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bbc0b3410 0x7f6bbc1f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc3b56700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc1428c0 0x7f6bbc0aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc3b56700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc15e390 0x7f6bbc0d1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc3b56700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0aca60 con 0x7f6bbc1428c0 2023-10-14T12:33:59.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc3b56700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0acd40 con 0x7f6bbc0b3410 2023-10-14T12:33:59.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc3b56700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0ad020 con 0x7f6bbc15e390 2023-10-14T12:33:59.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc10f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc1428c0 0x7f6bbc0aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc10f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc1428c0 0x7f6bbc0aff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47216/0 (socket says 172.21.15.72:47216) 2023-10-14T12:33:59.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc10f1700 1 -- 172.21.15.72:0/67553162 learned_addr learned my addr 172.21.15.72:0/67553162 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:59.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc18f2700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bbc0b3410 0x7f6bbc1f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc20f3700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc15e390 0x7f6bbc0d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc10f1700 1 -- 172.21.15.72:0/67553162 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc15e390 msgr2=0x7f6bbc0d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc10f1700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc15e390 0x7f6bbc0d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc10f1700 1 -- 172.21.15.72:0/67553162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bbc0b3410 msgr2=0x7f6bbc1f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc10f1700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bbc0b3410 0x7f6bbc1f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc10f1700 1 -- 172.21.15.72:0/67553162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4009b30 con 0x7f6bbc1428c0 2023-10-14T12:33:59.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.044+0000 7f6bc10f1700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc1428c0 0x7f6bbc0aff70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800e810 tx=0x7f6bb800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:59.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.045+0000 7f6bb27fc700 1 -- 172.21.15.72:0/67553162 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800c070 con 0x7f6bbc1428c0 2023-10-14T12:33:59.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.045+0000 7f6bb27fc700 1 -- 172.21.15.72:0/67553162 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8013610 con 0x7f6bbc1428c0 2023-10-14T12:33:59.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.045+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc0ad300 con 0x7f6bbc1428c0 2023-10-14T12:33:59.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.045+0000 7f6bb27fc700 1 -- 172.21.15.72:0/67553162 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80139c0 con 0x7f6bbc1428c0 2023-10-14T12:33:59.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.045+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc151ad0 con 0x7f6bbc1428c0 2023-10-14T12:33:59.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.046+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc0ad950 con 0x7f6bbc1428c0 2023-10-14T12:33:59.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.046+0000 7f6bb27fc700 1 -- 172.21.15.72:0/67553162 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6bb8013b20 con 0x7f6bbc1428c0 2023-10-14T12:33:59.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.046+0000 7f6bb27fc700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6ba006af00 0x7f6ba006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.046+0000 7f6bb27fc700 1 -- 172.21.15.72:0/67553162 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6bb80895d0 con 0x7f6bbc1428c0 2023-10-14T12:33:59.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.046+0000 7f6bc18f2700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6ba006af00 0x7f6ba006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.047+0000 7f6bc18f2700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6ba006af00 0x7f6ba006d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007fd0 tx=0x7f6bac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:59.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.051+0000 7f6bb27fc700 1 -- 172.21.15.72:0/67553162 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6bb80543a0 con 0x7f6bbc1428c0 2023-10-14T12:33:59.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.239+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bbc04ebb0 con 0x7f6bbc1428c0 2023-10-14T12:33:59.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.241+0000 7f6bb27fc700 1 -- 172.21.15.72:0/67553162 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f6bb80579c0 con 0x7f6bbc1428c0 2023-10-14T12:33:59.242 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:59.243 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:33:59.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6ba006af00 msgr2=0x7f6ba006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6ba006af00 0x7f6ba006d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007fd0 tx=0x7f6bac009040 comp rx=0 tx=0).stop 2023-10-14T12:33:59.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc1428c0 msgr2=0x7f6bbc0aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc1428c0 0x7f6bbc0aff70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800e810 tx=0x7f6bb800eb20 comp rx=0 tx=0).stop 2023-10-14T12:33:59.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 shutdown_connections 2023-10-14T12:33:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6ba006af00 0x7f6ba006d3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6bbc15e390 0x7f6bbc0d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bbc0b3410 0x7f6bbc1f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 --2- 172.21.15.72:0/67553162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bbc1428c0 0x7f6bbc0aff70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 >> 172.21.15.72:0/67553162 conn(0x7f6bbc0cdd00 msgr2=0x7f6bbc15d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:59.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 shutdown_connections 2023-10-14T12:33:59.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.243+0000 7f6bc3b56700 1 -- 172.21.15.72:0/67553162 wait complete. 2023-10-14T12:33:59.258 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:33:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.378+0000 7fb04747a700 1 Processor -- start 2023-10-14T12:33:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.378+0000 7fb04747a700 1 -- start start 2023-10-14T12:33:59.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb04747a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb04006a820 0x7fb0400cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb04747a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb0400ca7d0 0x7fb040071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb04747a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0400cfeb0 con 0x7fb04015e7f0 2023-10-14T12:33:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb04747a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0400ce410 con 0x7fb0400ca7d0 2023-10-14T12:33:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb04747a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04015ec70 con 0x7fb04006a820 2023-10-14T12:33:59.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb044a15700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb04015e7f0 0x7fb04006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53522/0 (socket says 172.21.15.72:53522) 2023-10-14T12:33:59.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb044a15700 1 -- 172.21.15.72:0/2382089587 learned_addr learned my addr 172.21.15.72:0/2382089587 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:33:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb045a17700 1 --2- 172.21.15.72:0/2382089587 >> v2:172.21.15.123:3300/0 conn(0x7fb0400ca7d0 0x7fb040071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb045216700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb04006a820 0x7fb0400cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066965182 0 0) 0x7fb0400cfeb0 con 0x7fb04015e7f0 2023-10-14T12:33:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02c0035b0 con 0x7fb04015e7f0 2023-10-14T12:33:59.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 224300122 0 0) 0x7fb02c0035b0 con 0x7fb04015e7f0 2023-10-14T12:33:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb04006a820 msgr2=0x7fb0400cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb04006a820 0x7fb0400cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 >> v2:172.21.15.123:3300/0 conn(0x7fb0400ca7d0 msgr2=0x7fb040071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 --2- 172.21.15.72:0/2382089587 >> v2:172.21.15.123:3300/0 conn(0x7fb0400ca7d0 0x7fb040071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0400af9d0 con 0x7fb04015e7f0 2023-10-14T12:33:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7fb030001670 con 0x7fb04015e7f0 2023-10-14T12:33:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 >> v1:172.21.15.72:6789/0 conn(0x7fb04015e7f0 legacy=0x7fb04006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb04006a820 0x7fb02c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb02c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c004d90 0x7fb02c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0400ce410 con 0x7fb02c003f80 2023-10-14T12:33:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04015ec70 con 0x7fb02c004d90 2023-10-14T12:33:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.379+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c00ba60 con 0x7fb04006a820 2023-10-14T12:33:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb044a15700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb02c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb045216700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb04006a820 0x7fb02c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb045a17700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c004d90 0x7fb02c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb044a15700 1 -- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb04006a820 msgr2=0x7fb02c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb044a15700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb04006a820 0x7fb02c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb044a15700 1 -- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c004d90 msgr2=0x7fb02c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:33:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb044a15700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb02c004d90 0x7fb02c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb044a15700 1 -- 172.21.15.72:0/2382089587 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0035b0 con 0x7fb02c003f80 2023-10-14T12:33:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb044a15700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb02c004850 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb03000c3a0 tx=0x7fb02c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89f3baf5994d9cc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030007c60 con 0x7fb02c003f80 2023-10-14T12:33:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb030005960 con 0x7fb02c003f80 2023-10-14T12:33:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.380+0000 7fb037fff700 1 -- 172.21.15.72:0/2382089587 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03000cea0 con 0x7fb02c003f80 2023-10-14T12:33:59.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.381+0000 7fb04747a700 1 -- 172.21.15.72:0/2382089587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 msgr2=0x7fb02c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.381+0000 7fb04747a700 1 --2- 172.21.15.72:0/2382089587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb02c004850 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb03000c3a0 tx=0x7fb02c005880 comp rx=0 tx=0).stop 2023-10-14T12:33:59.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.381+0000 7fb045a17700 1 -- 172.21.15.72:0/2382089587 reap_dead start 2023-10-14T12:33:59.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.381+0000 7fb04747a700 1 -- 172.21.15.72:0/2382089587 shutdown_connections 2023-10-14T12:33:59.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.381+0000 7fb04747a700 1 -- 172.21.15.72:0/2382089587 >> 172.21.15.72:0/2382089587 conn(0x7fb0400d0180 msgr2=0x7fb0400d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:59.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.381+0000 7fb04747a700 1 -- 172.21.15.72:0/2382089587 shutdown_connections 2023-10-14T12:33:59.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.381+0000 7fb04747a700 1 -- 172.21.15.72:0/2382089587 wait complete. 2023-10-14T12:33:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.382+0000 7fb04747a700 1 Processor -- start 2023-10-14T12:33:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.382+0000 7fb04747a700 1 -- start start 2023-10-14T12:33:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb04747a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb0401f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb04747a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0400b0e00 0x7fb04006d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb04747a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400c3c90 0x7fb0401f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb04747a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401f6cc0 con 0x7fb02c003f80 2023-10-14T12:33:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb04747a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401f6fa0 con 0x7fb0400c3c90 2023-10-14T12:33:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb04747a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0401f7280 con 0x7fb0400b0e00 2023-10-14T12:33:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045216700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb0401f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045216700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb0401f6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47234/0 (socket says 172.21.15.72:47234) 2023-10-14T12:33:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045216700 1 -- 172.21.15.72:0/3325354393 learned_addr learned my addr 172.21.15.72:0/3325354393 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:33:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045a17700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400c3c90 0x7fb0401f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb044a15700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0400b0e00 0x7fb04006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045216700 1 -- 172.21.15.72:0/3325354393 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0400b0e00 msgr2=0x7fb04006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045216700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0400b0e00 0x7fb04006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045216700 1 -- 172.21.15.72:0/3325354393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400c3c90 msgr2=0x7fb0401f36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045216700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400c3c90 0x7fb0401f36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045216700 1 -- 172.21.15.72:0/3325354393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0401f7560 con 0x7fb02c003f80 2023-10-14T12:33:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb045216700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb0401f6670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0119a0 tx=0x7fb03c011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:59.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb035ffb700 1 -- 172.21.15.72:0/3325354393 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00f780 con 0x7fb02c003f80 2023-10-14T12:33:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb035ffb700 1 -- 172.21.15.72:0/3325354393 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c00f8e0 con 0x7fb02c003f80 2023-10-14T12:33:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0401f3190 con 0x7fb02c003f80 2023-10-14T12:33:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.383+0000 7fb035ffb700 1 -- 172.21.15.72:0/3325354393 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00fc70 con 0x7fb02c003f80 2023-10-14T12:33:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.384+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04006da90 con 0x7fb02c003f80 2023-10-14T12:33:59.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.384+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0401f3500 con 0x7fb02c003f80 2023-10-14T12:33:59.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.385+0000 7fb035ffb700 1 -- 172.21.15.72:0/3325354393 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb03c014440 con 0x7fb02c003f80 2023-10-14T12:33:59.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.385+0000 7fb035ffb700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:33:59.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.385+0000 7fb035ffb700 1 -- 172.21.15.72:0/3325354393 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb03c089de0 con 0x7fb02c003f80 2023-10-14T12:33:59.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.385+0000 7fb044a15700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:33:59.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.386+0000 7fb044a15700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb030008fd0 tx=0x7fb03000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:33:59.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.390+0000 7fb035ffb700 1 -- 172.21.15.72:0/3325354393 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb03c054ba0 con 0x7fb02c003f80 2023-10-14T12:33:59.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.629+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb04004ebb0 con 0x7fb02c003f80 2023-10-14T12:33:59.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.629+0000 7fb035ffb700 1 -- 172.21.15.72:0/3325354393 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fb03c0581c0 con 0x7fb02c003f80 2023-10-14T12:33:59.632 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:33:59.632 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:47.920500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:33:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 msgr2=0x7fb02406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb030008fd0 tx=0x7fb03000a000 comp rx=0 tx=0).stop 2023-10-14T12:33:59.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 msgr2=0x7fb0401f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:33:59.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb0401f6670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0119a0 tx=0x7fb03c011cb0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 shutdown_connections 2023-10-14T12:33:59.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400c3c90 0x7fb0401f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb02c003f80 0x7fb0401f6670 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 --2- 172.21.15.72:0/3325354393 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0400b0e00 0x7fb04006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:33:59.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 >> 172.21.15.72:0/3325354393 conn(0x7fb0400d0180 msgr2=0x7fb0400cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:33:59.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 shutdown_connections 2023-10-14T12:33:59.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:33:59.632+0000 7fb04747a700 1 -- 172.21.15.72:0/3325354393 wait complete. 2023-10-14T12:33:59.639 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-10-14T12:34:00.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T12:33:31.210218+0000', 'modified': '2023-10-14T12:33:47.920500+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/3216890106', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6833', 'nonce': 3216890106}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3216890106}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T12:34:00.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T12:34:00.048 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-14T12:34:00.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.168+0000 7fe002d43700 1 Processor -- start 2023-10-14T12:34:00.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.168+0000 7fe002d43700 1 -- start start 2023-10-14T12:34:00.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.168+0000 7fe002d43700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdffc06bf80 0x7fdffc0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.168+0000 7fe002d43700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdffc15dc70 0x7fdffc15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.168+0000 7fe002d43700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc161260 con 0x7fdffc0cd4b0 2023-10-14T12:34:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.168+0000 7fe002d43700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc161b00 con 0x7fdffc15dc70 2023-10-14T12:34:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.168+0000 7fe002d43700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc158120 con 0x7fdffc06bf80 2023-10-14T12:34:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fe0012e0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdffc15dc70 0x7fdffc15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fe0012e0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdffc15dc70 0x7fdffc15e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47244/0 (socket says 172.21.15.72:47244) 2023-10-14T12:34:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fe0012e0700 1 -- 172.21.15.72:0/2451163726 learned_addr learned my addr 172.21.15.72:0/2451163726 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fdffbfff700 1 --2- 172.21.15.72:0/2451163726 >> v2:172.21.15.123:3300/0 conn(0x7fdffc06bf80 0x7fdffc0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fe0012e0700 1 -- 172.21.15.72:0/2451163726 >> v2:172.21.15.123:3300/0 conn(0x7fdffc06bf80 msgr2=0x7fdffc0cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fe0012e0700 1 --2- 172.21.15.72:0/2451163726 >> v2:172.21.15.123:3300/0 conn(0x7fdffc06bf80 0x7fdffc0cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fe0012e0700 1 -- 172.21.15.72:0/2451163726 >> v1:172.21.15.123:6789/0 conn(0x7fdffc0cd4b0 legacy=0x7fdffc06e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fe0012e0700 1 -- 172.21.15.72:0/2451163726 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0cddd0 con 0x7fdffc15dc70 2023-10-14T12:34:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fe0012e0700 1 --2- 172.21.15.72:0/2451163726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc15dc70 0x7fdffc15e0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdffc071fe0 tx=0x7fdff400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1633605f352b1288 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fdffb7fe700 1 -- 172.21.15.72:0/2451163726 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff400e070 con 0x7fdffc15dc70 2023-10-14T12:34:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fdffb7fe700 1 -- 172.21.15.72:0/2451163726 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff4003a20 con 0x7fdffc15dc70 2023-10-14T12:34:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.169+0000 7fdffb7fe700 1 -- 172.21.15.72:0/2451163726 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4003dd0 con 0x7fdffc15dc70 2023-10-14T12:34:00.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.170+0000 7fe002d43700 1 -- 172.21.15.72:0/2451163726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc15dc70 msgr2=0x7fdffc15e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.170+0000 7fe002d43700 1 --2- 172.21.15.72:0/2451163726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc15dc70 0x7fdffc15e0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdffc071fe0 tx=0x7fdff400b330 comp rx=0 tx=0).stop 2023-10-14T12:34:00.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.170+0000 7fe002d43700 1 -- 172.21.15.72:0/2451163726 shutdown_connections 2023-10-14T12:34:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.170+0000 7fe002d43700 1 --2- 172.21.15.72:0/2451163726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc15dc70 0x7fdffc15e0a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.170+0000 7fe002d43700 1 --2- 172.21.15.72:0/2451163726 >> v2:172.21.15.123:3300/0 conn(0x7fdffc06bf80 0x7fdffc0cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.170+0000 7fe002d43700 1 -- 172.21.15.72:0/2451163726 >> 172.21.15.72:0/2451163726 conn(0x7fdffc0cfcd0 msgr2=0x7fdffc0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:00.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.170+0000 7fe002d43700 1 -- 172.21.15.72:0/2451163726 shutdown_connections 2023-10-14T12:34:00.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.170+0000 7fe002d43700 1 -- 172.21.15.72:0/2451163726 wait complete. 2023-10-14T12:34:00.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.171+0000 7fe002d43700 1 Processor -- start 2023-10-14T12:34:00.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.171+0000 7fe002d43700 1 -- start start 2023-10-14T12:34:00.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe002d43700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc06bf80 0x7fdffc14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe002d43700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdffc0cd4b0 0x7fdffc160690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe002d43700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdffc15dc70 0x7fdffc06d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe002d43700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc14eff0 con 0x7fdffc06bf80 2023-10-14T12:34:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe002d43700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0c5780 con 0x7fdffc15dc70 2023-10-14T12:34:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe002d43700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0c5a60 con 0x7fdffc0cd4b0 2023-10-14T12:34:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe000adf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc06bf80 0x7fdffc14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe000adf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc06bf80 0x7fdffc14eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47246/0 (socket says 172.21.15.72:47246) 2023-10-14T12:34:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe000adf700 1 -- 172.21.15.72:0/1439226744 learned_addr learned my addr 172.21.15.72:0/1439226744 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fdffbfff700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdffc0cd4b0 0x7fdffc160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe0012e0700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdffc15dc70 0x7fdffc06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe000adf700 1 -- 172.21.15.72:0/1439226744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdffc0cd4b0 msgr2=0x7fdffc160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe000adf700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdffc0cd4b0 0x7fdffc160690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe000adf700 1 -- 172.21.15.72:0/1439226744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdffc15dc70 msgr2=0x7fdffc06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe000adf700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdffc15dc70 0x7fdffc06d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe000adf700 1 -- 172.21.15.72:0/1439226744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4009b30 con 0x7fdffc06bf80 2023-10-14T12:34:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe0012e0700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdffc15dc70 0x7fdffc06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:00.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe000adf700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc06bf80 0x7fdffc14eab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdff000b4a0 tx=0x7fdff000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fdff97fa700 1 -- 172.21.15.72:0/1439226744 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0011830 con 0x7fdffc06bf80 2023-10-14T12:34:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fdff97fa700 1 -- 172.21.15.72:0/1439226744 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff0011990 con 0x7fdffc06bf80 2023-10-14T12:34:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fe002d43700 1 -- 172.21.15.72:0/1439226744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc0c5d40 con 0x7fdffc06bf80 2023-10-14T12:34:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.172+0000 7fdff97fa700 1 -- 172.21.15.72:0/1439226744 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0011d40 con 0x7fdffc06bf80 2023-10-14T12:34:00.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.173+0000 7fe002d43700 1 -- 172.21.15.72:0/1439226744 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc14f470 con 0x7fdffc06bf80 2023-10-14T12:34:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.174+0000 7fdff97fa700 1 -- 172.21.15.72:0/1439226744 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdff001a400 con 0x7fdffc06bf80 2023-10-14T12:34:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.174+0000 7fdff97fa700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdfe006af00 0x7fdfe006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.174+0000 7fdff97fa700 1 -- 172.21.15.72:0/1439226744 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdff0089590 con 0x7fdffc06bf80 2023-10-14T12:34:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.174+0000 7fdffbfff700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdfe006af00 0x7fdfe006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.175+0000 7fdffbfff700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdfe006af00 0x7fdfe006d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdffc157840 tx=0x7fdfe8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.176+0000 7fe00ef2db80 1 Processor -- start 2023-10-14T12:34:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.176+0000 7fe00ef2db80 1 -- start start 2023-10-14T12:34:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e53975b630 0x55e53975dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e539731010 0x55e5397316c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5396a7c20 con 0x55e539731010 2023-10-14T12:34:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e53968cc10 con 0x55e53975b630 2023-10-14T12:34:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e53968a530 con 0x55e539756220 2023-10-14T12:34:00.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe0012e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e539731010 0x55e5397316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe0012e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e539731010 0x55e5397316c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47258/0 (socket says 172.21.15.72:47258) 2023-10-14T12:34:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe0012e0700 1 -- 172.21.15.72:0/2486552910 learned_addr learned my addr 172.21.15.72:0/2486552910 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe000adf700 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fdffbfff700 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e53975b630 0x55e53975dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe0012e0700 1 -- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 msgr2=0x55e53975da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe0012e0700 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe0012e0700 1 -- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e53975b630 msgr2=0x55e53975dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe0012e0700 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e53975b630 0x55e53975dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe0012e0700 1 -- 172.21.15.72:0/2486552910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5396433a0 con 0x55e539731010 2023-10-14T12:34:00.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fe000adf700 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.177+0000 7fdffbfff700 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e53975b630 0x55e53975dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe0012e0700 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e539731010 0x55e5397316c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdff4004000 tx=0x7fdff4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4f3da1a77420a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fdfe67fc700 1 -- 172.21.15.72:0/2486552910 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff400b980 con 0x55e539731010 2023-10-14T12:34:00.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fdfe67fc700 1 -- 172.21.15.72:0/2486552910 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff400bae0 con 0x55e539731010 2023-10-14T12:34:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fdfe67fc700 1 -- 172.21.15.72:0/2486552910 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff400be70 con 0x55e539731010 2023-10-14T12:34:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe00ef2db80 1 -- 172.21.15.72:0/2486552910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e539731010 msgr2=0x55e5397316c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e539731010 0x55e5397316c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdff4004000 tx=0x7fdff4010000 comp rx=0 tx=0).stop 2023-10-14T12:34:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe00ef2db80 1 -- 172.21.15.72:0/2486552910 shutdown_connections 2023-10-14T12:34:00.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e539731010 0x55e5397316c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/2486552910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e53975b630 0x55e53975dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe00ef2db80 1 -- 172.21.15.72:0/2486552910 >> 172.21.15.72:0/2486552910 conn(0x55e539660d80 msgr2=0x55e53977bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe00ef2db80 1 -- 172.21.15.72:0/2486552910 shutdown_connections 2023-10-14T12:34:00.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.178+0000 7fe00ef2db80 1 -- 172.21.15.72:0/2486552910 wait complete. 2023-10-14T12:34:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.179+0000 7fe00ef2db80 1 -- start start 2023-10-14T12:34:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.179+0000 7fe00ef2db80 1 Processor -- start 2023-10-14T12:34:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 0x55e539755180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e539731b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e539685e20 con 0x55e53975b630 2023-10-14T12:34:00.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5396226c0 con 0x55e539731010 2023-10-14T12:34:00.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e539622360 con 0x55e539756220 2023-10-14T12:34:00.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe00ef2db80 10 client.0 _ll_register_callbacks cb 0x55e53947f7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:34:00.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe0012e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e539731b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe0012e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e539731b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47264/0 (socket says 172.21.15.72:47264) 2023-10-14T12:34:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe0012e0700 1 -- 172.21.15.72:0/40053465 learned_addr learned my addr 172.21.15.72:0/40053465 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe000adf700 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 0x55e539755180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fdffbfff700 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe0012e0700 1 -- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 msgr2=0x55e53975ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe0012e0700 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe0012e0700 1 -- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 msgr2=0x55e539755180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe0012e0700 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 0x55e539755180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.180+0000 7fe0012e0700 1 -- 172.21.15.72:0/40053465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc0cddd0 con 0x55e53975b630 2023-10-14T12:34:00.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe0012e0700 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e539731b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdff400b730 tx=0x7fdff4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7611b13baed0b0b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fdfdb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-10-14T12:34:00.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/40053465 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff401d830 con 0x55e53975b630 2023-10-14T12:34:00.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/40053465 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdff4007020 con 0x55e53975b630 2023-10-14T12:34:00.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe00ef2db80 1 -- 172.21.15.72:0/40053465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5397265b0 con 0x55e53975b630 2023-10-14T12:34:00.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/40053465 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdff401d990 con 0x55e53975b630 2023-10-14T12:34:00.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe00ef2db80 10 client.4773 fetch_fsmap learned FSMap version 9 2023-10-14T12:34:00.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe00ef2db80 1 -- 172.21.15.72:0/40053465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e5394b0d90 con 0x55e53975b630 2023-10-14T12:34:00.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/40053465 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e5397265b0 con 0x55e53975b630 2023-10-14T12:34:00.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/40053465 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fdff4008030 con 0x55e53975b630 2023-10-14T12:34:00.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe00ef2db80 10 client.4773 fetch_fsmap finished waiting for FSMap version 9 2023-10-14T12:34:00.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe00ef2db80 10 client.4773 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:34:00.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe00ef2db80 20 client.4773 populate_metadata read hostname 'smithi072' 2023-10-14T12:34:00.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x55e53978b6e0 0x55e53978bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe00ef2db80 4 client.4773 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T12:34:00.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe00ef2db80 1 -- 172.21.15.72:0/40053465 --> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e53967ee00 con 0x55e53978b6e0 2023-10-14T12:34:00.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.181+0000 7fe000adf700 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x55e53978b6e0 0x55e53978bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.182+0000 7fdfdb7fe700 10 client.4773 ms_handle_connect on v2:172.21.15.123:6833/3216890106 2023-10-14T12:34:00.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.182+0000 7fe000adf700 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x55e53978b6e0 0x55e53978bac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec554af1f6054482 server_cookie=1bf661c2a93f69b4 in_seq=0 out_seq=0 2023-10-14T12:34:00.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.182+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/40053465 <== mds.0 v2:172.21.15.123:6833/3216890106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e53967ee00 con 0x55e53978b6e0 2023-10-14T12:34:00.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.182+0000 7fdfdb7fe700 10 client.4773 handle_command_reply: tid=0 2023-10-14T12:34:00.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.182+0000 7fe00ef2db80 1 client.4773 shutdown 2023-10-14T12:34:00.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.182+0000 7fe00ef2db80 1 -- 172.21.15.72:0/40053465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 msgr2=0x55e539731b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.182+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e539731b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdff400b730 tx=0x7fdff4004b40 comp rx=0 tx=0).stop 2023-10-14T12:34:00.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.182+0000 7fe00ef2db80 1 -- 172.21.15.72:0/40053465 shutdown_connections 2023-10-14T12:34:00.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.183+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x55e53978b6e0 0x55e53978bac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.183+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e539731b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.183+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 0x55e539755180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.183+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/40053465 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.183+0000 7fdfdb7fe700 0 client.4773 ms_handle_reset on v2:172.21.15.123:6833/3216890106 2023-10-14T12:34:00.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.183+0000 7fe00ef2db80 1 -- 172.21.15.72:0/40053465 >> 172.21.15.72:0/40053465 conn(0x55e539660d80 msgr2=0x55e5397313f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:00.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.183+0000 7fe00ef2db80 1 -- 172.21.15.72:0/40053465 shutdown_connections 2023-10-14T12:34:00.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.183+0000 7fe00ef2db80 1 -- 172.21.15.72:0/40053465 wait complete. 2023-10-14T12:34:00.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.183+0000 7fe00ef2db80 20 client.4773 trim_cache size 0 max 16384 2023-10-14T12:34:00.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.200+0000 7fe00ef2db80 1 Processor -- start 2023-10-14T12:34:00.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.200+0000 7fe00ef2db80 1 -- start start 2023-10-14T12:34:00.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.201+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539731010 0x55e539791af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.201+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539756220 0x55e5397315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.201+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.201+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5395068d0 con 0x55e53975b630 2023-10-14T12:34:00.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.201+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5397876d0 con 0x55e539756220 2023-10-14T12:34:00.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.201+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e539757c70 con 0x55e539731010 2023-10-14T12:34:00.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.201+0000 7fe0012e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.201+0000 7fe0012e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47272/0 (socket says 172.21.15.72:47272) 2023-10-14T12:34:00.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.201+0000 7fe0012e0700 1 -- 172.21.15.72:0/1750503786 learned_addr learned my addr 172.21.15.72:0/1750503786 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:00.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fe000adf700 1 --2- 172.21.15.72:0/1750503786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539731010 0x55e539791af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fe0012e0700 1 -- 172.21.15.72:0/1750503786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539731010 msgr2=0x55e539791af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fdffbfff700 1 --2- 172.21.15.72:0/1750503786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539756220 0x55e5397315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fe0012e0700 1 --2- 172.21.15.72:0/1750503786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539731010 0x55e539791af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fe0012e0700 1 -- 172.21.15.72:0/1750503786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539756220 msgr2=0x55e5397315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fe0012e0700 1 --2- 172.21.15.72:0/1750503786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539756220 0x55e5397315e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fe0012e0700 1 -- 172.21.15.72:0/1750503786 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0c8ef0 con 0x55e53975b630 2023-10-14T12:34:00.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fe0012e0700 1 --2- 172.21.15.72:0/1750503786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdff4000f80 tx=0x7fdff4028070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a612e337abbdcc15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fdfe6ffd700 1 -- 172.21.15.72:0/1750503786 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4007020 con 0x55e53975b630 2023-10-14T12:34:00.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fdfe6ffd700 1 -- 172.21.15.72:0/1750503786 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff401d630 con 0x55e53975b630 2023-10-14T12:34:00.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fdfe6ffd700 1 -- 172.21.15.72:0/1750503786 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff401d9e0 con 0x55e53975b630 2023-10-14T12:34:00.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.202+0000 7fe00ef2db80 1 -- 172.21.15.72:0/1750503786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 msgr2=0x55e53972da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/1750503786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdff4000f80 tx=0x7fdff4028070 comp rx=0 tx=0).stop 2023-10-14T12:34:00.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 -- 172.21.15.72:0/1750503786 shutdown_connections 2023-10-14T12:34:00.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/1750503786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/1750503786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539731010 0x55e539791af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/1750503786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539756220 0x55e5397315e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 -- 172.21.15.72:0/1750503786 >> 172.21.15.72:0/1750503786 conn(0x55e539660d80 msgr2=0x55e539760950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 -- 172.21.15.72:0/1750503786 shutdown_connections 2023-10-14T12:34:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 -- 172.21.15.72:0/1750503786 wait complete. 2023-10-14T12:34:00.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 -- start start 2023-10-14T12:34:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.203+0000 7fe00ef2db80 1 Processor -- start 2023-10-14T12:34:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 0x55e5397c8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e539753870 con 0x55e53975b630 2023-10-14T12:34:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5397e0380 con 0x55e539731010 2023-10-14T12:34:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e539733e50 con 0x55e539756220 2023-10-14T12:34:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 10 client.0 _ll_register_callbacks cb 0x7fdff400b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:34:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe0012e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe0012e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47278/0 (socket says 172.21.15.72:47278) 2023-10-14T12:34:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe0012e0700 1 -- 172.21.15.72:0/3582222355 learned_addr learned my addr 172.21.15.72:0/3582222355 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fdffbfff700 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe000adf700 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 0x55e5397c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe0012e0700 1 -- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 msgr2=0x55e53975f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe0012e0700 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe0012e0700 1 -- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 msgr2=0x55e5397c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe0012e0700 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 0x55e5397c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe0012e0700 1 -- 172.21.15.72:0/3582222355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5394b0d90 con 0x55e53975b630 2023-10-14T12:34:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe0012e0700 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdff4014010 tx=0x7fdff401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5513a3ed2491075f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fdfdb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-10-14T12:34:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/3582222355 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff400e040 con 0x55e53975b630 2023-10-14T12:34:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/3582222355 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdff401d9b0 con 0x55e53975b630 2023-10-14T12:34:00.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 1 -- 172.21.15.72:0/3582222355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdff400bae0 con 0x55e53975b630 2023-10-14T12:34:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/3582222355 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdff4044680 con 0x55e53975b630 2023-10-14T12:34:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 10 client.4779 fetch_fsmap learned FSMap version 9 2023-10-14T12:34:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.205+0000 7fe00ef2db80 1 -- 172.21.15.72:0/3582222355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e539499c10 con 0x55e53975b630 2023-10-14T12:34:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/3582222355 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff400bae0 con 0x55e53975b630 2023-10-14T12:34:00.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/3582222355 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fdff4040030 con 0x55e53975b630 2023-10-14T12:34:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fe00ef2db80 10 client.4779 fetch_fsmap finished waiting for FSMap version 9 2023-10-14T12:34:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fe00ef2db80 10 client.4779 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:34:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fe00ef2db80 20 client.4779 populate_metadata read hostname 'smithi072' 2023-10-14T12:34:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x55e5397df1f0 0x55e5397df5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fe00ef2db80 4 client.4779 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T12:34:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fe00ef2db80 1 -- 172.21.15.72:0/3582222355 --> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e53967eb20 con 0x55e5397df1f0 2023-10-14T12:34:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fe000adf700 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x55e5397df1f0 0x55e5397df5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fe000adf700 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x55e5397df1f0 0x55e5397df5d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c2a6f171b1eeae7 server_cookie=8569a2081e7542b4 in_seq=0 out_seq=0 2023-10-14T12:34:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fdfdb7fe700 10 client.4779 ms_handle_connect on v2:172.21.15.123:6833/3216890106 2023-10-14T12:34:00.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fdfdb7fe700 1 -- 172.21.15.72:0/3582222355 <== mds.0 v2:172.21.15.123:6833/3216890106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e53967eb20 con 0x55e5397df1f0 2023-10-14T12:34:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fdfdb7fe700 10 client.4779 handle_command_reply: tid=0 2023-10-14T12:34:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.206+0000 7fe00ef2db80 1 client.4779 shutdown 2023-10-14T12:34:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 -- 172.21.15.72:0/3582222355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 msgr2=0x55e53972da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdff4014010 tx=0x7fdff401d000 comp rx=0 tx=0).stop 2023-10-14T12:34:00.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 -- 172.21.15.72:0/3582222355 shutdown_connections 2023-10-14T12:34:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:6833/3216890106,v1:172.21.15.123:6835/3216890106] conn(0x55e5397df1f0 0x55e5397df5d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55e53975b630 0x55e53972da90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e539731010 0x55e5397c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fdfdb7fe700 0 client.4779 ms_handle_reset on v2:172.21.15.123:6833/3216890106 2023-10-14T12:34:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 --2- 172.21.15.72:0/3582222355 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x55e539756220 0x55e53975f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 -- 172.21.15.72:0/3582222355 >> 172.21.15.72:0/3582222355 conn(0x55e539660d80 msgr2=0x55e5397315e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 -- 172.21.15.72:0/3582222355 shutdown_connections 2023-10-14T12:34:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 1 -- 172.21.15.72:0/3582222355 wait complete. 2023-10-14T12:34:00.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe00ef2db80 20 client.4779 trim_cache size 0 max 16384 2023-10-14T12:34:00.237 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:34:00.237 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8", 2023-10-14T12:34:00.237 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-10-14T12:34:00.238 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4273, 2023-10-14T12:34:00.238 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-10-14T12:34:00.238 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-10-14T12:34:00.238 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-10-14T12:34:00.238 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 28.389559052999999, 2023-10-14T12:34:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 9, 2023-10-14T12:34:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 24, 2023-10-14T12:34:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 24, 2023-10-14T12:34:00.239 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 35.428472263000003 2023-10-14T12:34:00.239 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:34:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 -- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdfe006af00 msgr2=0x7fdfe006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdfe006af00 0x7fdfe006d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdffc157840 tx=0x7fdfe8008040 comp rx=0 tx=0).stop 2023-10-14T12:34:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 -- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc06bf80 msgr2=0x7fdffc14eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc06bf80 0x7fdffc14eab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdff000b4a0 tx=0x7fdff000b7b0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 -- 172.21.15.72:0/1439226744 shutdown_connections 2023-10-14T12:34:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdfe006af00 0x7fdfe006d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdffc15dc70 0x7fdffc06d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdffc06bf80 0x7fdffc14eab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 --2- 172.21.15.72:0/1439226744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdffc0cd4b0 0x7fdffc160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 -- 172.21.15.72:0/1439226744 >> 172.21.15.72:0/1439226744 conn(0x7fdffc0cfcd0 msgr2=0x7fdffc153540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 -- 172.21.15.72:0/1439226744 shutdown_connections 2023-10-14T12:34:00.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.207+0000 7fe002d43700 1 -- 172.21.15.72:0/1439226744 wait complete. 2023-10-14T12:34:00.244 INFO:teuthology.run_tasks:Running task kclient... 2023-10-14T12:34:00.258 INFO:tasks.kclient:Mounting kernel clients... 2023-10-14T12:34:00.259 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-14T12:34:00.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:00.259 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T12:34:00.276 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-14T12:34:00.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:00.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:34:00.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:00.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-14T12:34:00.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:00.473 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T12:34:00.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:00.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-14T12:34:00.558 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-10-14T12:34:00.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:34:00.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:00.560 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-10-14T12:34:00.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:00.581 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2023-10-14T12:34:00.655 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2023-10-14T12:34:00.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:34:00.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:00.657 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-10-14T12:34:00.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:00.716 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2023-10-14T12:34:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2023-10-14T12:34:00.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:34:00.788 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-14T12:34:00.788 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:34:00.788 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T12:34:00.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:34:00.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.910+0000 7fe2e2f6b700 1 Processor -- start 2023-10-14T12:34:00.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.910+0000 7fe2e2f6b700 1 -- start start 2023-10-14T12:34:00.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e2f6b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe2dc0cc170 0x7fe2dc15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e2f6b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2dc15efb0 0x7fe2dc15f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e2f6b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc06d6b0 con 0x7fe2dc0c9dd0 2023-10-14T12:34:00.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e2f6b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc15fea0 con 0x7fe2dc15efb0 2023-10-14T12:34:00.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e2f6b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc15fbc0 con 0x7fe2dc0cc170 2023-10-14T12:34:00.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e1508700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2dc15efb0 0x7fe2dc15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e0d07700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe2dc0c9dd0 0x7fe2dc0cba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53582/0 (socket says 172.21.15.72:53582) 2023-10-14T12:34:00.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e0d07700 1 -- 172.21.15.72:0/3373852917 learned_addr learned my addr 172.21.15.72:0/3373852917 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:00.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2dbfff700 1 --2- 172.21.15.72:0/3373852917 >> v2:172.21.15.123:3300/0 conn(0x7fe2dc0cc170 0x7fe2dc15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e1508700 1 -- 172.21.15.72:0/3373852917 >> v2:172.21.15.123:3300/0 conn(0x7fe2dc0cc170 msgr2=0x7fe2dc15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:00.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e1508700 1 --2- 172.21.15.72:0/3373852917 >> v2:172.21.15.123:3300/0 conn(0x7fe2dc0cc170 0x7fe2dc15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e1508700 1 -- 172.21.15.72:0/3373852917 >> v1:172.21.15.72:6789/0 conn(0x7fe2dc0c9dd0 legacy=0x7fe2dc0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e1508700 1 -- 172.21.15.72:0/3373852917 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc15bb40 con 0x7fe2dc15efb0 2023-10-14T12:34:00.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2db7fe700 1 -- 172.21.15.72:0/3373852917 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448204223 0 0) 0x7fe2d0001110 con 0x7fe2dc0c9dd0 2023-10-14T12:34:00.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2e1508700 1 --2- 172.21.15.72:0/3373852917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc15efb0 0x7fe2dc15f390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0c5fa0 tx=0x7fe2d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2286c4a0f1ce582 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2db7fe700 1 -- 172.21.15.72:0/3373852917 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400e070 con 0x7fe2dc15efb0 2023-10-14T12:34:00.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2db7fe700 1 -- 172.21.15.72:0/3373852917 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400bbd0 con 0x7fe2dc15efb0 2023-10-14T12:34:00.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.911+0000 7fe2db7fe700 1 -- 172.21.15.72:0/3373852917 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4012430 con 0x7fe2dc15efb0 2023-10-14T12:34:00.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.912+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3373852917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc15efb0 msgr2=0x7fe2dc15f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.912+0000 7fe2e2f6b700 1 --2- 172.21.15.72:0/3373852917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc15efb0 0x7fe2dc15f390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0c5fa0 tx=0x7fe2d400b330 comp rx=0 tx=0).stop 2023-10-14T12:34:00.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.912+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3373852917 shutdown_connections 2023-10-14T12:34:00.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.912+0000 7fe2e2f6b700 1 --2- 172.21.15.72:0/3373852917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc15efb0 0x7fe2dc15f390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.912+0000 7fe2e2f6b700 1 --2- 172.21.15.72:0/3373852917 >> v2:172.21.15.123:3300/0 conn(0x7fe2dc0cc170 0x7fe2dc15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.912+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3373852917 >> 172.21.15.72:0/3373852917 conn(0x7fe2dc06c850 msgr2=0x7fe2dc06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:00.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.912+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3373852917 shutdown_connections 2023-10-14T12:34:00.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.912+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3373852917 wait complete. 2023-10-14T12:34:00.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.913+0000 7fe2e2f6b700 1 Processor -- start 2023-10-14T12:34:00.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.913+0000 7fe2e2f6b700 1 -- start start 2023-10-14T12:34:00.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.914+0000 7fe2e2f6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2dc0c9dd0 0x7fe2dc0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.914+0000 7fe2e2f6b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0cc170 0x7fe2dc0b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.914+0000 7fe2e2f6b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe2dc15efb0 0x7fe2dc0ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.914+0000 7fe2e2f6b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0cd370 con 0x7fe2dc0cc170 2023-10-14T12:34:00.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.914+0000 7fe2e2f6b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0cd5c0 con 0x7fe2dc0c9dd0 2023-10-14T12:34:00.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.914+0000 7fe2e2f6b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0cd8a0 con 0x7fe2dc15efb0 2023-10-14T12:34:00.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.914+0000 7fe2dbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0cc170 0x7fe2dc0b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.914+0000 7fe2dbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0cc170 0x7fe2dc0b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47290/0 (socket says 172.21.15.72:47290) 2023-10-14T12:34:00.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.914+0000 7fe2dbfff700 1 -- 172.21.15.72:0/3935015705 learned_addr learned my addr 172.21.15.72:0/3935015705 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:00.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2e0d07700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2dc0c9dd0 0x7fe2dc0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2dbfff700 1 -- 172.21.15.72:0/3935015705 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe2dc15efb0 msgr2=0x7fe2dc0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2dbfff700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe2dc15efb0 0x7fe2dc0ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2dbfff700 1 -- 172.21.15.72:0/3935015705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2dc0c9dd0 msgr2=0x7fe2dc0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:00.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2dbfff700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2dc0c9dd0 0x7fe2dc0c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:00.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2dbfff700 1 -- 172.21.15.72:0/3935015705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d4009a70 con 0x7fe2dc0cc170 2023-10-14T12:34:00.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2e0d07700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2dc0c9dd0 0x7fe2dc0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:00.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2dbfff700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0cc170 0x7fe2dc0b2de0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800e810 tx=0x7fe2c800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2d97fa700 1 -- 172.21.15.72:0/3935015705 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8013610 con 0x7fe2dc0cc170 2023-10-14T12:34:00.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2d97fa700 1 -- 172.21.15.72:0/3935015705 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c8013770 con 0x7fe2dc0cc170 2023-10-14T12:34:00.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc0cdb80 con 0x7fe2dc0cc170 2023-10-14T12:34:00.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2d97fa700 1 -- 172.21.15.72:0/3935015705 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8013b20 con 0x7fe2dc0cc170 2023-10-14T12:34:00.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.915+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc0c9280 con 0x7fe2dc0cc170 2023-10-14T12:34:00.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.916+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc04f400 con 0x7fe2dc0cc170 2023-10-14T12:34:00.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.916+0000 7fe2d97fa700 1 -- 172.21.15.72:0/3935015705 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe2c8013c80 con 0x7fe2dc0cc170 2023-10-14T12:34:00.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.917+0000 7fe2d97fa700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2c006af00 0x7fe2c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:00.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.917+0000 7fe2d97fa700 1 -- 172.21.15.72:0/3935015705 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2c80896b0 con 0x7fe2dc0cc170 2023-10-14T12:34:00.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.917+0000 7fe2e0d07700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2c006af00 0x7fe2c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:00.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.917+0000 7fe2e0d07700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2c006af00 0x7fe2c006d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0007fd0 tx=0x7fe2d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:00.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:00.921+0000 7fe2d97fa700 1 -- 172.21.15.72:0/3935015705 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2c80543e0 con 0x7fe2dc0cc170 2023-10-14T12:34:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.157+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe2dc04ebb0 con 0x7fe2dc0cc170 2023-10-14T12:34:01.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.158+0000 7fe2d97fa700 1 -- 172.21.15.72:0/3935015705 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe2c8057a00 con 0x7fe2dc0cc170 2023-10-14T12:34:01.163 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:34:01.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2c006af00 msgr2=0x7fe2c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:01.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2c006af00 0x7fe2c006d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0007fd0 tx=0x7fe2d0009040 comp rx=0 tx=0).stop 2023-10-14T12:34:01.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0cc170 msgr2=0x7fe2dc0b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:01.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0cc170 0x7fe2dc0b2de0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800e810 tx=0x7fe2c800ebd0 comp rx=0 tx=0).stop 2023-10-14T12:34:01.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 shutdown_connections 2023-10-14T12:34:01.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2c006af00 0x7fe2c006d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:01.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe2dc15efb0 0x7fe2dc0ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:01.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2dc0c9dd0 0x7fe2dc0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:01.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 --2- 172.21.15.72:0/3935015705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0cc170 0x7fe2dc0b2de0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:01.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 >> 172.21.15.72:0/3935015705 conn(0x7fe2dc06c850 msgr2=0x7fe2dc154c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:01.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 shutdown_connections 2023-10-14T12:34:01.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:01.160+0000 7fe2e2f6b700 1 -- 172.21.15.72:0/3935015705 wait complete. 2023-10-14T12:34:01.173 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:34:01.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:34:01.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-10-14T12:34:01.174 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T12:34:01.174 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T12:34:01.175 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:34:01.175 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:34:01.175 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:34:01.175 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:34:01.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.176 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-10-14T12:34:01.193 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:34:01.193 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:34:01.194 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:34:01.194 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:01.194 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T12:34:01.194 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:01.195 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:01.195 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:01.195 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:01.195 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:01.196 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:01.196 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:01.196 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:34:01.196 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:01.196 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:34:01.197 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42388sec preferred_lft 42388sec 2023-10-14T12:34:01.197 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e497:c464:2199:335/64 scope link noprefixroute 2023-10-14T12:34:01.197 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:01.197 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T12:34:01.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.198 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:01.199 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:01.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-10-14T12:34:01.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-10-14T12:34:01.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-10-14T12:34:01.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T12:34:01.200 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:01.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.309 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:34:01.334 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-14T12:34:01.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.336 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-10-14T12:34:01.394 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-10-14T12:34:01.395 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:34:01.395 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:34:01.395 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:34:01.395 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:34:01.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.397 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:01.397 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:01.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:34:01.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:34:01.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:34:01.398 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:01.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.502 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T12:34:01.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.519 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-10-14T12:34:01.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.575 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:01.575 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:01.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:34:01.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T12:34:01.576 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:01.668 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T12:34:01.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.669 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:01.670 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:01.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T12:34:01.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T12:34:01.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T12:34:01.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T12:34:01.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T12:34:01.671 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:01.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:01.879 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:01.879 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:01.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-10-14T12:34:01.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T12:34:01.880 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:01.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:01.992 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T12:34:02.014 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:34:02.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:02.015 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:34:02.071 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-14T12:34:02.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:02.072 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:02.157 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:02.158 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:02.300 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:02.300 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:02.300 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:02.301 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 0@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:02.301 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:02.301 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:02.301 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:02.302 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:02.388 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:02.388 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:02.388 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:02.388 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 0@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:02.389 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:02.389 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:02.389 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:02.389 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:02.389 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790" 2023-10-14T12:34:02.390 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790:/ 2023-10-14T12:34:02.390 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8" will pass to kernel 2023-10-14T12:34:02.391 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T12:34:02.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:02.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:34:02.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:02.419 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:02.490 INFO:teuthology.orchestra.run.smithi072.stdout:client4535 2023-10-14T12:34:02.491 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:02.492 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:02.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:02.549 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:02.621 INFO:teuthology.orchestra.run.smithi072.stdout:client4535 2023-10-14T12:34:02.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:02.622 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:02.693 INFO:teuthology.orchestra.run.smithi072.stdout:client4535 2023-10-14T12:34:02.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:02.694 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.client4535/status') 2023-10-14T12:34:02.773 INFO:teuthology.orchestra.run.smithi072.stdout:instance: client.4535 (3)172.21.15.72:0/3451108334 2023-10-14T12:34:02.774 INFO:teuthology.orchestra.run.smithi072.stdout:blocklisted: false 2023-10-14T12:34:02.775 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records in 2023-10-14T12:34:02.775 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records out 2023-10-14T12:34:02.775 INFO:teuthology.orchestra.run.smithi072.stderr:70 bytes copied, 2.0874e-05 s, 3.4 MB/s 2023-10-14T12:34:02.776 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-14T12:34:02.776 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:34:02.776 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T12:34:02.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:34:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.933+0000 7f0a2c939700 1 Processor -- start 2023-10-14T12:34:02.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.933+0000 7f0a2c939700 1 -- start start 2023-10-14T12:34:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.934+0000 7f0a2c939700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 0x7f0a280cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.934+0000 7f0a2c939700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a280ca7d0 0x7f0a28071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.934+0000 7f0a2c939700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a280cfeb0 con 0x7f0a2815e7f0 2023-10-14T12:34:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.934+0000 7f0a2c939700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a280ce410 con 0x7f0a280ca7d0 2023-10-14T12:34:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.934+0000 7f0a2c939700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815ec70 con 0x7f0a2806a820 2023-10-14T12:34:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a26d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0a280ca7d0 0x7f0a28071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a25d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0a2815e7f0 0x7f0a2806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53602/0 (socket says 172.21.15.72:53602) 2023-10-14T12:34:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a25d9b700 1 -- 172.21.15.72:0/1567507611 learned_addr learned my addr 172.21.15.72:0/1567507611 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a2659c700 1 --2- 172.21.15.72:0/1567507611 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 0x7f0a280cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a26d9d700 1 -- 172.21.15.72:0/1567507611 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 msgr2=0x7f0a280cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a26d9d700 1 --2- 172.21.15.72:0/1567507611 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 0x7f0a280cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a26d9d700 1 -- 172.21.15.72:0/1567507611 >> v1:172.21.15.72:6789/0 conn(0x7f0a2815e7f0 legacy=0x7f0a2806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a26d9d700 1 -- 172.21.15.72:0/1567507611 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280af9d0 con 0x7f0a280ca7d0 2023-10-14T12:34:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a2559a700 1 -- 172.21.15.72:0/1567507611 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560300606 0 0) 0x7f0a280cfeb0 con 0x7f0a2815e7f0 2023-10-14T12:34:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a26d9d700 1 --2- 172.21.15.72:0/1567507611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 0x7f0a28071ea0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009d90 tx=0x7f0a2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa55871100d979d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a2559a700 1 -- 172.21.15.72:0/1567507611 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000e070 con 0x7f0a280ca7d0 2023-10-14T12:34:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a2559a700 1 -- 172.21.15.72:0/1567507611 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2000bbd0 con 0x7f0a280ca7d0 2023-10-14T12:34:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.935+0000 7f0a2559a700 1 -- 172.21.15.72:0/1567507611 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20012430 con 0x7f0a280ca7d0 2023-10-14T12:34:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.936+0000 7f0a2c939700 1 -- 172.21.15.72:0/1567507611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 msgr2=0x7f0a28071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.936+0000 7f0a2c939700 1 --2- 172.21.15.72:0/1567507611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 0x7f0a28071ea0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009d90 tx=0x7f0a2000b330 comp rx=0 tx=0).stop 2023-10-14T12:34:02.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.936+0000 7f0a2c939700 1 -- 172.21.15.72:0/1567507611 shutdown_connections 2023-10-14T12:34:02.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.936+0000 7f0a2c939700 1 --2- 172.21.15.72:0/1567507611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 0x7f0a28071ea0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:02.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.936+0000 7f0a2c939700 1 --2- 172.21.15.72:0/1567507611 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 0x7f0a280cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.936+0000 7f0a2c939700 1 -- 172.21.15.72:0/1567507611 >> 172.21.15.72:0/1567507611 conn(0x7f0a280d0180 msgr2=0x7f0a280d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.936+0000 7f0a2c939700 1 -- 172.21.15.72:0/1567507611 shutdown_connections 2023-10-14T12:34:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.936+0000 7f0a2c939700 1 -- 172.21.15.72:0/1567507611 wait complete. 2023-10-14T12:34:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.937+0000 7f0a2c939700 1 Processor -- start 2023-10-14T12:34:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.937+0000 7f0a2c939700 1 -- start start 2023-10-14T12:34:02.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a2c939700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 0x7f0a28153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a2c939700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 0x7f0a28159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a2c939700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a2815e7f0 0x7f0a28159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a2c939700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a281542b0 con 0x7f0a280ca7d0 2023-10-14T12:34:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a2c939700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815a5e0 con 0x7f0a2815e7f0 2023-10-14T12:34:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a2c939700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815bb40 con 0x7f0a2806a820 2023-10-14T12:34:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a25d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 0x7f0a28159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a25d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 0x7f0a28159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47308/0 (socket says 172.21.15.72:47308) 2023-10-14T12:34:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a25d9b700 1 -- 172.21.15.72:0/3644744668 learned_addr learned my addr 172.21.15.72:0/3644744668 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a2659c700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 0x7f0a28153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:02.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a26d9d700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a2815e7f0 0x7f0a28159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:02.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a25d9b700 1 -- 172.21.15.72:0/3644744668 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 msgr2=0x7f0a28153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:02.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a25d9b700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 0x7f0a28153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:02.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a25d9b700 1 -- 172.21.15.72:0/3644744668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a2815e7f0 msgr2=0x7f0a28159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a25d9b700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a2815e7f0 0x7f0a28159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a25d9b700 1 -- 172.21.15.72:0/3644744668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20009a70 con 0x7f0a280ca7d0 2023-10-14T12:34:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a2659c700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 0x7f0a28153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.938+0000 7f0a25d9b700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 0x7f0a28159760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800c550 tx=0x7f0a1800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.939+0000 7f0a1effd700 1 -- 172.21.15.72:0/3644744668 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18004c80 con 0x7f0a280ca7d0 2023-10-14T12:34:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.939+0000 7f0a1effd700 1 -- 172.21.15.72:0/3644744668 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a18004e00 con 0x7f0a280ca7d0 2023-10-14T12:34:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.939+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a280ace90 con 0x7f0a280ca7d0 2023-10-14T12:34:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.939+0000 7f0a1effd700 1 -- 172.21.15.72:0/3644744668 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18007310 con 0x7f0a280ca7d0 2023-10-14T12:34:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.939+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a280ad450 con 0x7f0a280ca7d0 2023-10-14T12:34:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.940+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a280ad670 con 0x7f0a280ca7d0 2023-10-14T12:34:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.940+0000 7f0a1effd700 1 -- 172.21.15.72:0/3644744668 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0a18007470 con 0x7f0a280ca7d0 2023-10-14T12:34:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.940+0000 7f0a1effd700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0a0806af00 0x7f0a0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.941+0000 7f0a2659c700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0a0806af00 0x7f0a0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:02.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.941+0000 7f0a1effd700 1 -- 172.21.15.72:0/3644744668 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a18089500 con 0x7f0a280ca7d0 2023-10-14T12:34:02.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.941+0000 7f0a2659c700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0a0806af00 0x7f0a0806d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a100099f0 tx=0x7f0a10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:02.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:02.945+0000 7f0a1effd700 1 -- 172.21.15.72:0/3644744668 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a180542c0 con 0x7f0a280ca7d0 2023-10-14T12:34:03.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.179+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0a2804ebb0 con 0x7f0a280ca7d0 2023-10-14T12:34:03.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.179+0000 7f0a1effd700 1 -- 172.21.15.72:0/3644744668 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0a180578e0 con 0x7f0a280ca7d0 2023-10-14T12:34:03.181 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:34:03.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0a0806af00 msgr2=0x7f0a0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:03.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0a0806af00 0x7f0a0806d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a100099f0 tx=0x7f0a10008040 comp rx=0 tx=0).stop 2023-10-14T12:34:03.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 msgr2=0x7f0a28159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:03.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 0x7f0a28159760 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800c550 tx=0x7f0a1800c860 comp rx=0 tx=0).stop 2023-10-14T12:34:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 shutdown_connections 2023-10-14T12:34:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0a0806af00 0x7f0a0806d3c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a2815e7f0 0x7f0a28159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0a2806a820 0x7f0a28153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:03.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 --2- 172.21.15.72:0/3644744668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a280ca7d0 0x7f0a28159760 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 >> 172.21.15.72:0/3644744668 conn(0x7f0a280d0180 msgr2=0x7f0a28071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 shutdown_connections 2023-10-14T12:34:03.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:03.181+0000 7f0a2c939700 1 -- 172.21.15.72:0/3644744668 wait complete. 2023-10-14T12:34:03.195 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:34:03.195 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:34:03.195 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-10-14T12:34:03.195 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-14T12:34:03.196 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T12:34:03.196 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:34:03.196 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:34:03.196 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:34:03.197 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-14T12:34:03.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.197 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-10-14T12:34:03.215 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:34:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:34:03.215 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:34:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T12:34:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.216 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:03.216 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:03.217 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:03.217 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:03.217 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:34:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:34:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42386sec preferred_lft 42386sec 2023-10-14T12:34:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e497:c464:2199:335/64 scope link noprefixroute 2023-10-14T12:34:03.218 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.219 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:34:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether fe:41:c0:8b:d6:30 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T12:34:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.219 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::fc8e:48ff:fe28:ff93/64 scope link 2023-10-14T12:34:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.220 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:34:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether fe:41:c0:8b:d6:30 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:34:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::fc41:c0ff:fe8b:d630/64 scope link tentative 2023-10-14T12:34:03.220 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.221 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:34:03.280 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-14T12:34:03.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.282 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-10-14T12:34:03.340 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-10-14T12:34:03.340 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:34:03.340 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:34:03.341 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:34:03.341 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:34:03.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.342 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:03.342 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:03.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:34:03.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:34:03.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:34:03.343 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:03.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.445 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T12:34:03.462 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T12:34:03.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.463 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-10-14T12:34:03.519 INFO:teuthology.orchestra.run.smithi072.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-14T12:34:03.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.520 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:03.520 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:03.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:34:03.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-14T12:34:03.521 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:03.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T12:34:03.653 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:34:03.653 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:34:03.653 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:34:03.654 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.654 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T12:34:03.654 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.654 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:34:03.654 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 32:37:ec:fb:cc:c5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:34:03.655 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:34:03.655 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.655 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3037:ecff:fefb:ccc5/64 scope link 2023-10-14T12:34:03.655 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T12:34:03.745 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:34:03.745 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:34:03.745 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:34:03.746 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.746 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T12:34:03.746 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.746 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:34:03.746 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 32:37:ec:fb:cc:c5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:34:03.747 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:34:03.747 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.747 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3037:ecff:fefb:ccc5/64 scope link 2023-10-14T12:34:03.747 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:03.766 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-14T12:34:03.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:03.767 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:03.767 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:03.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-14T12:34:03.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T12:34:03.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-14T12:34:03.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-14T12:34:03.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-14T12:34:03.769 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:04.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:04.015 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:04.016 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:04.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.1 up 2023-10-14T12:34:04.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T12:34:04.016 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:04.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:04.130 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-14T12:34:04.149 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-14T12:34:04.149 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:04.150 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-14T12:34:04.205 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-14T12:34:04.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:04.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:04.290 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:04.290 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:04.321 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:04.322 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:04.322 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:04.322 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 2@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:04.322 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:04.323 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:04.323 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:04.323 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:04.347 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:04.347 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:04.347 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:04.347 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 2@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:04.348 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:04.348 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:04.348 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:04.348 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:04.348 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790" 2023-10-14T12:34:04.349 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790:/ 2023-10-14T12:34:04.349 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8" will pass to kernel 2023-10-14T12:34:04.350 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T12:34:04.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:04.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-14T12:34:04.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:04.381 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:04.451 INFO:teuthology.orchestra.run.smithi072.stdout:client4800 2023-10-14T12:34:04.452 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:04.452 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:04.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:04.511 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:04.582 INFO:teuthology.orchestra.run.smithi072.stdout:client4800 2023-10-14T12:34:04.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:04.583 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:04.656 INFO:teuthology.orchestra.run.smithi072.stdout:client4800 2023-10-14T12:34:04.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:04.657 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.client4800/status') 2023-10-14T12:34:04.736 INFO:teuthology.orchestra.run.smithi072.stdout:instance: client.4800 (3)192.168.0.2:0/2518101638 2023-10-14T12:34:04.736 INFO:teuthology.orchestra.run.smithi072.stdout:blocklisted: false 2023-10-14T12:34:04.737 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records in 2023-10-14T12:34:04.737 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records out 2023-10-14T12:34:04.738 INFO:teuthology.orchestra.run.smithi072.stderr:69 bytes copied, 2.1209e-05 s, 3.3 MB/s 2023-10-14T12:34:04.738 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-14T12:34:04.738 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:34:04.739 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T12:34:04.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:34:04.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.896+0000 7f3cf05a5700 1 Processor -- start 2023-10-14T12:34:04.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.896+0000 7f3cf05a5700 1 -- start start 2023-10-14T12:34:04.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.897+0000 7f3cf05a5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce815daa0 0x7f3ce80af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:04.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.897+0000 7f3cf05a5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ce8071f60 0x7f3ce806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:04.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.897+0000 7f3cf05a5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce815ed10 con 0x7f3ce80af560 2023-10-14T12:34:04.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.897+0000 7f3cf05a5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce815de80 con 0x7f3ce8071f60 2023-10-14T12:34:04.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.897+0000 7f3cf05a5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce815e100 con 0x7f3ce815daa0 2023-10-14T12:34:04.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ceeb42700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ce8071f60 0x7f3ce806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:04.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ceeb42700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ce8071f60 0x7f3ce806d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47322/0 (socket says 172.21.15.72:47322) 2023-10-14T12:34:04.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ceeb42700 1 -- 172.21.15.72:0/1364161175 learned_addr learned my addr 172.21.15.72:0/1364161175 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:04.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3cee341700 1 --2- 172.21.15.72:0/1364161175 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce815daa0 0x7f3ce80af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:04.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ceeb42700 1 -- 172.21.15.72:0/1364161175 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce815daa0 msgr2=0x7f3ce80af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:04.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ceeb42700 1 --2- 172.21.15.72:0/1364161175 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce815daa0 0x7f3ce80af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:04.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ceeb42700 1 -- 172.21.15.72:0/1364161175 >> v1:172.21.15.123:6789/0 conn(0x7f3ce80af560 legacy=0x7f3ce8071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:04.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ceeb42700 1 -- 172.21.15.72:0/1364161175 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce815e3e0 con 0x7f3ce8071f60 2023-10-14T12:34:04.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3cee341700 1 --2- 172.21.15.72:0/1364161175 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce815daa0 0x7f3ce80af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:04.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ceeb42700 1 --2- 172.21.15.72:0/1364161175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8071f60 0x7f3ce806d100 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009e50 tx=0x7f3ce000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46aa4d4e12ca91a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:04.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ced33f700 1 -- 172.21.15.72:0/1364161175 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce000e070 con 0x7f3ce8071f60 2023-10-14T12:34:04.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ced33f700 1 -- 172.21.15.72:0/1364161175 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce0003a70 con 0x7f3ce8071f60 2023-10-14T12:34:04.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.898+0000 7f3ced33f700 1 -- 172.21.15.72:0/1364161175 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0003e20 con 0x7f3ce8071f60 2023-10-14T12:34:04.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.899+0000 7f3cf05a5700 1 -- 172.21.15.72:0/1364161175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8071f60 msgr2=0x7f3ce806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:04.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.899+0000 7f3cf05a5700 1 --2- 172.21.15.72:0/1364161175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8071f60 0x7f3ce806d100 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009e50 tx=0x7f3ce000b330 comp rx=0 tx=0).stop 2023-10-14T12:34:04.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.899+0000 7f3cf05a5700 1 -- 172.21.15.72:0/1364161175 shutdown_connections 2023-10-14T12:34:04.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.899+0000 7f3cf05a5700 1 --2- 172.21.15.72:0/1364161175 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce815daa0 0x7f3ce80af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:04.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.899+0000 7f3cf05a5700 1 --2- 172.21.15.72:0/1364161175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce8071f60 0x7f3ce806d100 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:04.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.899+0000 7f3cf05a5700 1 -- 172.21.15.72:0/1364161175 >> 172.21.15.72:0/1364161175 conn(0x7f3ce80d0180 msgr2=0x7f3ce80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:04.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.899+0000 7f3cf05a5700 1 -- 172.21.15.72:0/1364161175 shutdown_connections 2023-10-14T12:34:04.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.899+0000 7f3cf05a5700 1 -- 172.21.15.72:0/1364161175 wait complete. 2023-10-14T12:34:04.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.900+0000 7f3cf05a5700 1 Processor -- start 2023-10-14T12:34:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.900+0000 7f3cf05a5700 1 -- start start 2023-10-14T12:34:04.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.901+0000 7f3cf05a5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ce8071f60 0x7f3ce80c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.901+0000 7f3cf05a5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce80af560 0x7f3ce80ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.901+0000 7f3cf05a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce815daa0 0x7f3ce80c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.901+0000 7f3cf05a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce81550e0 con 0x7f3ce815daa0 2023-10-14T12:34:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.901+0000 7f3cf05a5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8154460 con 0x7f3ce8071f60 2023-10-14T12:34:04.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.901+0000 7f3cf05a5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8154740 con 0x7f3ce80af560 2023-10-14T12:34:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.901+0000 7f3ceeb42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce815daa0 0x7f3ce80c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.901+0000 7f3ceeb42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce815daa0 0x7f3ce80c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47326/0 (socket says 172.21.15.72:47326) 2023-10-14T12:34:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.901+0000 7f3ceeb42700 1 -- 172.21.15.72:0/3544678310 learned_addr learned my addr 172.21.15.72:0/3544678310 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:04.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3cee341700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ce8071f60 0x7f3ce80c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3cedb40700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce80af560 0x7f3ce80ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3ceeb42700 1 -- 172.21.15.72:0/3544678310 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce80af560 msgr2=0x7f3ce80ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3ceeb42700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce80af560 0x7f3ce80ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3ceeb42700 1 -- 172.21.15.72:0/3544678310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ce8071f60 msgr2=0x7f3ce80c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:04.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3ceeb42700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ce8071f60 0x7f3ce80c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3ceeb42700 1 -- 172.21.15.72:0/3544678310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0009b30 con 0x7f3ce815daa0 2023-10-14T12:34:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3ceeb42700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce815daa0 0x7f3ce80c3c90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0004000 tx=0x7f3ce0004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3cdeffd700 1 -- 172.21.15.72:0/3544678310 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0004440 con 0x7f3ce815daa0 2023-10-14T12:34:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3cdeffd700 1 -- 172.21.15.72:0/3544678310 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce00045c0 con 0x7f3ce815daa0 2023-10-14T12:34:04.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce8154a20 con 0x7f3ce815daa0 2023-10-14T12:34:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3cdeffd700 1 -- 172.21.15.72:0/3544678310 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0004970 con 0x7f3ce815daa0 2023-10-14T12:34:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.902+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce80b5c10 con 0x7f3ce815daa0 2023-10-14T12:34:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.903+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce804ebb0 con 0x7f3ce815daa0 2023-10-14T12:34:04.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.903+0000 7f3cdeffd700 1 -- 172.21.15.72:0/3544678310 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3ce0012430 con 0x7f3ce815daa0 2023-10-14T12:34:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.904+0000 7f3cdeffd700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3ccc06af00 0x7f3ccc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.904+0000 7f3cee341700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3ccc06af00 0x7f3ccc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.904+0000 7f3cdeffd700 1 -- 172.21.15.72:0/3544678310 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ce008add0 con 0x7f3ce815daa0 2023-10-14T12:34:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.904+0000 7f3cee341700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3ccc06af00 0x7f3ccc06d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8006fd0 tx=0x7f3cd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:04.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:04.908+0000 7f3cdeffd700 1 -- 172.21.15.72:0/3544678310 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3ce0059610 con 0x7f3ce815daa0 2023-10-14T12:34:05.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.141+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3ce8152d40 con 0x7f3ce815daa0 2023-10-14T12:34:05.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.141+0000 7f3cdeffd700 1 -- 172.21.15.72:0/3544678310 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3ce0017020 con 0x7f3ce815daa0 2023-10-14T12:34:05.144 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:34:05.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3ccc06af00 msgr2=0x7f3ccc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3ccc06af00 0x7f3ccc06d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8006fd0 tx=0x7f3cd8008040 comp rx=0 tx=0).stop 2023-10-14T12:34:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce815daa0 msgr2=0x7f3ce80c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce815daa0 0x7f3ce80c3c90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0004000 tx=0x7f3ce0004b20 comp rx=0 tx=0).stop 2023-10-14T12:34:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 shutdown_connections 2023-10-14T12:34:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3ccc06af00 0x7f3ccc06d3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ce815daa0 0x7f3ce80c3c90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ce8071f60 0x7f3ce80c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 --2- 172.21.15.72:0/3544678310 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3ce80af560 0x7f3ce80ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 >> 172.21.15.72:0/3544678310 conn(0x7f3ce80d0180 msgr2=0x7f3ce80ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 shutdown_connections 2023-10-14T12:34:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:05.144+0000 7f3cf05a5700 1 -- 172.21.15.72:0/3544678310 wait complete. 2023-10-14T12:34:05.157 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:34:05.157 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:34:05.158 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2023-10-14T12:34:05.158 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T12:34:05.158 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T12:34:05.159 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:34:05.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:34:05.159 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:34:05.160 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T12:34:05.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:05.160 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2023-10-14T12:34:05.181 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:34:05.182 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:34:05.182 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:34:05.182 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:05.182 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-10-14T12:34:05.183 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:05.183 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:05.183 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:05.183 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:05.183 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:05.184 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:05.184 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:05.184 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:34:05.184 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:05.184 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:34:05.185 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-10-14T12:34:05.185 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::45c0:aab0:b2b8:a5b5/64 scope link noprefixroute 2023-10-14T12:34:05.185 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:05.186 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T12:34:05.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:05.186 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-10-14T12:34:05.187 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-10-14T12:34:05.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2023-10-14T12:34:05.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2023-10-14T12:34:05.188 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2023-10-14T12:34:05.188 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T12:34:05.188 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-10-14T12:34:05.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:05.366 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:34:05.395 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-10-14T12:34:05.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:05.398 DEBUG:teuthology.orchestra.run.smithi123:> route 2023-10-14T12:34:05.475 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2023-10-14T12:34:05.476 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:34:05.476 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:34:05.476 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:34:05.477 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:34:05.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:05.477 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-10-14T12:34:05.478 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-10-14T12:34:05.478 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:34:05.478 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:34:05.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:34:05.479 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-10-14T12:34:05.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:05.739 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-10-14T12:34:05.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:05.757 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2023-10-14T12:34:05.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:05.814 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-10-14T12:34:05.815 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-10-14T12:34:05.815 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:34:05.815 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T12:34:05.816 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-10-14T12:34:05.906 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T12:34:05.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:05.907 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-10-14T12:34:05.907 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-10-14T12:34:05.908 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T12:34:05.908 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T12:34:05.908 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T12:34:05.908 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T12:34:05.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T12:34:05.909 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-10-14T12:34:06.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:06.110 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-10-14T12:34:06.111 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-10-14T12:34:06.111 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2023-10-14T12:34:06.111 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T12:34:06.112 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-10-14T12:34:06.212 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:06.212 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T12:34:06.231 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T12:34:06.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:06.232 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T12:34:06.287 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-14T12:34:06.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:06.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:06.388 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:06.389 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:06.498 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:06.499 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:06.499 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:06.499 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with new device syntax: 1@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:06.499 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:06.499 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:06.500 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:06.500 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:06.524 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:06.524 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:06.524 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:06.524 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with new device syntax: 1@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:06.525 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:06.525 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:06.525 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:06.525 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:06.525 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790" 2023-10-14T12:34:06.526 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790:/ 2023-10-14T12:34:06.526 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8" will pass to kernel 2023-10-14T12:34:06.528 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T12:34:06.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:06.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T12:34:06.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:06.558 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:06.630 INFO:teuthology.orchestra.run.smithi123.stdout:client4547 2023-10-14T12:34:06.630 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:06.631 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:06.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:06.688 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:06.760 INFO:teuthology.orchestra.run.smithi123.stdout:client4547 2023-10-14T12:34:06.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:06.761 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:06.832 INFO:teuthology.orchestra.run.smithi123.stdout:client4547 2023-10-14T12:34:06.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:06.833 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.client4547/status') 2023-10-14T12:34:06.912 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.4547 (3)192.168.0.1:0/3379129866 2023-10-14T12:34:06.912 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2023-10-14T12:34:06.913 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2023-10-14T12:34:06.914 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2023-10-14T12:34:06.914 INFO:teuthology.orchestra.run.smithi123.stderr:69 bytes copied, 2.1504e-05 s, 3.2 MB/s 2023-10-14T12:34:06.914 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-14T12:34:06.915 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:34:06.915 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T12:34:06.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:34:06.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:34:06.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:34:07.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.052+0000 7f6fa5153700 1 Processor -- start 2023-10-14T12:34:07.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.052+0000 7f6fa5153700 1 -- start start 2023-10-14T12:34:07.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.053+0000 7f6fa5153700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.053+0000 7f6fa5153700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fa015e7f0 0x7f6fa006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.053+0000 7f6fa5153700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa00cfeb0 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.053+0000 7f6fa5153700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa00ce410 con 0x7f6fa015e7f0 2023-10-14T12:34:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.053+0000 7f6fa5153700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa015ec70 con 0x7f6fa006a820 2023-10-14T12:34:07.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9ed9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9e59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fa015e7f0 0x7f6fa006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9ed9d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa00cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:42984/0 (socket says 172.21.15.72:42984) 2023-10-14T12:34:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9f59e700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6fa00ca7d0 0x7f6fa0071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51832/0 (socket says 172.21.15.72:51832) 2023-10-14T12:34:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9ed9d700 1 -- 172.21.15.72:0/2743462124 learned_addr learned my addr 172.21.15.72:0/2743462124 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:07.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9e59c700 1 -- 172.21.15.72:0/2743462124 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 msgr2=0x7f6fa00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9e59c700 1 --2- 172.21.15.72:0/2743462124 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9e59c700 1 -- 172.21.15.72:0/2743462124 >> v1:172.21.15.123:6789/0 conn(0x7f6fa00ca7d0 legacy=0x7f6fa0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9e59c700 1 -- 172.21.15.72:0/2743462124 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00af9d0 con 0x7f6fa015e7f0 2023-10-14T12:34:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9dd9b700 1 -- 172.21.15.72:0/2743462124 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115556014 0 0) 0x7f6fa00cfeb0 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9ed9d700 1 --2- 172.21.15.72:0/2743462124 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:07.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9e59c700 1 --2- 172.21.15.72:0/2743462124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa015e7f0 0x7f6fa006ac00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009840 tx=0x7f6f90009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10735d604a21b1ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:07.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9dd9b700 1 -- 172.21.15.72:0/2743462124 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90011830 con 0x7f6fa015e7f0 2023-10-14T12:34:07.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9dd9b700 1 -- 172.21.15.72:0/2743462124 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f90011990 con 0x7f6fa015e7f0 2023-10-14T12:34:07.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.054+0000 7f6f9dd9b700 1 -- 172.21.15.72:0/2743462124 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90011d20 con 0x7f6fa015e7f0 2023-10-14T12:34:07.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.055+0000 7f6fa5153700 1 -- 172.21.15.72:0/2743462124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa015e7f0 msgr2=0x7f6fa006ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:07.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.055+0000 7f6fa5153700 1 --2- 172.21.15.72:0/2743462124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa015e7f0 0x7f6fa006ac00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009840 tx=0x7f6f90009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:07.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.055+0000 7f6fa5153700 1 -- 172.21.15.72:0/2743462124 shutdown_connections 2023-10-14T12:34:07.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.055+0000 7f6fa5153700 1 --2- 172.21.15.72:0/2743462124 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.055+0000 7f6fa5153700 1 --2- 172.21.15.72:0/2743462124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa015e7f0 0x7f6fa006ac00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.055+0000 7f6fa5153700 1 -- 172.21.15.72:0/2743462124 >> 172.21.15.72:0/2743462124 conn(0x7f6fa00d0180 msgr2=0x7f6fa00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:07.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.055+0000 7f6fa5153700 1 -- 172.21.15.72:0/2743462124 shutdown_connections 2023-10-14T12:34:07.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.055+0000 7f6fa5153700 1 -- 172.21.15.72:0/2743462124 wait complete. 2023-10-14T12:34:07.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.056+0000 7f6fa5153700 1 Processor -- start 2023-10-14T12:34:07.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6fa5153700 1 -- start start 2023-10-14T12:34:07.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6fa5153700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa01f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:07.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6fa5153700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa00ca7d0 0x7f6fa01f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:07.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6fa5153700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa015e7f0 0x7f6fa01f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:07.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6fa5153700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00ad780 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6fa5153700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00ad480 con 0x7f6fa015e7f0 2023-10-14T12:34:07.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6fa5153700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa01f6db0 con 0x7f6fa006a820 2023-10-14T12:34:07.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6f9e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa00ca7d0 0x7f6fa01f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:07.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6f9e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa00ca7d0 0x7f6fa01f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47338/0 (socket says 172.21.15.72:47338) 2023-10-14T12:34:07.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.057+0000 7f6f9e59c700 1 -- 172.21.15.72:0/1291192296 learned_addr learned my addr 172.21.15.72:0/1291192296 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:07.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f9f59e700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa015e7f0 0x7f6fa01f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:07.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f9ed9d700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa01f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:07.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f9e59c700 1 -- 172.21.15.72:0/1291192296 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 msgr2=0x7f6fa01f3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:07.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f9e59c700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa01f3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f9e59c700 1 -- 172.21.15.72:0/1291192296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa015e7f0 msgr2=0x7f6fa01f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:07.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f9e59c700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa015e7f0 0x7f6fa01f2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f9e59c700 1 -- 172.21.15.72:0/1291192296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94009550 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f9e59c700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa00ca7d0 0x7f6fa01f6560 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009b90 tx=0x7f6f90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f877fe700 1 -- 172.21.15.72:0/1291192296 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f900036a0 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f877fe700 1 -- 172.21.15.72:0/1291192296 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9001e070 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f900094a0 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6f877fe700 1 -- 172.21.15.72:0/1291192296 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90003a60 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.058+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa01f6aa0 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.059+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa004ebb0 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.059+0000 7f6f877fe700 1 -- 172.21.15.72:0/1291192296 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f90003bc0 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.060+0000 7f6f877fe700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6f8c06af00 0x7f6f8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:07.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.060+0000 7f6f877fe700 1 -- 172.21.15.72:0/1291192296 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f9008a6d0 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.060+0000 7f6f9ed9d700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6f8c06af00 0x7f6f8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:07.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.060+0000 7f6f9ed9d700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6f8c06af00 0x7f6f8c06d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f94006d30 tx=0x7f6f940092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:07.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.065+0000 7f6f877fe700 1 -- 172.21.15.72:0/1291192296 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f90055520 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.298+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6fa00ad8c0 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.299+0000 7f6f877fe700 1 -- 172.21.15.72:0/1291192296 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6f90020070 con 0x7f6fa00ca7d0 2023-10-14T12:34:07.300 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:34:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.300+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6f8c06af00 msgr2=0x7f6f8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.300+0000 7f6fa5153700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6f8c06af00 0x7f6f8c06d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f94006d30 tx=0x7f6f940092c0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.300+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa00ca7d0 msgr2=0x7f6fa01f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:07.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.300+0000 7f6fa5153700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa00ca7d0 0x7f6fa01f6560 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009b90 tx=0x7f6f90004750 comp rx=0 tx=0).stop 2023-10-14T12:34:07.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.300+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 shutdown_connections 2023-10-14T12:34:07.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.300+0000 7f6fa5153700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6f8c06af00 0x7f6f8c06d3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.300+0000 7f6fa5153700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa015e7f0 0x7f6fa01f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.300+0000 7f6fa5153700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6fa006a820 0x7f6fa01f3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.300+0000 7f6fa5153700 1 --2- 172.21.15.72:0/1291192296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fa00ca7d0 0x7f6fa01f6560 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.301+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 >> 172.21.15.72:0/1291192296 conn(0x7f6fa00d0180 msgr2=0x7f6fa00cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.301+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 shutdown_connections 2023-10-14T12:34:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:07.301+0000 7f6fa5153700 1 -- 172.21.15.72:0/1291192296 wait complete. 2023-10-14T12:34:07.314 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:34:07.314 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:34:07.314 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2023-10-14T12:34:07.315 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-14T12:34:07.315 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T12:34:07.315 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:34:07.315 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:34:07.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:34:07.316 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-14T12:34:07.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.316 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2023-10-14T12:34:07.334 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:34:07.334 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:34:07.334 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:34:07.335 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.335 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-10-14T12:34:07.335 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.335 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:07.335 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:07.336 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:07.336 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:07.336 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:07.336 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:07.336 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:34:07.337 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:07.337 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:34:07.337 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42341sec preferred_lft 42341sec 2023-10-14T12:34:07.337 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::45c0:aab0:b2b8:a5b5/64 scope link noprefixroute 2023-10-14T12:34:07.337 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.337 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:34:07.338 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 1a:6e:9b:8a:98:47 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:07.338 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T12:34:07.338 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.338 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::70cc:bcff:fe33:2f52/64 scope link tentative 2023-10-14T12:34:07.338 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.339 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:34:07.339 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 1a:6e:9b:8a:98:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:34:07.339 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::186e:9bff:fe8a:9847/64 scope link 2023-10-14T12:34:07.339 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.340 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:34:07.400 INFO:teuthology.orchestra.run.smithi123.stdout:1 2023-10-14T12:34:07.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.402 DEBUG:teuthology.orchestra.run.smithi123:> route 2023-10-14T12:34:07.461 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2023-10-14T12:34:07.461 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:34:07.462 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:34:07.462 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:34:07.462 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:34:07.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.463 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-10-14T12:34:07.463 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-10-14T12:34:07.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:34:07.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:34:07.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:34:07.465 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-10-14T12:34:07.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.566 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-10-14T12:34:07.582 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T12:34:07.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.584 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2023-10-14T12:34:07.640 INFO:teuthology.orchestra.run.smithi123.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-14T12:34:07.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.641 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-10-14T12:34:07.641 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-10-14T12:34:07.642 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T12:34:07.642 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-14T12:34:07.642 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-10-14T12:34:07.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.733 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T12:34:07.769 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:34:07.769 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:34:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:34:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-10-14T12:34:07.770 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.771 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:34:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 2a:3f:fd:4c:64:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:34:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:34:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.771 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::283f:fdff:fe4c:64b5/64 scope link 2023-10-14T12:34:07.772 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T12:34:07.860 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:34:07.860 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:34:07.861 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:34:07.861 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.861 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2023-10-14T12:34:07.861 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.861 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:34:07.862 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 2a:3f:fd:4c:64:b5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:34:07.862 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:34:07.862 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.862 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::283f:fdff:fe4c:64b5/64 scope link 2023-10-14T12:34:07.862 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:07.868 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-14T12:34:07.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:07.869 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-10-14T12:34:07.869 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-10-14T12:34:07.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-14T12:34:07.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T12:34:07.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-14T12:34:07.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-14T12:34:07.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-14T12:34:07.871 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-10-14T12:34:08.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:08.113 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2023-10-14T12:34:08.114 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2023-10-14T12:34:08.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.1 up 2023-10-14T12:34:08.114 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T12:34:08.114 DEBUG:teuthology.orchestra.run.smithi123:> ') 2023-10-14T12:34:08.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:08.223 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-14T12:34:08.243 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-14T12:34:08.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:08.244 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-14T12:34:08.299 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-14T12:34:08.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:08.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:08.384 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:08.384 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:08.410 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:08.410 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:08.410 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:08.410 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with new device syntax: 3@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:08.411 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:08.411 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:08.411 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:08.411 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:08.440 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:08.441 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:08.441 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:08.442 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with new device syntax: 3@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:08.442 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:08.442 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:08.443 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:08.443 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:08.443 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790" 2023-10-14T12:34:08.444 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790:/ 2023-10-14T12:34:08.444 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8" will pass to kernel 2023-10-14T12:34:08.446 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T12:34:08.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:08.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-14T12:34:08.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:08.476 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:08.549 INFO:teuthology.orchestra.run.smithi123.stdout:client4812 2023-10-14T12:34:08.549 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:08.550 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:08.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:08.609 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:08.681 INFO:teuthology.orchestra.run.smithi123.stdout:client4812 2023-10-14T12:34:08.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:08.682 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T12:34:08.753 INFO:teuthology.orchestra.run.smithi123.stdout:client4812 2023-10-14T12:34:08.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:08.754 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.client4812/status') 2023-10-14T12:34:08.834 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.4812 (3)172.21.15.123:0/1231806481 2023-10-14T12:34:08.834 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2023-10-14T12:34:08.835 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2023-10-14T12:34:08.835 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2023-10-14T12:34:08.835 INFO:teuthology.orchestra.run.smithi123.stderr:71 bytes copied, 2.0989e-05 s, 3.4 MB/s 2023-10-14T12:34:08.836 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T12:34:08.853 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:08.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.986+0000 7fb048d3b700 1 Processor -- start 2023-10-14T12:34:08.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.986+0000 7fb048d3b700 1 -- start start 2023-10-14T12:34:08.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb048d3b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb044160b50 0x7fb0440cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:08.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb048d3b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0440b9000 0x7fb0440b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:08.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb048d3b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b5530 0x7fb0441611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:08.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb048d3b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0440b59c0 con 0x7fb0440b9000 2023-10-14T12:34:08.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb048d3b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0440b94b0 con 0x7fb044160b50 2023-10-14T12:34:08.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb048d3b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440d0010 con 0x7fb0440b5530 2023-10-14T12:34:08.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb041d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0440b9000 0x7fb0440b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb041d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0440b9000 0x7fb0440b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47350/0 (socket says 172.21.15.72:47350) 2023-10-14T12:34:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb041d9b700 1 -- 172.21.15.72:0/3217869599 learned_addr learned my addr 172.21.15.72:0/3217869599 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb04259c700 1 --2- 172.21.15.72:0/3217869599 >> v2:172.21.15.123:3300/0 conn(0x7fb044160b50 0x7fb0440cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb041d9b700 1 -- 172.21.15.72:0/3217869599 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b5530 msgr2=0x7fb0441611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb041d9b700 1 --2- 172.21.15.72:0/3217869599 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b5530 0x7fb0441611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb041d9b700 1 -- 172.21.15.72:0/3217869599 >> v2:172.21.15.123:3300/0 conn(0x7fb044160b50 msgr2=0x7fb0440cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb041d9b700 1 --2- 172.21.15.72:0/3217869599 >> v2:172.21.15.123:3300/0 conn(0x7fb044160b50 0x7fb0440cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb041d9b700 1 -- 172.21.15.72:0/3217869599 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440d02f0 con 0x7fb0440b9000 2023-10-14T12:34:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb041d9b700 1 --2- 172.21.15.72:0/3217869599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b9000 0x7fb0440b4ff0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb0380098f0 tx=0x7fb038009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f844e1be83718d5d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.987+0000 7fb04159a700 1 -- 172.21.15.72:0/3217869599 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800b860 con 0x7fb0440b9000 2023-10-14T12:34:08.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb04159a700 1 -- 172.21.15.72:0/3217869599 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800b9c0 con 0x7fb0440b9000 2023-10-14T12:34:08.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb04159a700 1 -- 172.21.15.72:0/3217869599 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800bd50 con 0x7fb0440b9000 2023-10-14T12:34:08.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb048d3b700 1 -- 172.21.15.72:0/3217869599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b9000 msgr2=0x7fb0440b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:08.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb048d3b700 1 --2- 172.21.15.72:0/3217869599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b9000 0x7fb0440b4ff0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb0380098f0 tx=0x7fb038009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb048d3b700 1 -- 172.21.15.72:0/3217869599 shutdown_connections 2023-10-14T12:34:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb048d3b700 1 --2- 172.21.15.72:0/3217869599 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b5530 0x7fb0441611f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb048d3b700 1 --2- 172.21.15.72:0/3217869599 >> v2:172.21.15.123:3300/0 conn(0x7fb044160b50 0x7fb0440cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb048d3b700 1 --2- 172.21.15.72:0/3217869599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b9000 0x7fb0440b4ff0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb048d3b700 1 -- 172.21.15.72:0/3217869599 >> 172.21.15.72:0/3217869599 conn(0x7fb04406bc70 msgr2=0x7fb04406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb048d3b700 1 -- 172.21.15.72:0/3217869599 shutdown_connections 2023-10-14T12:34:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.988+0000 7fb048d3b700 1 -- 172.21.15.72:0/3217869599 wait complete. 2023-10-14T12:34:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.990+0000 7fb048d3b700 1 Processor -- start 2023-10-14T12:34:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.990+0000 7fb048d3b700 1 -- start start 2023-10-14T12:34:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb048d3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b5530 0x7fb0441469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb048d3b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b9000 0x7fb0440ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb048d3b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb044160b50 0x7fb0440ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb048d3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044146f10 con 0x7fb0440b5530 2023-10-14T12:34:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb048d3b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440c9970 con 0x7fb044160b50 2023-10-14T12:34:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb048d3b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440cd610 con 0x7fb0440b9000 2023-10-14T12:34:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb04259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b5530 0x7fb0441469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb04259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b5530 0x7fb0441469d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47354/0 (socket says 172.21.15.72:47354) 2023-10-14T12:34:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb04259c700 1 -- 172.21.15.72:0/1717809834 learned_addr learned my addr 172.21.15.72:0/1717809834 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb042d9d700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb044160b50 0x7fb0440ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb041d9b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b9000 0x7fb0440ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb04259c700 1 -- 172.21.15.72:0/1717809834 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b9000 msgr2=0x7fb0440ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb04259c700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b9000 0x7fb0440ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb04259c700 1 -- 172.21.15.72:0/1717809834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb044160b50 msgr2=0x7fb0440ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb04259c700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb044160b50 0x7fb0440ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb04259c700 1 -- 172.21.15.72:0/1717809834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038009550 con 0x7fb0440b5530 2023-10-14T12:34:09.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb041d9b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b9000 0x7fb0440ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:09.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.991+0000 7fb04259c700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b5530 0x7fb0441469d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb03400c820 tx=0x7fb03400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:09.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.992+0000 7fb032ffd700 1 -- 172.21.15.72:0/1717809834 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034011800 con 0x7fb0440b5530 2023-10-14T12:34:09.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.992+0000 7fb032ffd700 1 -- 172.21.15.72:0/1717809834 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb034011960 con 0x7fb0440b5530 2023-10-14T12:34:09.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.992+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0440cc570 con 0x7fb0440b5530 2023-10-14T12:34:09.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.992+0000 7fb032ffd700 1 -- 172.21.15.72:0/1717809834 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034011cf0 con 0x7fb0440b5530 2023-10-14T12:34:09.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.992+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0440ccb30 con 0x7fb0440b5530 2023-10-14T12:34:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.993+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04404ebb0 con 0x7fb0440b5530 2023-10-14T12:34:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.993+0000 7fb032ffd700 1 -- 172.21.15.72:0/1717809834 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb034018360 con 0x7fb0440b5530 2023-10-14T12:34:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.994+0000 7fb032ffd700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.994+0000 7fb041d9b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.994+0000 7fb032ffd700 1 -- 172.21.15.72:0/1717809834 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb034089740 con 0x7fb0440b5530 2023-10-14T12:34:09.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.994+0000 7fb041d9b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb038000c00 tx=0x7fb038008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:09.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:08.998+0000 7fb032ffd700 1 -- 172.21.15.72:0/1717809834 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb034054500 con 0x7fb0440b5530 2023-10-14T12:34:09.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.187+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb044155b40 con 0x7fb0440b5530 2023-10-14T12:34:09.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.188+0000 7fb032ffd700 1 -- 172.21.15.72:0/1717809834 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fb034015090 con 0x7fb0440b5530 2023-10-14T12:34:09.190 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:09.191 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:09.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 msgr2=0x7fb02406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb038000c00 tx=0x7fb038008030 comp rx=0 tx=0).stop 2023-10-14T12:34:09.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b5530 msgr2=0x7fb0441469d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b5530 0x7fb0441469d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb03400c820 tx=0x7fb03400cb30 comp rx=0 tx=0).stop 2023-10-14T12:34:09.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 shutdown_connections 2023-10-14T12:34:09.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb02406af00 0x7fb02406d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb044160b50 0x7fb0440ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0440b5530 0x7fb0441469d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 --2- 172.21.15.72:0/1717809834 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb0440b9000 0x7fb0440ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 >> 172.21.15.72:0/1717809834 conn(0x7fb04406bc70 msgr2=0x7fb044156060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:09.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 shutdown_connections 2023-10-14T12:34:09.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.190+0000 7fb048d3b700 1 -- 172.21.15.72:0/1717809834 wait complete. 2023-10-14T12:34:09.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:09.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.327+0000 7f84df89f700 1 Processor -- start 2023-10-14T12:34:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.328+0000 7f84df89f700 1 -- start start 2023-10-14T12:34:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.328+0000 7f84df89f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d80b33f0 0x7f84d806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.328+0000 7f84df89f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d8070620 con 0x7f84d815b4e0 2023-10-14T12:34:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.328+0000 7f84df89f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d8070900 con 0x7f84d80cd770 2023-10-14T12:34:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.328+0000 7f84df89f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8070be0 con 0x7f84d80b33f0 2023-10-14T12:34:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.328+0000 7f84dd63b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f84d815b4e0 0x7f84d80b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53662/0 (socket says 172.21.15.72:53662) 2023-10-14T12:34:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.328+0000 7f84dd63b700 1 -- 172.21.15.72:0/3827045936 learned_addr learned my addr 172.21.15.72:0/3827045936 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84dce3a700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d80b33f0 0x7f84d806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792863643 0 0) 0x7f84d8070620 con 0x7f84d815b4e0 2023-10-14T12:34:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84c40035b0 con 0x7f84d815b4e0 2023-10-14T12:34:09.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795317085 0 0) 0x7f84d8070900 con 0x7f84d80cd770 2023-10-14T12:34:09.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d8070620 con 0x7f84d80cd770 2023-10-14T12:34:09.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1617592454 0 0) 0x7f84c40035b0 con 0x7f84d815b4e0 2023-10-14T12:34:09.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d80b33f0 msgr2=0x7f84d806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d80b33f0 0x7f84d806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 >> v1:172.21.15.123:6789/0 conn(0x7f84d80cd770 legacy=0x7f84d80b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d8070ec0 con 0x7f84d815b4e0 2023-10-14T12:34:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f84c8001670 con 0x7f84d815b4e0 2023-10-14T12:34:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 >> v1:172.21.15.72:6789/0 conn(0x7f84d815b4e0 legacy=0x7f84d80b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c4003bc0 0x7f84c4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d80b33f0 0x7f84c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84c4004d90 0x7f84c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8070be0 con 0x7f84c4004d90 2023-10-14T12:34:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c400baf0 con 0x7f84c4003bc0 2023-10-14T12:34:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c400bcb0 con 0x7f84d80b33f0 2023-10-14T12:34:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84dd63b700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c4003bc0 0x7f84c4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84dde3c700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84c4004d90 0x7f84c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.329+0000 7f84dce3a700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d80b33f0 0x7f84c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84dde3c700 1 -- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d80b33f0 msgr2=0x7f84c4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84dde3c700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d80b33f0 0x7f84c4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84dde3c700 1 -- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c4003bc0 msgr2=0x7f84c4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84dde3c700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c4003bc0 0x7f84c4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84dde3c700 1 -- 172.21.15.72:0/3827045936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c40035b0 con 0x7f84c4004d90 2023-10-14T12:34:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84dde3c700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84c4004d90 0x7f84c4005210 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c2f0 tx=0x7f84c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7f38496295973b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0001f30 con 0x7f84c4004d90 2023-10-14T12:34:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d000ce90 con 0x7f84c4004d90 2023-10-14T12:34:09.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84cffff700 1 -- 172.21.15.72:0/3827045936 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0003c40 con 0x7f84c4004d90 2023-10-14T12:34:09.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84df89f700 1 -- 172.21.15.72:0/3827045936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84c4004d90 msgr2=0x7f84c4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84df89f700 1 --2- 172.21.15.72:0/3827045936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84c4004d90 0x7f84c4005210 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c2f0 tx=0x7f84c4005880 comp rx=0 tx=0).stop 2023-10-14T12:34:09.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84dde3c700 1 -- 172.21.15.72:0/3827045936 reap_dead start 2023-10-14T12:34:09.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84df89f700 1 -- 172.21.15.72:0/3827045936 shutdown_connections 2023-10-14T12:34:09.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84df89f700 1 -- 172.21.15.72:0/3827045936 >> 172.21.15.72:0/3827045936 conn(0x7f84d80cdce0 msgr2=0x7f84d80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:09.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84df89f700 1 -- 172.21.15.72:0/3827045936 shutdown_connections 2023-10-14T12:34:09.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.330+0000 7f84df89f700 1 -- 172.21.15.72:0/3827045936 wait complete. 2023-10-14T12:34:09.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84df89f700 1 Processor -- start 2023-10-14T12:34:09.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84df89f700 1 -- start start 2023-10-14T12:34:09.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84df89f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8153060 0x7f84d8155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84df89f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84d81e16d0 0x7f84d8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84df89f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d81546b0 0x7f84d8157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84df89f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8153440 con 0x7f84d8153060 2023-10-14T12:34:09.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84df89f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8154bb0 con 0x7f84d81e16d0 2023-10-14T12:34:09.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84df89f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8154e90 con 0x7f84d81546b0 2023-10-14T12:34:09.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84dd63b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8153060 0x7f84d8155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84dd63b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8153060 0x7f84d8155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47374/0 (socket says 172.21.15.72:47374) 2023-10-14T12:34:09.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.332+0000 7f84dd63b700 1 -- 172.21.15.72:0/4183293863 learned_addr learned my addr 172.21.15.72:0/4183293863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:09.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84dd63b700 1 -- 172.21.15.72:0/4183293863 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d81546b0 msgr2=0x7f84d8157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84dd63b700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d81546b0 0x7f84d8157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84dce3a700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84d81e16d0 0x7f84d8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84dd63b700 1 -- 172.21.15.72:0/4183293863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84d81e16d0 msgr2=0x7f84d8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84dd63b700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84d81e16d0 0x7f84d8156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84dd63b700 1 -- 172.21.15.72:0/4183293863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d8155170 con 0x7f84d8153060 2023-10-14T12:34:09.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84dd63b700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8153060 0x7f84d8155c50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f84c8007290 tx=0x7f84c8007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:09.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84cdffb700 1 -- 172.21.15.72:0/4183293863 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800f870 con 0x7f84d8153060 2023-10-14T12:34:09.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84cdffb700 1 -- 172.21.15.72:0/4183293863 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c800f9f0 con 0x7f84d8153060 2023-10-14T12:34:09.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84cdffb700 1 -- 172.21.15.72:0/4183293863 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800fda0 con 0x7f84d8153060 2023-10-14T12:34:09.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d8155450 con 0x7f84d8153060 2023-10-14T12:34:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.333+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d81536a0 con 0x7f84d8153060 2023-10-14T12:34:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.334+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d804ebb0 con 0x7f84d8153060 2023-10-14T12:34:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.334+0000 7f84cdffb700 1 -- 172.21.15.72:0/4183293863 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f84c801d460 con 0x7f84d8153060 2023-10-14T12:34:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.335+0000 7f84cdffb700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f84bc06af00 0x7f84bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.335+0000 7f84cdffb700 1 -- 172.21.15.72:0/4183293863 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84c8089960 con 0x7f84d8153060 2023-10-14T12:34:09.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.335+0000 7f84dce3a700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f84bc06af00 0x7f84bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.335+0000 7f84dce3a700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f84bc06af00 0x7f84bc06d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f84d806ef40 tx=0x7f84d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:09.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.339+0000 7f84cdffb700 1 -- 172.21.15.72:0/4183293863 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84c8054720 con 0x7f84d8153060 2023-10-14T12:34:09.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.529+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84d80d0bf0 con 0x7f84d8153060 2023-10-14T12:34:09.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.529+0000 7f84cdffb700 1 -- 172.21.15.72:0/4183293863 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84c8057d40 con 0x7f84d8153060 2023-10-14T12:34:09.531 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:09.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.531+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f84bc06af00 msgr2=0x7f84bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.531+0000 7f84df89f700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f84bc06af00 0x7f84bc06d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f84d806ef40 tx=0x7f84d4008040 comp rx=0 tx=0).stop 2023-10-14T12:34:09.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.531+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8153060 msgr2=0x7f84d8155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.531+0000 7f84df89f700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8153060 0x7f84d8155c50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f84c8007290 tx=0x7f84c8007650 comp rx=0 tx=0).stop 2023-10-14T12:34:09.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.531+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 shutdown_connections 2023-10-14T12:34:09.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.532+0000 7f84df89f700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f84bc06af00 0x7f84bc06d3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.532+0000 7f84df89f700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f84d81546b0 0x7f84d8157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.532+0000 7f84df89f700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84d8153060 0x7f84d8155c50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.532+0000 7f84df89f700 1 --2- 172.21.15.72:0/4183293863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84d81e16d0 0x7f84d8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.532+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 >> 172.21.15.72:0/4183293863 conn(0x7f84d80cdce0 msgr2=0x7f84d80c66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:09.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.532+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 shutdown_connections 2023-10-14T12:34:09.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.532+0000 7f84df89f700 1 -- 172.21.15.72:0/4183293863 wait complete. 2023-10-14T12:34:09.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.668+0000 7f1bbf1e8700 1 Processor -- start 2023-10-14T12:34:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.668+0000 7f1bbf1e8700 1 -- start start 2023-10-14T12:34:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbf1e8700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bb80717e0 0x7f1bb8071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbf1e8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbf1e8700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb8072100 con 0x7f1bb80af6f0 2023-10-14T12:34:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbf1e8700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb80cb9b0 con 0x7f1bb80717e0 2023-10-14T12:34:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbf1e8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80cbc90 con 0x7f1bb80af290 2023-10-14T12:34:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bb7fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbcf84700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bb80717e0 0x7f1bb8071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbd785700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1bb80af6f0 0x7f1bb806df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51884/0 (socket says 172.21.15.72:51884) 2023-10-14T12:34:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bb7fff700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb815b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:43034/0 (socket says 172.21.15.72:43034) 2023-10-14T12:34:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbcf84700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bb80717e0 0x7f1bb8071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:35534/0 (socket says 172.21.15.72:35534) 2023-10-14T12:34:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bb7fff700 1 -- 172.21.15.72:0/2409712602 learned_addr learned my addr 172.21.15.72:0/2409712602 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:09.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbcf84700 1 -- 172.21.15.72:0/2409712602 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 msgr2=0x7f1bb815b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:09.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbcf84700 1 --2- 172.21.15.72:0/2409712602 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb815b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbcf84700 1 -- 172.21.15.72:0/2409712602 >> v1:172.21.15.123:6789/0 conn(0x7f1bb80af6f0 legacy=0x7f1bb806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.669+0000 7f1bbcf84700 1 -- 172.21.15.72:0/2409712602 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb80cbf70 con 0x7f1bb80717e0 2023-10-14T12:34:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bbcf84700 1 --2- 172.21.15.72:0/2409712602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb80717e0 0x7f1bb8071bc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009840 tx=0x7f1bac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d006064d3704e11 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bb77fe700 1 -- 172.21.15.72:0/2409712602 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac011830 con 0x7f1bb80717e0 2023-10-14T12:34:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bb77fe700 1 -- 172.21.15.72:0/2409712602 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac011990 con 0x7f1bb80717e0 2023-10-14T12:34:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bb77fe700 1 -- 172.21.15.72:0/2409712602 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac011d20 con 0x7f1bb80717e0 2023-10-14T12:34:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2409712602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb80717e0 msgr2=0x7f1bb8071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bbf1e8700 1 --2- 172.21.15.72:0/2409712602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb80717e0 0x7f1bb8071bc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009840 tx=0x7f1bac009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2409712602 shutdown_connections 2023-10-14T12:34:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bbf1e8700 1 --2- 172.21.15.72:0/2409712602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb80717e0 0x7f1bb8071bc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bbf1e8700 1 --2- 172.21.15.72:0/2409712602 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb815b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2409712602 >> 172.21.15.72:0/2409712602 conn(0x7f1bb80d0180 msgr2=0x7f1bb80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.670+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2409712602 shutdown_connections 2023-10-14T12:34:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.671+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2409712602 wait complete. 2023-10-14T12:34:09.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.672+0000 7f1bbf1e8700 1 Processor -- start 2023-10-14T12:34:09.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.672+0000 7f1bbf1e8700 1 -- start start 2023-10-14T12:34:09.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbf1e8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb80717e0 0x7f1bb81555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbf1e8700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb81f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbf1e8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb80af6f0 0x7f1bb80b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbf1e8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb81f1090 con 0x7f1bb80717e0 2023-10-14T12:34:09.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbf1e8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80b3b50 con 0x7f1bb80af6f0 2023-10-14T12:34:09.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbf1e8700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80b2f40 con 0x7f1bb80af290 2023-10-14T12:34:09.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbcf84700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb80717e0 0x7f1bb81555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbcf84700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb80717e0 0x7f1bb81555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47388/0 (socket says 172.21.15.72:47388) 2023-10-14T12:34:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbcf84700 1 -- 172.21.15.72:0/2167284700 learned_addr learned my addr 172.21.15.72:0/2167284700 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbd785700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb80af6f0 0x7f1bb80b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bb7fff700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb81f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbcf84700 1 -- 172.21.15.72:0/2167284700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 msgr2=0x7f1bb81f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbcf84700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb81f1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbcf84700 1 -- 172.21.15.72:0/2167284700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb80af6f0 msgr2=0x7f1bb80b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbcf84700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb80af6f0 0x7f1bb80b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbcf84700 1 -- 172.21.15.72:0/2167284700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac0094a0 con 0x7f1bb80717e0 2023-10-14T12:34:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bb7fff700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb81f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbcf84700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb80717e0 0x7f1bb81555e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0090b0 tx=0x7f1bac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bb57fa700 1 -- 172.21.15.72:0/2167284700 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac004480 con 0x7f1bb80717e0 2023-10-14T12:34:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bb57fa700 1 -- 172.21.15.72:0/2167284700 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac0045e0 con 0x7f1bb80717e0 2023-10-14T12:34:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb80b3220 con 0x7f1bb80717e0 2023-10-14T12:34:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bb57fa700 1 -- 172.21.15.72:0/2167284700 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0038e0 con 0x7f1bb80717e0 2023-10-14T12:34:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.673+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb80b37e0 con 0x7f1bb80717e0 2023-10-14T12:34:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.674+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb80cb590 con 0x7f1bb80717e0 2023-10-14T12:34:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.675+0000 7f1bb57fa700 1 -- 172.21.15.72:0/2167284700 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1bac023070 con 0x7f1bb80717e0 2023-10-14T12:34:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.675+0000 7f1bb57fa700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b9c06af00 0x7f1b9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.675+0000 7f1bb57fa700 1 -- 172.21.15.72:0/2167284700 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1bac08c710 con 0x7f1bb80717e0 2023-10-14T12:34:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.675+0000 7f1bb7fff700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b9c06af00 0x7f1b9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.675+0000 7f1bb7fff700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b9c06af00 0x7f1b9c06d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1bb81f35f0 tx=0x7f1ba4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.680+0000 7f1bb57fa700 1 -- 172.21.15.72:0/2167284700 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1bac057560 con 0x7f1bb80717e0 2023-10-14T12:34:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.869+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bb804ebb0 con 0x7f1bb80717e0 2023-10-14T12:34:09.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.869+0000 7f1bb57fa700 1 -- 172.21.15.72:0/2167284700 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1bac05ab80 con 0x7f1bb80717e0 2023-10-14T12:34:09.871 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:09.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b9c06af00 msgr2=0x7f1b9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b9c06af00 0x7f1b9c06d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1bb81f35f0 tx=0x7f1ba4008040 comp rx=0 tx=0).stop 2023-10-14T12:34:09.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb80717e0 msgr2=0x7f1bb81555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:09.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb80717e0 0x7f1bb81555e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0090b0 tx=0x7f1bac004750 comp rx=0 tx=0).stop 2023-10-14T12:34:09.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 shutdown_connections 2023-10-14T12:34:09.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1b9c06af00 0x7f1b9c06d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb80af6f0 0x7f1bb80b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb80717e0 0x7f1bb81555e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 --2- 172.21.15.72:0/2167284700 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1bb80af290 0x7f1bb81f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:09.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 >> 172.21.15.72:0/2167284700 conn(0x7f1bb80d0180 msgr2=0x7f1bb80ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:09.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 shutdown_connections 2023-10-14T12:34:09.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:09.871+0000 7f1bbf1e8700 1 -- 172.21.15.72:0/2167284700 wait complete. 2023-10-14T12:34:09.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.006+0000 7f8fe3ebc700 1 Processor -- start 2023-10-14T12:34:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.007+0000 7f8fe3ebc700 1 -- start start 2023-10-14T12:34:10.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.007+0000 7f8fe3ebc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06b370 0x7f8fdc15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.007+0000 7f8fe3ebc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8fdc0cdd30 0x7f8fdc0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.007+0000 7f8fe3ebc700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fdc0ce6d0 con 0x7f8fdc06a820 2023-10-14T12:34:10.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe3ebc700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc161360 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe3ebc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc06b750 con 0x7f8fdc06b370 2023-10-14T12:34:10.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe2459700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8fdc0cdd30 0x7f8fdc0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe1c58700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06b370 0x7f8fdc15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe1457700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8fdc06a820 0x7f8fdc06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:51894/0 (socket says 172.21.15.72:51894) 2023-10-14T12:34:10.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe1457700 1 -- 172.21.15.72:0/4022904847 learned_addr learned my addr 172.21.15.72:0/4022904847 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:10.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe2459700 1 -- 172.21.15.72:0/4022904847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06b370 msgr2=0x7f8fdc15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:10.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe2459700 1 --2- 172.21.15.72:0/4022904847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06b370 0x7f8fdc15dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe2459700 1 -- 172.21.15.72:0/4022904847 >> v1:172.21.15.123:6789/0 conn(0x7f8fdc06a820 legacy=0x7f8fdc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe2459700 1 -- 172.21.15.72:0/4022904847 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc06dcc0 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.008+0000 7f8fe2459700 1 --2- 172.21.15.72:0/4022904847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0cdd30 0x7f8fdc0ce190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009d90 tx=0x7f8fd400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5682dee1fa1ce3f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:10.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe0c56700 1 -- 172.21.15.72:0/4022904847 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400e070 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe0c56700 1 -- 172.21.15.72:0/4022904847 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd400bb20 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe0c56700 1 -- 172.21.15.72:0/4022904847 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4012430 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/4022904847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0cdd30 msgr2=0x7f8fdc0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe3ebc700 1 --2- 172.21.15.72:0/4022904847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0cdd30 0x7f8fdc0ce190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009d90 tx=0x7f8fd400b330 comp rx=0 tx=0).stop 2023-10-14T12:34:10.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/4022904847 shutdown_connections 2023-10-14T12:34:10.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe3ebc700 1 --2- 172.21.15.72:0/4022904847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0cdd30 0x7f8fdc0ce190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe3ebc700 1 --2- 172.21.15.72:0/4022904847 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06b370 0x7f8fdc15dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/4022904847 >> 172.21.15.72:0/4022904847 conn(0x7f8fdc0ccbe0 msgr2=0x7f8fdc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:10.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/4022904847 shutdown_connections 2023-10-14T12:34:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.009+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/4022904847 wait complete. 2023-10-14T12:34:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.010+0000 7f8fe3ebc700 1 Processor -- start 2023-10-14T12:34:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe3ebc700 1 -- start start 2023-10-14T12:34:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe3ebc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06a820 0x7f8fdc156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe3ebc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc06b370 0x7f8fdc0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe3ebc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc0cdd30 0x7f8fdc0aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe3ebc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1f71e0 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe3ebc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc156f80 con 0x7f8fdc06b370 2023-10-14T12:34:10.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe3ebc700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc1f6660 con 0x7f8fdc06a820 2023-10-14T12:34:10.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe2459700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc0cdd30 0x7f8fdc0aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe2459700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc0cdd30 0x7f8fdc0aea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47406/0 (socket says 172.21.15.72:47406) 2023-10-14T12:34:10.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.011+0000 7f8fe2459700 1 -- 172.21.15.72:0/3695913246 learned_addr learned my addr 172.21.15.72:0/3695913246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:10.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe1457700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc06b370 0x7f8fdc0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe1c58700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06a820 0x7f8fdc156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe2459700 1 -- 172.21.15.72:0/3695913246 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06a820 msgr2=0x7f8fdc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe2459700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06a820 0x7f8fdc156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe2459700 1 -- 172.21.15.72:0/3695913246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc06b370 msgr2=0x7f8fdc0c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe2459700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc06b370 0x7f8fdc0c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe2459700 1 -- 172.21.15.72:0/3695913246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4009a70 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe1c58700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06a820 0x7f8fdc156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:10.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe2459700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc0cdd30 0x7f8fdc0aea60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4014040 tx=0x7f8fd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fd27fc700 1 -- 172.21.15.72:0/3695913246 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4012430 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fd27fc700 1 -- 172.21.15.72:0/3695913246 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4020070 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc1f6940 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fd27fc700 1 -- 172.21.15.72:0/3695913246 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4003ea0 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.012+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc1f6f00 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.013+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc072d10 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.013+0000 7f8fd27fc700 1 -- 172.21.15.72:0/3695913246 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8fd4004280 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.014+0000 7f8fd27fc700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8fc006af00 0x7f8fc006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.014+0000 7f8fd27fc700 1 -- 172.21.15.72:0/3695913246 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8fd4022070 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.014+0000 7f8fe1c58700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8fc006af00 0x7f8fc006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.014+0000 7f8fe1c58700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8fc006af00 0x7f8fc006d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009b60 tx=0x7f8fcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:10.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.018+0000 7f8fd27fc700 1 -- 172.21.15.72:0/3695913246 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fd4056420 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.207+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8fdc04ebb0 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.207+0000 7f8fd27fc700 1 -- 172.21.15.72:0/3695913246 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8fd4059a40 con 0x7f8fdc0cdd30 2023-10-14T12:34:10.209 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:10.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8fc006af00 msgr2=0x7f8fc006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8fc006af00 0x7f8fc006d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009b60 tx=0x7f8fcc008040 comp rx=0 tx=0).stop 2023-10-14T12:34:10.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc0cdd30 msgr2=0x7f8fdc0aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc0cdd30 0x7f8fdc0aea60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4014040 tx=0x7f8fd4004ad0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 shutdown_connections 2023-10-14T12:34:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8fc006af00 0x7f8fc006d3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fdc0cdd30 0x7f8fdc0aea60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8fdc06a820 0x7f8fdc156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 --2- 172.21.15.72:0/3695913246 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc06b370 0x7f8fdc0c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 >> 172.21.15.72:0/3695913246 conn(0x7f8fdc0ccbe0 msgr2=0x7f8fdc160490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 shutdown_connections 2023-10-14T12:34:10.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.209+0000 7f8fe3ebc700 1 -- 172.21.15.72:0/3695913246 wait complete. 2023-10-14T12:34:10.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.344+0000 7fd05d9ea700 1 Processor -- start 2023-10-14T12:34:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.344+0000 7fd05d9ea700 1 -- start start 2023-10-14T12:34:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd05d9ea700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd05806bef0 0x7fd0580ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd05d9ea700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0580ce5e0 con 0x7fd0580b9060 2023-10-14T12:34:10.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd05d9ea700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0580cf420 con 0x7fd05815d760 2023-10-14T12:34:10.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd05d9ea700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580b94c0 con 0x7fd05806bef0 2023-10-14T12:34:10.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd0567fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd0580b9060 0x7fd05806b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53710/0 (socket says 172.21.15.72:53710) 2023-10-14T12:34:10.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd0567fc700 1 -- 172.21.15.72:0/395262894 learned_addr learned my addr 172.21.15.72:0/395262894 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:10.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd0577fe700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd05806bef0 0x7fd0580ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758172006 0 0) 0x7fd0580ce5e0 con 0x7fd0580b9060 2023-10-14T12:34:10.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0400035b0 con 0x7fd0580b9060 2023-10-14T12:34:10.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067877087 0 0) 0x7fd0580cf420 con 0x7fd05815d760 2023-10-14T12:34:10.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0580ce5e0 con 0x7fd05815d760 2023-10-14T12:34:10.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3628757585 0 0) 0x7fd0400035b0 con 0x7fd0580b9060 2023-10-14T12:34:10.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd05806bef0 msgr2=0x7fd0580ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:10.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd05806bef0 0x7fd0580ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 >> v1:172.21.15.123:6789/0 conn(0x7fd05815d760 legacy=0x7fd0580cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580ce810 con 0x7fd0580b9060 2023-10-14T12:34:10.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7fd04c001670 con 0x7fd0580b9060 2023-10-14T12:34:10.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 >> v1:172.21.15.72:6789/0 conn(0x7fd0580b9060 legacy=0x7fd05806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd040003bc0 0x7fd040003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd05806bef0 0x7fd040004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd040004d90 0x7fd040005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580b94c0 con 0x7fd040003bc0 2023-10-14T12:34:10.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04000baf0 con 0x7fd040004d90 2023-10-14T12:34:10.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04000bcb0 con 0x7fd05806bef0 2023-10-14T12:34:10.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd056ffd700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd040003bc0 0x7fd040003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.345+0000 7fd0567fc700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd05806bef0 0x7fd040004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd0577fe700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd040004d90 0x7fd040005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd056ffd700 1 -- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd05806bef0 msgr2=0x7fd040004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:10.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd056ffd700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd05806bef0 0x7fd040004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd056ffd700 1 -- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd040004d90 msgr2=0x7fd040005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:10.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd056ffd700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd040004d90 0x7fd040005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd056ffd700 1 -- 172.21.15.72:0/395262894 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400035b0 con 0x7fd040003bc0 2023-10-14T12:34:10.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd056ffd700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd040003bc0 0x7fd040003fc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd048001980 tx=0x7fd040005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da88c9572aadc71 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:10.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048001470 con 0x7fd040003bc0 2023-10-14T12:34:10.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0480052d0 con 0x7fd040003bc0 2023-10-14T12:34:10.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd055ffb700 1 -- 172.21.15.72:0/395262894 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048003680 con 0x7fd040003bc0 2023-10-14T12:34:10.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd05d9ea700 1 -- 172.21.15.72:0/395262894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd040003bc0 msgr2=0x7fd040003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd05d9ea700 1 --2- 172.21.15.72:0/395262894 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd040003bc0 0x7fd040003fc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd048001980 tx=0x7fd040005880 comp rx=0 tx=0).stop 2023-10-14T12:34:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.346+0000 7fd0577fe700 1 -- 172.21.15.72:0/395262894 reap_dead start 2023-10-14T12:34:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.347+0000 7fd05d9ea700 1 -- 172.21.15.72:0/395262894 shutdown_connections 2023-10-14T12:34:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.347+0000 7fd05d9ea700 1 -- 172.21.15.72:0/395262894 >> 172.21.15.72:0/395262894 conn(0x7fd058072340 msgr2=0x7fd058072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.347+0000 7fd05d9ea700 1 -- 172.21.15.72:0/395262894 shutdown_connections 2023-10-14T12:34:10.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.347+0000 7fd05d9ea700 1 -- 172.21.15.72:0/395262894 wait complete. 2023-10-14T12:34:10.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.348+0000 7fd05d9ea700 1 Processor -- start 2023-10-14T12:34:10.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.348+0000 7fd05d9ea700 1 -- start start 2023-10-14T12:34:10.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd05d9ea700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd040003bc0 0x7fd05814c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd05d9ea700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0580cb670 0x7fd05815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd05d9ea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05815e080 0x7fd058160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd05d9ea700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0580b4090 con 0x7fd05815e080 2023-10-14T12:34:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd05d9ea700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05815e590 con 0x7fd0580cb670 2023-10-14T12:34:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd05d9ea700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05815e870 con 0x7fd040003bc0 2023-10-14T12:34:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05815e080 0x7fd058160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05815e080 0x7fd058160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47426/0 (socket says 172.21.15.72:47426) 2023-10-14T12:34:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0577fe700 1 -- 172.21.15.72:0/2372996272 learned_addr learned my addr 172.21.15.72:0/2372996272 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0567fc700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0580cb670 0x7fd05815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd056ffd700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd040003bc0 0x7fd05814c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0577fe700 1 -- 172.21.15.72:0/2372996272 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd040003bc0 msgr2=0x7fd05814c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0577fe700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd040003bc0 0x7fd05814c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0577fe700 1 -- 172.21.15.72:0/2372996272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0580cb670 msgr2=0x7fd05815db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0577fe700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0580cb670 0x7fd05815db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0577fe700 1 -- 172.21.15.72:0/2372996272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0580b3d20 con 0x7fd05815e080 2023-10-14T12:34:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd056ffd700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd040003bc0 0x7fd05814c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd0577fe700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05815e080 0x7fd058160040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd05808c6a0 tx=0x7fd050011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd03ffff700 1 -- 172.21.15.72:0/2372996272 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000e040 con 0x7fd05815e080 2023-10-14T12:34:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd03ffff700 1 -- 172.21.15.72:0/2372996272 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05000f040 con 0x7fd05815e080 2023-10-14T12:34:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd03ffff700 1 -- 172.21.15.72:0/2372996272 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000fd00 con 0x7fd05815e080 2023-10-14T12:34:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.349+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05815eb50 con 0x7fd05815e080 2023-10-14T12:34:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.350+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0580b5c20 con 0x7fd05815e080 2023-10-14T12:34:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.350+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05804ebb0 con 0x7fd05815e080 2023-10-14T12:34:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.351+0000 7fd03ffff700 1 -- 172.21.15.72:0/2372996272 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd050022460 con 0x7fd05815e080 2023-10-14T12:34:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.351+0000 7fd03ffff700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd04406af00 0x7fd04406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.351+0000 7fd03ffff700 1 -- 172.21.15.72:0/2372996272 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd050089df0 con 0x7fd05815e080 2023-10-14T12:34:10.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.351+0000 7fd056ffd700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd04406af00 0x7fd04406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.352+0000 7fd056ffd700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd04406af00 0x7fd04406d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd048015040 tx=0x7fd04800a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:10.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.356+0000 7fd03ffff700 1 -- 172.21.15.72:0/2372996272 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd050054bb0 con 0x7fd05815e080 2023-10-14T12:34:10.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.546+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd0580b3eb0 con 0x7fd05815e080 2023-10-14T12:34:10.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.546+0000 7fd03ffff700 1 -- 172.21.15.72:0/2372996272 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd0500581d0 con 0x7fd05815e080 2023-10-14T12:34:10.548 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:10.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.548+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd04406af00 msgr2=0x7fd04406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.548+0000 7fd05d9ea700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd04406af00 0x7fd04406d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd048015040 tx=0x7fd04800a000 comp rx=0 tx=0).stop 2023-10-14T12:34:10.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.548+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05815e080 msgr2=0x7fd058160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.548+0000 7fd05d9ea700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05815e080 0x7fd058160040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd05808c6a0 tx=0x7fd050011ed0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.549+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 shutdown_connections 2023-10-14T12:34:10.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.549+0000 7fd05d9ea700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd04406af00 0x7fd04406d3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.549+0000 7fd05d9ea700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05815e080 0x7fd058160040 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.549+0000 7fd05d9ea700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd040003bc0 0x7fd05814c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.549+0000 7fd05d9ea700 1 --2- 172.21.15.72:0/2372996272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0580cb670 0x7fd05815db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.549+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 >> 172.21.15.72:0/2372996272 conn(0x7fd058072340 msgr2=0x7fd0580d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.549+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 shutdown_connections 2023-10-14T12:34:10.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.549+0000 7fd05d9ea700 1 -- 172.21.15.72:0/2372996272 wait complete. 2023-10-14T12:34:10.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:10.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.681+0000 7f9a79283700 1 Processor -- start 2023-10-14T12:34:10.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.681+0000 7f9a79283700 1 -- start start 2023-10-14T12:34:10.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.682+0000 7f9a79283700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a7406a820 0x7f9a740cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.682+0000 7f9a79283700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a7415e7f0 0x7f9a7406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.682+0000 7f9a79283700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a740cfeb0 con 0x7f9a740ca7d0 2023-10-14T12:34:10.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.682+0000 7f9a79283700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a740ce410 con 0x7f9a7406a820 2023-10-14T12:34:10.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.682+0000 7f9a79283700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7415ec50 con 0x7f9a7415e7f0 2023-10-14T12:34:10.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.682+0000 7f9a72ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a7406a820 0x7f9a740cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.682+0000 7f9a72ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a7406a820 0x7f9a740cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47430/0 (socket says 172.21.15.72:47430) 2023-10-14T12:34:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.682+0000 7f9a72ffd700 1 -- 172.21.15.72:0/3756717094 learned_addr learned my addr 172.21.15.72:0/3756717094 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.682+0000 7f9a727fc700 1 --2- 172.21.15.72:0/3756717094 >> v2:172.21.15.123:3300/0 conn(0x7f9a7415e7f0 0x7f9a7406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a72ffd700 1 -- 172.21.15.72:0/3756717094 >> v2:172.21.15.123:3300/0 conn(0x7f9a7415e7f0 msgr2=0x7f9a7406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a72ffd700 1 --2- 172.21.15.72:0/3756717094 >> v2:172.21.15.123:3300/0 conn(0x7f9a7415e7f0 0x7f9a7406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a72ffd700 1 -- 172.21.15.72:0/3756717094 >> v1:172.21.15.123:6789/0 conn(0x7f9a740ca7d0 legacy=0x7f9a74071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a72ffd700 1 -- 172.21.15.72:0/3756717094 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a740af9d0 con 0x7f9a7406a820 2023-10-14T12:34:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a72ffd700 1 --2- 172.21.15.72:0/3756717094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 0x7f9a740cf7d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a7406c8a0 tx=0x7f9a68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad67a06b270ddefd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a71ffb700 1 -- 172.21.15.72:0/3756717094 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68011830 con 0x7f9a7406a820 2023-10-14T12:34:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a71ffb700 1 -- 172.21.15.72:0/3756717094 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a68011990 con 0x7f9a7406a820 2023-10-14T12:34:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a71ffb700 1 -- 172.21.15.72:0/3756717094 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68011d20 con 0x7f9a7406a820 2023-10-14T12:34:10.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a79283700 1 -- 172.21.15.72:0/3756717094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 msgr2=0x7f9a740cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a79283700 1 --2- 172.21.15.72:0/3756717094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 0x7f9a740cf7d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a7406c8a0 tx=0x7f9a68009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a79283700 1 -- 172.21.15.72:0/3756717094 shutdown_connections 2023-10-14T12:34:10.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a79283700 1 --2- 172.21.15.72:0/3756717094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 0x7f9a740cf7d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a79283700 1 --2- 172.21.15.72:0/3756717094 >> v2:172.21.15.123:3300/0 conn(0x7f9a7415e7f0 0x7f9a7406ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.683+0000 7f9a79283700 1 -- 172.21.15.72:0/3756717094 >> 172.21.15.72:0/3756717094 conn(0x7f9a740d0180 msgr2=0x7f9a740d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:10.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.684+0000 7f9a79283700 1 -- 172.21.15.72:0/3756717094 shutdown_connections 2023-10-14T12:34:10.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.684+0000 7f9a79283700 1 -- 172.21.15.72:0/3756717094 wait complete. 2023-10-14T12:34:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.685+0000 7f9a79283700 1 Processor -- start 2023-10-14T12:34:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.685+0000 7f9a79283700 1 -- start start 2023-10-14T12:34:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a79283700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 0x7f9a74154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a79283700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740ca7d0 0x7f9a74160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a79283700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7415e7f0 0x7f9a7406e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a79283700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740ad800 con 0x7f9a7406a820 2023-10-14T12:34:10.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a79283700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740aeb10 con 0x7f9a740ca7d0 2023-10-14T12:34:10.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a79283700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740aedf0 con 0x7f9a7415e7f0 2023-10-14T12:34:10.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 0x7f9a74154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 0x7f9a74154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47436/0 (socket says 172.21.15.72:47436) 2023-10-14T12:34:10.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a72ffd700 1 -- 172.21.15.72:0/1108628967 learned_addr learned my addr 172.21.15.72:0/1108628967 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:10.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a727fc700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740ca7d0 0x7f9a74160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a737fe700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7415e7f0 0x7f9a7406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a72ffd700 1 -- 172.21.15.72:0/1108628967 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7415e7f0 msgr2=0x7f9a7406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a72ffd700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7415e7f0 0x7f9a7406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a72ffd700 1 -- 172.21.15.72:0/1108628967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740ca7d0 msgr2=0x7f9a74160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a72ffd700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740ca7d0 0x7f9a74160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a72ffd700 1 -- 172.21.15.72:0/1108628967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68009550 con 0x7f9a7406a820 2023-10-14T12:34:10.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a72ffd700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 0x7f9a74154d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000c00 tx=0x7f9a68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:10.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a5b7fe700 1 -- 172.21.15.72:0/1108628967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68004380 con 0x7f9a7406a820 2023-10-14T12:34:10.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a5b7fe700 1 -- 172.21.15.72:0/1108628967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6801f070 con 0x7f9a7406a820 2023-10-14T12:34:10.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a740af0d0 con 0x7f9a7406a820 2023-10-14T12:34:10.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a5b7fe700 1 -- 172.21.15.72:0/1108628967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a680036a0 con 0x7f9a7406a820 2023-10-14T12:34:10.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.686+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a741552c0 con 0x7f9a7406a820 2023-10-14T12:34:10.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.687+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a740adc90 con 0x7f9a7406a820 2023-10-14T12:34:10.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.688+0000 7f9a5b7fe700 1 -- 172.21.15.72:0/1108628967 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9a68021030 con 0x7f9a7406a820 2023-10-14T12:34:10.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.688+0000 7f9a5b7fe700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9a6006af00 0x7f9a6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:10.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.688+0000 7f9a5b7fe700 1 -- 172.21.15.72:0/1108628967 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a6808ac70 con 0x7f9a7406a820 2023-10-14T12:34:10.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.688+0000 7f9a727fc700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9a6006af00 0x7f9a6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:10.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.688+0000 7f9a727fc700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9a6006af00 0x7f9a6006d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a741607d0 tx=0x7f9a64009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:10.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.693+0000 7f9a5b7fe700 1 -- 172.21.15.72:0/1108628967 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a740adc90 con 0x7f9a7406a820 2023-10-14T12:34:10.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.886+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a740668b0 con 0x7f9a7406a820 2023-10-14T12:34:10.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.887+0000 7f9a5b7fe700 1 -- 172.21.15.72:0/1108628967 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f9a68055a40 con 0x7f9a7406a820 2023-10-14T12:34:10.888 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:10.889 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:10.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9a6006af00 msgr2=0x7f9a6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9a6006af00 0x7f9a6006d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a741607d0 tx=0x7f9a64009210 comp rx=0 tx=0).stop 2023-10-14T12:34:10.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 msgr2=0x7f9a74154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:10.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 0x7f9a74154d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9a68000c00 tx=0x7f9a68004750 comp rx=0 tx=0).stop 2023-10-14T12:34:10.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 shutdown_connections 2023-10-14T12:34:10.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9a6006af00 0x7f9a6006d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9a7415e7f0 0x7f9a7406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a7406a820 0x7f9a74154d80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 --2- 172.21.15.72:0/1108628967 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740ca7d0 0x7f9a74160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:10.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 >> 172.21.15.72:0/1108628967 conn(0x7f9a740d0180 msgr2=0x7f9a740b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:10.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 shutdown_connections 2023-10-14T12:34:10.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:10.889+0000 7f9a79283700 1 -- 172.21.15.72:0/1108628967 wait complete. 2023-10-14T12:34:10.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:10.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.026+0000 7f4e052f2700 1 Processor -- start 2023-10-14T12:34:11.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.026+0000 7f4e052f2700 1 -- start start 2023-10-14T12:34:11.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.026+0000 7f4e052f2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0015d760 0x7f4e000b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.026+0000 7f4e052f2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e0006b7e0 0x7f4e0006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.026+0000 7f4e052f2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e000cf420 con 0x7f4e000ce0a0 2023-10-14T12:34:11.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.026+0000 7f4e052f2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e000b95a0 con 0x7f4e0006b7e0 2023-10-14T12:34:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.026+0000 7f4e052f2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0006c1b0 con 0x7f4e0015d760 2023-10-14T12:34:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dff7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e0006b7e0 0x7f4e0006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dff7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e0006b7e0 0x7f4e0006bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47448/0 (socket says 172.21.15.72:47448) 2023-10-14T12:34:11.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dff7fe700 1 -- 172.21.15.72:0/823453093 learned_addr learned my addr 172.21.15.72:0/823453093 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dfeffd700 1 --2- 172.21.15.72:0/823453093 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0015d760 0x7f4e000b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dff7fe700 1 -- 172.21.15.72:0/823453093 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0015d760 msgr2=0x7f4e000b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dff7fe700 1 --2- 172.21.15.72:0/823453093 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0015d760 0x7f4e000b9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dff7fe700 1 -- 172.21.15.72:0/823453093 >> v1:172.21.15.123:6789/0 conn(0x7f4e000ce0a0 legacy=0x7f4e000cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dff7fe700 1 -- 172.21.15.72:0/823453093 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e000ce810 con 0x7f4e0006b7e0 2023-10-14T12:34:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dff7fe700 1 --2- 172.21.15.72:0/823453093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0006b7e0 0x7f4e0006bc70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009e50 tx=0x7f4df800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1591c50f53fa3cc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dfdffb700 1 -- 172.21.15.72:0/823453093 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800e070 con 0x7f4e0006b7e0 2023-10-14T12:34:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dfdffb700 1 -- 172.21.15.72:0/823453093 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800b9c0 con 0x7f4e0006b7e0 2023-10-14T12:34:11.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.027+0000 7f4dfdffb700 1 -- 172.21.15.72:0/823453093 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800bd70 con 0x7f4e0006b7e0 2023-10-14T12:34:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.028+0000 7f4e052f2700 1 -- 172.21.15.72:0/823453093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0006b7e0 msgr2=0x7f4e0006bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.028+0000 7f4e052f2700 1 --2- 172.21.15.72:0/823453093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0006b7e0 0x7f4e0006bc70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009e50 tx=0x7f4df800b330 comp rx=0 tx=0).stop 2023-10-14T12:34:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.028+0000 7f4e052f2700 1 -- 172.21.15.72:0/823453093 shutdown_connections 2023-10-14T12:34:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.028+0000 7f4e052f2700 1 --2- 172.21.15.72:0/823453093 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0015d760 0x7f4e000b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.028+0000 7f4e052f2700 1 --2- 172.21.15.72:0/823453093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0006b7e0 0x7f4e0006bc70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.028+0000 7f4e052f2700 1 -- 172.21.15.72:0/823453093 >> 172.21.15.72:0/823453093 conn(0x7f4e00072340 msgr2=0x7f4e00072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:11.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.028+0000 7f4e052f2700 1 -- 172.21.15.72:0/823453093 shutdown_connections 2023-10-14T12:34:11.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.028+0000 7f4e052f2700 1 -- 172.21.15.72:0/823453093 wait complete. 2023-10-14T12:34:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.029+0000 7f4e052f2700 1 Processor -- start 2023-10-14T12:34:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.029+0000 7f4e052f2700 1 -- start start 2023-10-14T12:34:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4e052f2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0006b7e0 0x7f4e000cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4e052f2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e000ce0a0 0x7f4e00159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4e052f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0015d760 0x7f4e001f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4e052f2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0015efd0 con 0x7f4e0015d760 2023-10-14T12:34:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4e052f2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e001f3630 con 0x7f4e000ce0a0 2023-10-14T12:34:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4e052f2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e001f3910 con 0x7f4e0006b7e0 2023-10-14T12:34:11.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0015d760 0x7f4e001f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0015d760 0x7f4e001f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47454/0 (socket says 172.21.15.72:47454) 2023-10-14T12:34:11.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dff7fe700 1 -- 172.21.15.72:0/2394722864 learned_addr learned my addr 172.21.15.72:0/2394722864 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:11.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dfe7fc700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e000ce0a0 0x7f4e00159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dfeffd700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0006b7e0 0x7f4e000cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dff7fe700 1 -- 172.21.15.72:0/2394722864 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0006b7e0 msgr2=0x7f4e000cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dff7fe700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0006b7e0 0x7f4e000cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dff7fe700 1 -- 172.21.15.72:0/2394722864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e000ce0a0 msgr2=0x7f4e00159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dff7fe700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e000ce0a0 0x7f4e00159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dff7fe700 1 -- 172.21.15.72:0/2394722864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8009b30 con 0x7f4e0015d760 2023-10-14T12:34:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.030+0000 7f4dff7fe700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0015d760 0x7f4e001f2e00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e0006c4f0 tx=0x7f4df8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.031+0000 7f4de77fe700 1 -- 172.21.15.72:0/2394722864 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df80047c0 con 0x7f4e0015d760 2023-10-14T12:34:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.031+0000 7f4de77fe700 1 -- 172.21.15.72:0/2394722864 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df80092e0 con 0x7f4e0015d760 2023-10-14T12:34:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.031+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e001f3bf0 con 0x7f4e0015d760 2023-10-14T12:34:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.031+0000 7f4de77fe700 1 -- 172.21.15.72:0/2394722864 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df801c660 con 0x7f4e0015d760 2023-10-14T12:34:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.031+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e001f3340 con 0x7f4e0015d760 2023-10-14T12:34:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.031+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e001f3d80 con 0x7f4e0015d760 2023-10-14T12:34:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.032+0000 7f4de77fe700 1 -- 172.21.15.72:0/2394722864 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4df801c7c0 con 0x7f4e0015d760 2023-10-14T12:34:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.032+0000 7f4de77fe700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4dec06af00 0x7f4dec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.032+0000 7f4de77fe700 1 -- 172.21.15.72:0/2394722864 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4df808b0e0 con 0x7f4e0015d760 2023-10-14T12:34:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.032+0000 7f4dfeffd700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4dec06af00 0x7f4dec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.033+0000 7f4dfeffd700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4dec06af00 0x7f4dec06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4df0006b20 tx=0x7f4df0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.037+0000 7f4de77fe700 1 -- 172.21.15.72:0/2394722864 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4df8055ea0 con 0x7f4e0015d760 2023-10-14T12:34:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.229+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e0004ebb0 con 0x7f4e0015d760 2023-10-14T12:34:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.230+0000 7f4de77fe700 1 -- 172.21.15.72:0/2394722864 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4df80594c0 con 0x7f4e0015d760 2023-10-14T12:34:11.232 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4dec06af00 msgr2=0x7f4dec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4dec06af00 0x7f4dec06d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4df0006b20 tx=0x7f4df0008040 comp rx=0 tx=0).stop 2023-10-14T12:34:11.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0015d760 msgr2=0x7f4e001f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0015d760 0x7f4e001f2e00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e0006c4f0 tx=0x7f4df8004ad0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 shutdown_connections 2023-10-14T12:34:11.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4dec06af00 0x7f4dec06d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e0015d760 0x7f4e001f2e00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4e0006b7e0 0x7f4e000cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 --2- 172.21.15.72:0/2394722864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e000ce0a0 0x7f4e00159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 >> 172.21.15.72:0/2394722864 conn(0x7f4e00072340 msgr2=0x7f4e000b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:11.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 shutdown_connections 2023-10-14T12:34:11.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.232+0000 7f4e052f2700 1 -- 172.21.15.72:0/2394722864 wait complete. 2023-10-14T12:34:11.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:11.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.369+0000 7f168ef7a700 1 Processor -- start 2023-10-14T12:34:11.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.369+0000 7f168ef7a700 1 -- start start 2023-10-14T12:34:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.369+0000 7f168ef7a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f168815a710 0x7f168815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.369+0000 7f168ef7a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16880ce520 con 0x7f168815a330 2023-10-14T12:34:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.369+0000 7f168ef7a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16880cdf60 con 0x7f16880ce740 2023-10-14T12:34:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.369+0000 7f168ef7a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168815e5e0 con 0x7f168815a710 2023-10-14T12:34:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.369+0000 7f168cd16700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f168815a330 0x7f16880725c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53758/0 (socket says 172.21.15.72:53758) 2023-10-14T12:34:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f168cd16700 1 -- 172.21.15.72:0/1182715996 learned_addr learned my addr 172.21.15.72:0/1182715996 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f1687fff700 1 --2- 172.21.15.72:0/1182715996 >> v2:172.21.15.123:3300/0 conn(0x7f168815a710 0x7f168815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080589426 0 0) 0x7f16880ce520 con 0x7f168815a330 2023-10-14T12:34:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16780035b0 con 0x7f168815a330 2023-10-14T12:34:11.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1508326489 0 0) 0x7f16780035b0 con 0x7f168815a330 2023-10-14T12:34:11.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 >> v2:172.21.15.123:3300/0 conn(0x7f168815a710 msgr2=0x7f168815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:11.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 --2- 172.21.15.72:0/1182715996 >> v2:172.21.15.123:3300/0 conn(0x7f168815a710 0x7f168815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 >> v1:172.21.15.123:6789/0 conn(0x7f16880ce740 legacy=0x7f1688071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880ce240 con 0x7f168815a330 2023-10-14T12:34:11.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f167c001670 con 0x7f168815a330 2023-10-14T12:34:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 >> v1:172.21.15.72:6789/0 conn(0x7f168815a330 legacy=0x7f16880725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678003a00 0x7f1678003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1678004850 0x7f1678004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1678005330 0x7f167800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168815e5e0 con 0x7f1678004850 2023-10-14T12:34:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167800c200 con 0x7f1678003a00 2023-10-14T12:34:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167800c3c0 con 0x7f1678005330 2023-10-14T12:34:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f1687fff700 1 --2- 172.21.15.72:0/1182715996 >> v2:172.21.15.123:3300/0 conn(0x7f168815a710 0x7f168815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f1687fff700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1678004850 0x7f1678004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f168cd16700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678003a00 0x7f1678003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f168d517700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1678005330 0x7f167800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f1687fff700 1 -- 172.21.15.72:0/1182715996 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1678005330 msgr2=0x7f167800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f1687fff700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1678005330 0x7f167800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f1687fff700 1 -- 172.21.15.72:0/1182715996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678003a00 msgr2=0x7f1678003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f1687fff700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678003a00 0x7f1678003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.370+0000 7f168d517700 1 -- 172.21.15.72:0/1182715996 reap_dead start 2023-10-14T12:34:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f1687fff700 1 -- 172.21.15.72:0/1182715996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16780035b0 con 0x7f1678004850 2023-10-14T12:34:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f1687fff700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1678004850 0x7f1678004cd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f168815aba0 tx=0x7f1678005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24d19859e5c08e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674004030 con 0x7f1678004850 2023-10-14T12:34:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1674004190 con 0x7f1678004850 2023-10-14T12:34:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f16877fe700 1 -- 172.21.15.72:0/1182715996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674004540 con 0x7f1678004850 2023-10-14T12:34:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f168ef7a700 1 -- 172.21.15.72:0/1182715996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1678004850 msgr2=0x7f1678004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f168ef7a700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1678004850 0x7f1678004cd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f168815aba0 tx=0x7f1678005880 comp rx=0 tx=0).stop 2023-10-14T12:34:11.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f168ef7a700 1 -- 172.21.15.72:0/1182715996 shutdown_connections 2023-10-14T12:34:11.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f168ef7a700 1 --2- 172.21.15.72:0/1182715996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1678004850 0x7f1678004cd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f168ef7a700 1 -- 172.21.15.72:0/1182715996 >> 172.21.15.72:0/1182715996 conn(0x7f16880ccce0 msgr2=0x7f16880cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:11.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f168ef7a700 1 -- 172.21.15.72:0/1182715996 shutdown_connections 2023-10-14T12:34:11.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.371+0000 7f168ef7a700 1 -- 172.21.15.72:0/1182715996 wait complete. 2023-10-14T12:34:11.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.373+0000 7f168ef7a700 1 Processor -- start 2023-10-14T12:34:11.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.373+0000 7f168ef7a700 1 -- start start 2023-10-14T12:34:11.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.373+0000 7f168ef7a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678004850 0x7f1688156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.373+0000 7f168ef7a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16880c9f10 0x7f16880c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.373+0000 7f168ef7a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16880c5b70 0x7f168806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168ef7a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1688156ec0 con 0x7f16880c5b70 2023-10-14T12:34:11.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168ef7a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16880c81d0 con 0x7f1678004850 2023-10-14T12:34:11.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168ef7a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16880c7c10 con 0x7f16880c9f10 2023-10-14T12:34:11.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168d517700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16880c5b70 0x7f168806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168d517700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16880c5b70 0x7f168806ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47474/0 (socket says 172.21.15.72:47474) 2023-10-14T12:34:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168d517700 1 -- 172.21.15.72:0/3531161311 learned_addr learned my addr 172.21.15.72:0/3531161311 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f1687fff700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16880c9f10 0x7f16880c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168cd16700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678004850 0x7f1688156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168d517700 1 -- 172.21.15.72:0/3531161311 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16880c9f10 msgr2=0x7f16880c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168d517700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16880c9f10 0x7f16880c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168d517700 1 -- 172.21.15.72:0/3531161311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678004850 msgr2=0x7f1688156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168d517700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678004850 0x7f1688156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168d517700 1 -- 172.21.15.72:0/3531161311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880c7ef0 con 0x7f16880c5b70 2023-10-14T12:34:11.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168d517700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16880c5b70 0x7f168806ed40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16880c72c0 tx=0x7f168000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:11.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f16857fa700 1 -- 172.21.15.72:0/3531161311 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1680002120 con 0x7f16880c5b70 2023-10-14T12:34:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f16857fa700 1 -- 172.21.15.72:0/3531161311 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1680003c60 con 0x7f16880c5b70 2023-10-14T12:34:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16880c5370 con 0x7f16880c5b70 2023-10-14T12:34:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f16857fa700 1 -- 172.21.15.72:0/3531161311 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168000d990 con 0x7f16880c5b70 2023-10-14T12:34:11.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.374+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16880c7870 con 0x7f16880c5b70 2023-10-14T12:34:11.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.375+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1688072a40 con 0x7f16880c5b70 2023-10-14T12:34:11.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.376+0000 7f16857fa700 1 -- 172.21.15.72:0/3531161311 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f168000db10 con 0x7f16880c5b70 2023-10-14T12:34:11.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.376+0000 7f16857fa700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f166c06af00 0x7f166c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.376+0000 7f16857fa700 1 -- 172.21.15.72:0/3531161311 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1680089ac0 con 0x7f16880c5b70 2023-10-14T12:34:11.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.376+0000 7f168cd16700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f166c06af00 0x7f166c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.376+0000 7f168cd16700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f166c06af00 0x7f166c06d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16880694d0 tx=0x7f167c007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:11.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.380+0000 7f16857fa700 1 -- 172.21.15.72:0/3531161311 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1680054910 con 0x7f16880c5b70 2023-10-14T12:34:11.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.569+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f168804ebb0 con 0x7f16880c5b70 2023-10-14T12:34:11.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.570+0000 7f16857fa700 1 -- 172.21.15.72:0/3531161311 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1680089e60 con 0x7f16880c5b70 2023-10-14T12:34:11.572 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f166c06af00 msgr2=0x7f166c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f166c06af00 0x7f166c06d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16880694d0 tx=0x7f167c007d00 comp rx=0 tx=0).stop 2023-10-14T12:34:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16880c5b70 msgr2=0x7f168806ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16880c5b70 0x7f168806ed40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16880c72c0 tx=0x7f168000d430 comp rx=0 tx=0).stop 2023-10-14T12:34:11.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 shutdown_connections 2023-10-14T12:34:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f166c06af00 0x7f166c06d3c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16880c5b70 0x7f168806ed40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1678004850 0x7f1688156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 --2- 172.21.15.72:0/3531161311 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f16880c9f10 0x7f16880c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 >> 172.21.15.72:0/3531161311 conn(0x7f16880ccce0 msgr2=0x7f16880cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 shutdown_connections 2023-10-14T12:34:11.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.572+0000 7f168ef7a700 1 -- 172.21.15.72:0/3531161311 wait complete. 2023-10-14T12:34:11.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:11.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.709+0000 7f0b5ee94700 1 Processor -- start 2023-10-14T12:34:11.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.709+0000 7f0b5ee94700 1 -- start start 2023-10-14T12:34:11.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5ee94700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b5815b4e0 0x7f0b5806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5ee94700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580cd770 0x7f0b580b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5ee94700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b58070620 con 0x7f0b580b3220 2023-10-14T12:34:11.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5ee94700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b580b36b0 con 0x7f0b5815b4e0 2023-10-14T12:34:11.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5ee94700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b58070900 con 0x7f0b580cd770 2023-10-14T12:34:11.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5cc30700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b5815b4e0 0x7f0b5806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5cc30700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b5815b4e0 0x7f0b5806f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47478/0 (socket says 172.21.15.72:47478) 2023-10-14T12:34:11.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5cc30700 1 -- 172.21.15.72:0/2495442576 learned_addr learned my addr 172.21.15.72:0/2495442576 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:11.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b57fff700 1 --2- 172.21.15.72:0/2495442576 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580cd770 0x7f0b580b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5cc30700 1 -- 172.21.15.72:0/2495442576 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580cd770 msgr2=0x7f0b580b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:11.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5cc30700 1 --2- 172.21.15.72:0/2495442576 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580cd770 0x7f0b580b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5cc30700 1 -- 172.21.15.72:0/2495442576 >> v1:172.21.15.123:6789/0 conn(0x7f0b580b3220 legacy=0x7f0b580cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:11.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5cc30700 1 -- 172.21.15.72:0/2495442576 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58070be0 con 0x7f0b5815b4e0 2023-10-14T12:34:11.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b57fff700 1 --2- 172.21.15.72:0/2495442576 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580cd770 0x7f0b580b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:11.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b5cc30700 1 --2- 172.21.15.72:0/2495442576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b5815b4e0 0x7f0b5806f280 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0098f0 tx=0x7f0b4c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d751a65705bc0780 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:11.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.710+0000 7f0b577fe700 1 -- 172.21.15.72:0/2495442576 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004230 con 0x7f0b5815b4e0 2023-10-14T12:34:11.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b577fe700 1 -- 172.21.15.72:0/2495442576 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c004390 con 0x7f0b5815b4e0 2023-10-14T12:34:11.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b577fe700 1 -- 172.21.15.72:0/2495442576 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0036a0 con 0x7f0b5815b4e0 2023-10-14T12:34:11.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b5ee94700 1 -- 172.21.15.72:0/2495442576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b5815b4e0 msgr2=0x7f0b5806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b5ee94700 1 --2- 172.21.15.72:0/2495442576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b5815b4e0 0x7f0b5806f280 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0098f0 tx=0x7f0b4c009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:11.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b5ee94700 1 -- 172.21.15.72:0/2495442576 shutdown_connections 2023-10-14T12:34:11.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b5ee94700 1 --2- 172.21.15.72:0/2495442576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b5815b4e0 0x7f0b5806f280 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b5ee94700 1 --2- 172.21.15.72:0/2495442576 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580cd770 0x7f0b580b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b5ee94700 1 -- 172.21.15.72:0/2495442576 >> 172.21.15.72:0/2495442576 conn(0x7f0b580cdce0 msgr2=0x7f0b580ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:11.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b5ee94700 1 -- 172.21.15.72:0/2495442576 shutdown_connections 2023-10-14T12:34:11.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.711+0000 7f0b5ee94700 1 -- 172.21.15.72:0/2495442576 wait complete. 2023-10-14T12:34:11.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.712+0000 7f0b5ee94700 1 Processor -- start 2023-10-14T12:34:11.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.712+0000 7f0b5ee94700 1 -- start start 2023-10-14T12:34:11.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b5ee94700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580b3220 0x7f0b581e5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b5ee94700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b580cd770 0x7f0b581e2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b5ee94700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b5815b4e0 0x7f0b58159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b5ee94700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b581e0660 con 0x7f0b580cd770 2023-10-14T12:34:11.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b5ee94700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b581e14c0 con 0x7f0b5815b4e0 2023-10-14T12:34:11.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b5ee94700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b581e08b0 con 0x7f0b580b3220 2023-10-14T12:34:11.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b57fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b580cd770 0x7f0b581e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b57fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b580cd770 0x7f0b581e2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47486/0 (socket says 172.21.15.72:47486) 2023-10-14T12:34:11.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b57fff700 1 -- 172.21.15.72:0/170100420 learned_addr learned my addr 172.21.15.72:0/170100420 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:11.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b5d431700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b5815b4e0 0x7f0b58159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b5cc30700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580b3220 0x7f0b581e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.713+0000 7f0b57fff700 1 -- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580b3220 msgr2=0x7f0b581e5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b57fff700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580b3220 0x7f0b581e5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b57fff700 1 -- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b5815b4e0 msgr2=0x7f0b58159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b57fff700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b5815b4e0 0x7f0b58159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b57fff700 1 -- 172.21.15.72:0/170100420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c009550 con 0x7f0b580cd770 2023-10-14T12:34:11.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b5d431700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b5815b4e0 0x7f0b58159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:11.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b5cc30700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580b3220 0x7f0b581e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:11.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b57fff700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b580cd770 0x7f0b581e2140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400c820 tx=0x7f0b4400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:11.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b557fa700 1 -- 172.21.15.72:0/170100420 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44011800 con 0x7f0b580cd770 2023-10-14T12:34:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b557fa700 1 -- 172.21.15.72:0/170100420 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44011960 con 0x7f0b580cd770 2023-10-14T12:34:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b557fa700 1 -- 172.21.15.72:0/170100420 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44011cd0 con 0x7f0b580cd770 2023-10-14T12:34:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b581e0b90 con 0x7f0b580cd770 2023-10-14T12:34:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.714+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b581e1150 con 0x7f0b580cd770 2023-10-14T12:34:11.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.715+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5804ebb0 con 0x7f0b580cd770 2023-10-14T12:34:11.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.715+0000 7f0b557fa700 1 -- 172.21.15.72:0/170100420 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b44022350 con 0x7f0b580cd770 2023-10-14T12:34:11.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.716+0000 7f0b557fa700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b3c06af00 0x7f0b3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:11.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.716+0000 7f0b5cc30700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b3c06af00 0x7f0b3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:11.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.716+0000 7f0b557fa700 1 -- 172.21.15.72:0/170100420 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b44089990 con 0x7f0b580cd770 2023-10-14T12:34:11.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.716+0000 7f0b5cc30700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b3c06af00 0x7f0b3c06d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009c40 tx=0x7f0b4c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:11.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.720+0000 7f0b557fa700 1 -- 172.21.15.72:0/170100420 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b440546b0 con 0x7f0b580cd770 2023-10-14T12:34:11.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.914+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b580d0bf0 con 0x7f0b580cd770 2023-10-14T12:34:11.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.914+0000 7f0b557fa700 1 -- 172.21.15.72:0/170100420 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b44057cd0 con 0x7f0b580cd770 2023-10-14T12:34:11.916 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:11.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b3c06af00 msgr2=0x7f0b3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b3c06af00 0x7f0b3c06d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009c40 tx=0x7f0b4c008030 comp rx=0 tx=0).stop 2023-10-14T12:34:11.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b580cd770 msgr2=0x7f0b581e2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:11.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b580cd770 0x7f0b581e2140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0b4400c820 tx=0x7f0b4400cbe0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 shutdown_connections 2023-10-14T12:34:11.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b3c06af00 0x7f0b3c06d3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b5815b4e0 0x7f0b58159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b580b3220 0x7f0b581e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 --2- 172.21.15.72:0/170100420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b580cd770 0x7f0b581e2140 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 >> 172.21.15.72:0/170100420 conn(0x7f0b580cdce0 msgr2=0x7f0b580c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:11.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 shutdown_connections 2023-10-14T12:34:11.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:11.917+0000 7f0b5ee94700 1 -- 172.21.15.72:0/170100420 wait complete. 2023-10-14T12:34:11.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:12.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.052+0000 7f52eca5c700 1 Processor -- start 2023-10-14T12:34:12.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.052+0000 7f52eca5c700 1 -- start start 2023-10-14T12:34:12.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52eca5c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f52e806b370 0x7f52e815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52eca5c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e806a820 0x7f52e806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52eca5c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e8161360 con 0x7f52e80cdd30 2023-10-14T12:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52eca5c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e806b750 con 0x7f52e806b370 2023-10-14T12:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52eca5c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e815e300 con 0x7f52e806a820 2023-10-14T12:34:12.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f52e80cdd30 0x7f52e81617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53796/0 (socket says 172.21.15.72:53796) 2023-10-14T12:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e6d9d700 1 -- 172.21.15.72:0/187455331 learned_addr learned my addr 172.21.15.72:0/187455331 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e659c700 1 --2- 172.21.15.72:0/187455331 >> v2:172.21.15.123:3300/0 conn(0x7f52e806b370 0x7f52e815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e5d9b700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e806a820 0x7f52e806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394283895 0 0) 0x7f52e8161360 con 0x7f52e80cdd30 2023-10-14T12:34:12.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d00035b0 con 0x7f52e80cdd30 2023-10-14T12:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362518628 0 0) 0x7f52d00035b0 con 0x7f52e80cdd30 2023-10-14T12:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e806a820 msgr2=0x7f52e806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e559a700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e806a820 0x7f52e806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 >> v2:172.21.15.123:3300/0 conn(0x7f52e806b370 msgr2=0x7f52e815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:12.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e559a700 1 --2- 172.21.15.72:0/187455331 >> v2:172.21.15.123:3300/0 conn(0x7f52e806b370 0x7f52e815dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e815e5e0 con 0x7f52e80cdd30 2023-10-14T12:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.053+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f52e00019f0 con 0x7f52e80cdd30 2023-10-14T12:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 >> v1:172.21.15.72:6789/0 conn(0x7f52e80cdd30 legacy=0x7f52e81617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52d0003a00 0x7f52d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0004850 0x7f52d0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e806a820 0x7f52d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e806b750 con 0x7f52d0003a00 2023-10-14T12:34:12.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e815e300 con 0x7f52d0004850 2023-10-14T12:34:12.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d000ba10 con 0x7f52e806a820 2023-10-14T12:34:12.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e659c700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52d0003a00 0x7f52d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e5d9b700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0004850 0x7f52d0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e6d9d700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e806a820 0x7f52d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e659c700 1 -- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e806a820 msgr2=0x7f52d0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:12.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e659c700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e806a820 0x7f52d0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e659c700 1 -- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0004850 msgr2=0x7f52d0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:12.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e659c700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0004850 0x7f52d0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e659c700 1 -- 172.21.15.72:0/187455331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00035b0 con 0x7f52d0003a00 2023-10-14T12:34:12.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e5d9b700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0004850 0x7f52d0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:12.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e659c700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52d0003a00 0x7f52d0003e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009b60 tx=0x7f52d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6c5c9560b6b547 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:12.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d800e6c0 con 0x7f52d0003a00 2023-10-14T12:34:12.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d800e820 con 0x7f52d0003a00 2023-10-14T12:34:12.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.054+0000 7f52e559a700 1 -- 172.21.15.72:0/187455331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d800eb90 con 0x7f52d0003a00 2023-10-14T12:34:12.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.055+0000 7f52eca5c700 1 -- 172.21.15.72:0/187455331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52d0003a00 msgr2=0x7f52d0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.055+0000 7f52eca5c700 1 --2- 172.21.15.72:0/187455331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52d0003a00 0x7f52d0003e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009b60 tx=0x7f52d0005880 comp rx=0 tx=0).stop 2023-10-14T12:34:12.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.055+0000 7f52e6d9d700 1 -- 172.21.15.72:0/187455331 reap_dead start 2023-10-14T12:34:12.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.055+0000 7f52eca5c700 1 -- 172.21.15.72:0/187455331 shutdown_connections 2023-10-14T12:34:12.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.055+0000 7f52eca5c700 1 -- 172.21.15.72:0/187455331 >> 172.21.15.72:0/187455331 conn(0x7f52e80ccbe0 msgr2=0x7f52e80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.055+0000 7f52eca5c700 1 -- 172.21.15.72:0/187455331 shutdown_connections 2023-10-14T12:34:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.055+0000 7f52eca5c700 1 -- 172.21.15.72:0/187455331 wait complete. 2023-10-14T12:34:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.056+0000 7f52eca5c700 1 Processor -- start 2023-10-14T12:34:12.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.056+0000 7f52eca5c700 1 -- start start 2023-10-14T12:34:12.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52eca5c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0003a00 0x7f52e8158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52eca5c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52e80cc4d0 0x7f52e80b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52eca5c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e8155570 0x7f52e81559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52eca5c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8155f30 con 0x7f52e80cc4d0 2023-10-14T12:34:12.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52eca5c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8159420 con 0x7f52d0003a00 2023-10-14T12:34:12.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52eca5c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8159700 con 0x7f52e8155570 2023-10-14T12:34:12.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52e80cc4d0 0x7f52e80b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52e80cc4d0 0x7f52e80b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47506/0 (socket says 172.21.15.72:47506) 2023-10-14T12:34:12.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e5d9b700 1 -- 172.21.15.72:0/4245540174 learned_addr learned my addr 172.21.15.72:0/4245540174 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:12.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e659c700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0003a00 0x7f52e8158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e6d9d700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e8155570 0x7f52e81559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e5d9b700 1 -- 172.21.15.72:0/4245540174 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e8155570 msgr2=0x7f52e81559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e5d9b700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e8155570 0x7f52e81559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e5d9b700 1 -- 172.21.15.72:0/4245540174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0003a00 msgr2=0x7f52e8158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e5d9b700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0003a00 0x7f52e8158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e5d9b700 1 -- 172.21.15.72:0/4245540174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e81599e0 con 0x7f52e80cc4d0 2023-10-14T12:34:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.057+0000 7f52e5d9b700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52e80cc4d0 0x7f52e80b0ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f52dc011680 tx=0x7f52dc011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.058+0000 7f52d6ffd700 1 -- 172.21.15.72:0/4245540174 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc004230 con 0x7f52e80cc4d0 2023-10-14T12:34:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.058+0000 7f52d6ffd700 1 -- 172.21.15.72:0/4245540174 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc004390 con 0x7f52e80cc4d0 2023-10-14T12:34:12.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.058+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e8159cc0 con 0x7f52e80cc4d0 2023-10-14T12:34:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.058+0000 7f52d6ffd700 1 -- 172.21.15.72:0/4245540174 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0036a0 con 0x7f52e80cc4d0 2023-10-14T12:34:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.058+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e80cc950 con 0x7f52e80cc4d0 2023-10-14T12:34:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.059+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e8072d10 con 0x7f52e80cc4d0 2023-10-14T12:34:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.059+0000 7f52d6ffd700 1 -- 172.21.15.72:0/4245540174 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f52dc003800 con 0x7f52e80cc4d0 2023-10-14T12:34:12.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.059+0000 7f52d6ffd700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52c806af00 0x7f52c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.059+0000 7f52d6ffd700 1 -- 172.21.15.72:0/4245540174 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f52dc089a20 con 0x7f52e80cc4d0 2023-10-14T12:34:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.059+0000 7f52e659c700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52c806af00 0x7f52c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.060+0000 7f52e659c700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52c806af00 0x7f52c806d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52d80090b0 tx=0x7f52d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:12.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.064+0000 7f52d6ffd700 1 -- 172.21.15.72:0/4245540174 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52dc0547e0 con 0x7f52e80cc4d0 2023-10-14T12:34:12.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.252+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f52e815a310 con 0x7f52e80cc4d0 2023-10-14T12:34:12.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.252+0000 7f52d6ffd700 1 -- 172.21.15.72:0/4245540174 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f52dc0220a0 con 0x7f52e80cc4d0 2023-10-14T12:34:12.254 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:12.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52c806af00 msgr2=0x7f52c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52c806af00 0x7f52c806d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f52d80090b0 tx=0x7f52d8008030 comp rx=0 tx=0).stop 2023-10-14T12:34:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52e80cc4d0 msgr2=0x7f52e80b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52e80cc4d0 0x7f52e80b0ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f52dc011680 tx=0x7f52dc011990 comp rx=0 tx=0).stop 2023-10-14T12:34:12.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 shutdown_connections 2023-10-14T12:34:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52c806af00 0x7f52c806d3c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52e8155570 0x7f52e81559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52d0003a00 0x7f52e8158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 --2- 172.21.15.72:0/4245540174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52e80cc4d0 0x7f52e80b0ee0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 >> 172.21.15.72:0/4245540174 conn(0x7f52e80ccbe0 msgr2=0x7f52e8157820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:12.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 shutdown_connections 2023-10-14T12:34:12.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.254+0000 7f52eca5c700 1 -- 172.21.15.72:0/4245540174 wait complete. 2023-10-14T12:34:12.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:12.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.387+0000 7f46158b4700 1 Processor -- start 2023-10-14T12:34:12.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.387+0000 7f46158b4700 1 -- start start 2023-10-14T12:34:12.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f46158b4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4610160b50 0x7f46100cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f46158b4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46100b94b0 con 0x7f46100b5700 2023-10-14T12:34:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f46158b4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46100d0010 con 0x7f46100b9000 2023-10-14T12:34:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f46158b4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46100d02f0 con 0x7f4610160b50 2023-10-14T12:34:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4610160b50 0x7f46100cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f46100b5700 0x7f46100ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53816/0 (socket says 172.21.15.72:53816) 2023-10-14T12:34:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4610160b50 0x7f46100cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47512/0 (socket says 172.21.15.72:47512) 2023-10-14T12:34:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460f7fe700 1 -- 172.21.15.72:0/533187132 learned_addr learned my addr 172.21.15.72:0/533187132 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460effd700 1 -- 172.21.15.72:0/533187132 >> v1:172.21.15.123:6789/0 conn(0x7f46100b9000 legacy=0x7f46100b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460effd700 1 -- 172.21.15.72:0/533187132 >> v1:172.21.15.72:6789/0 conn(0x7f46100b5700 legacy=0x7f46100ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460effd700 1 -- 172.21.15.72:0/533187132 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46100d05d0 con 0x7f4610160b50 2023-10-14T12:34:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460dffb700 1 -- 172.21.15.72:0/533187132 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728714093 0 0) 0x7f46100b94b0 con 0x7f46100b5700 2023-10-14T12:34:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460effd700 1 --2- 172.21.15.72:0/533187132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4610160b50 0x7f46100cf980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4600009870 tx=0x7f4600009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2310ab37aaaac8a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:12.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460dffb700 1 -- 172.21.15.72:0/533187132 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600004230 con 0x7f4610160b50 2023-10-14T12:34:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460dffb700 1 -- 172.21.15.72:0/533187132 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600004390 con 0x7f4610160b50 2023-10-14T12:34:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.388+0000 7f460dffb700 1 -- 172.21.15.72:0/533187132 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000036a0 con 0x7f4610160b50 2023-10-14T12:34:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.389+0000 7f46158b4700 1 -- 172.21.15.72:0/533187132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4610160b50 msgr2=0x7f46100cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.389+0000 7f46158b4700 1 --2- 172.21.15.72:0/533187132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4610160b50 0x7f46100cf980 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4600009870 tx=0x7f4600009b80 comp rx=0 tx=0).stop 2023-10-14T12:34:12.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.389+0000 7f46158b4700 1 -- 172.21.15.72:0/533187132 shutdown_connections 2023-10-14T12:34:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.389+0000 7f46158b4700 1 --2- 172.21.15.72:0/533187132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4610160b50 0x7f46100cf980 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.389+0000 7f46158b4700 1 -- 172.21.15.72:0/533187132 >> 172.21.15.72:0/533187132 conn(0x7f461006bc70 msgr2=0x7f461006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.389+0000 7f46158b4700 1 -- 172.21.15.72:0/533187132 shutdown_connections 2023-10-14T12:34:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.389+0000 7f46158b4700 1 -- 172.21.15.72:0/533187132 wait complete. 2023-10-14T12:34:12.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.390+0000 7f46158b4700 1 Processor -- start 2023-10-14T12:34:12.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.390+0000 7f46158b4700 1 -- start start 2023-10-14T12:34:12.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f46158b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46100b5700 0x7f46101f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f46158b4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f46100b9000 0x7f46101545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f46158b4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4610160b50 0x7f46101585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f46158b4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4610158180 con 0x7f46100b5700 2023-10-14T12:34:12.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f46158b4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461015c6b0 con 0x7f4610160b50 2023-10-14T12:34:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f46158b4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46101577e0 con 0x7f46100b9000 2023-10-14T12:34:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46100b5700 0x7f46101f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46100b5700 0x7f46101f6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47518/0 (socket says 172.21.15.72:47518) 2023-10-14T12:34:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460effd700 1 -- 172.21.15.72:0/330487152 learned_addr learned my addr 172.21.15.72:0/330487152 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:12.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460effd700 1 -- 172.21.15.72:0/330487152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f46100b9000 msgr2=0x7f46101545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460effd700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f46100b9000 0x7f46101545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460effd700 1 -- 172.21.15.72:0/330487152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4610160b50 msgr2=0x7f46101585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460f7fe700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4610160b50 0x7f46101585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460effd700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4610160b50 0x7f46101585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460effd700 1 -- 172.21.15.72:0/330487152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46000094a0 con 0x7f46100b5700 2023-10-14T12:34:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.391+0000 7f460effd700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46100b5700 0x7f46101f6ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4600009840 tx=0x7f46000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.392+0000 7f45f7fff700 1 -- 172.21.15.72:0/330487152 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600011830 con 0x7f46100b5700 2023-10-14T12:34:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.392+0000 7f45f7fff700 1 -- 172.21.15.72:0/330487152 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46000119b0 con 0x7f46100b5700 2023-10-14T12:34:12.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.392+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4610157ac0 con 0x7f46100b5700 2023-10-14T12:34:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.392+0000 7f45f7fff700 1 -- 172.21.15.72:0/330487152 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600011d60 con 0x7f46100b5700 2023-10-14T12:34:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.392+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4610158ae0 con 0x7f46100b5700 2023-10-14T12:34:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.393+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4610158c70 con 0x7f46100b5700 2023-10-14T12:34:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.393+0000 7f45f7fff700 1 -- 172.21.15.72:0/330487152 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f460001b440 con 0x7f46100b5700 2023-10-14T12:34:12.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.393+0000 7f45f7fff700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45fc06af00 0x7f45fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.394+0000 7f460e7fc700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45fc06af00 0x7f45fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.394+0000 7f45f7fff700 1 -- 172.21.15.72:0/330487152 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f460008b2c0 con 0x7f46100b5700 2023-10-14T12:34:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.394+0000 7f460e7fc700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45fc06af00 0x7f45fc06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f46101f7010 tx=0x7f4604007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:12.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.398+0000 7f45f7fff700 1 -- 172.21.15.72:0/330487152 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4600056080 con 0x7f46100b5700 2023-10-14T12:34:12.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.588+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46100d3ab0 con 0x7f46100b5700 2023-10-14T12:34:12.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.589+0000 7f45f7fff700 1 -- 172.21.15.72:0/330487152 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f46000596a0 con 0x7f46100b5700 2023-10-14T12:34:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:12.591 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:12.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45fc06af00 msgr2=0x7f45fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45fc06af00 0x7f45fc06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f46101f7010 tx=0x7f4604007a40 comp rx=0 tx=0).stop 2023-10-14T12:34:12.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46100b5700 msgr2=0x7f46101f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46100b5700 0x7f46101f6ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4600009840 tx=0x7f46000047c0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 shutdown_connections 2023-10-14T12:34:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f45fc06af00 0x7f45fc06d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4610160b50 0x7f46101585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46100b5700 0x7f46101f6ad0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 --2- 172.21.15.72:0/330487152 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f46100b9000 0x7f46101545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 >> 172.21.15.72:0/330487152 conn(0x7f461006bc70 msgr2=0x7f4610155d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:12.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 shutdown_connections 2023-10-14T12:34:12.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.591+0000 7f46158b4700 1 -- 172.21.15.72:0/330487152 wait complete. 2023-10-14T12:34:12.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:12.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:12.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.728+0000 7f05731ae700 1 Processor -- start 2023-10-14T12:34:12.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.728+0000 7f05731ae700 1 -- start start 2023-10-14T12:34:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.728+0000 7f05731ae700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f056c15d760 0x7f056c0b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.728+0000 7f05731ae700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f056c0ce0a0 0x7f056c0cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.728+0000 7f05731ae700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 0x7f056c06bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.728+0000 7f05731ae700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c0b95a0 con 0x7f056c0ce0a0 2023-10-14T12:34:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.728+0000 7f05731ae700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c06c1b0 con 0x7f056c15d760 2023-10-14T12:34:12.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.728+0000 7f05731ae700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0cf420 con 0x7f056c06b7e0 2023-10-14T12:34:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f056c0ce0a0 0x7f056c0cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f056c0ce0a0 0x7f056c0cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47526/0 (socket says 172.21.15.72:47526) 2023-10-14T12:34:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056bfff700 1 -- 172.21.15.72:0/4051010785 learned_addr learned my addr 172.21.15.72:0/4051010785 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f0570f4a700 1 --2- 172.21.15.72:0/4051010785 >> v2:172.21.15.123:3300/0 conn(0x7f056c15d760 0x7f056c0b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f057174b700 1 --2- 172.21.15.72:0/4051010785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 0x7f056c06bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056bfff700 1 -- 172.21.15.72:0/4051010785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 msgr2=0x7f056c06bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056bfff700 1 --2- 172.21.15.72:0/4051010785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 0x7f056c06bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056bfff700 1 -- 172.21.15.72:0/4051010785 >> v2:172.21.15.123:3300/0 conn(0x7f056c15d760 msgr2=0x7f056c0b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056bfff700 1 --2- 172.21.15.72:0/4051010785 >> v2:172.21.15.123:3300/0 conn(0x7f056c15d760 0x7f056c0b9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056bfff700 1 -- 172.21.15.72:0/4051010785 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0cfdf0 con 0x7f056c0ce0a0 2023-10-14T12:34:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056bfff700 1 --2- 172.21.15.72:0/4051010785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0ce0a0 0x7f056c0cf8b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f056c06c380 tx=0x7f0558009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c199f0bbbcb2dfc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056b7fe700 1 -- 172.21.15.72:0/4051010785 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800b870 con 0x7f056c0ce0a0 2023-10-14T12:34:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056b7fe700 1 -- 172.21.15.72:0/4051010785 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055800b9d0 con 0x7f056c0ce0a0 2023-10-14T12:34:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.729+0000 7f056b7fe700 1 -- 172.21.15.72:0/4051010785 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800bd60 con 0x7f056c0ce0a0 2023-10-14T12:34:12.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.730+0000 7f05731ae700 1 -- 172.21.15.72:0/4051010785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0ce0a0 msgr2=0x7f056c0cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.730+0000 7f05731ae700 1 --2- 172.21.15.72:0/4051010785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0ce0a0 0x7f056c0cf8b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f056c06c380 tx=0x7f0558009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.730+0000 7f05731ae700 1 -- 172.21.15.72:0/4051010785 shutdown_connections 2023-10-14T12:34:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.730+0000 7f05731ae700 1 --2- 172.21.15.72:0/4051010785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 0x7f056c06bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.730+0000 7f05731ae700 1 --2- 172.21.15.72:0/4051010785 >> v2:172.21.15.123:3300/0 conn(0x7f056c15d760 0x7f056c0b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.730+0000 7f05731ae700 1 --2- 172.21.15.72:0/4051010785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c0ce0a0 0x7f056c0cf8b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.730+0000 7f05731ae700 1 -- 172.21.15.72:0/4051010785 >> 172.21.15.72:0/4051010785 conn(0x7f056c072340 msgr2=0x7f056c072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.730+0000 7f05731ae700 1 -- 172.21.15.72:0/4051010785 shutdown_connections 2023-10-14T12:34:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.730+0000 7f05731ae700 1 -- 172.21.15.72:0/4051010785 wait complete. 2023-10-14T12:34:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.731+0000 7f05731ae700 1 Processor -- start 2023-10-14T12:34:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.731+0000 7f05731ae700 1 -- start start 2023-10-14T12:34:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f05731ae700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 0x7f056c160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f05731ae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f056c0ce0a0 0x7f056c0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f05731ae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c15d760 0x7f056c0b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f05731ae700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0b39e0 con 0x7f056c15d760 2023-10-14T12:34:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f05731ae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0cbf20 con 0x7f056c0ce0a0 2023-10-14T12:34:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f05731ae700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0cb030 con 0x7f056c06b7e0 2023-10-14T12:34:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f057174b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c15d760 0x7f056c0b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f057174b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c15d760 0x7f056c0b2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47534/0 (socket says 172.21.15.72:47534) 2023-10-14T12:34:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f057174b700 1 -- 172.21.15.72:0/844086036 learned_addr learned my addr 172.21.15.72:0/844086036 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f0570f4a700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 0x7f056c160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f056bfff700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f056c0ce0a0 0x7f056c0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f057174b700 1 -- 172.21.15.72:0/844086036 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 msgr2=0x7f056c160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f057174b700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 0x7f056c160810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f057174b700 1 -- 172.21.15.72:0/844086036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f056c0ce0a0 msgr2=0x7f056c0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f057174b700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f056c0ce0a0 0x7f056c0cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f057174b700 1 -- 172.21.15.72:0/844086036 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558009550 con 0x7f056c15d760 2023-10-14T12:34:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f056bfff700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f056c0ce0a0 0x7f056c0cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:12.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.732+0000 7f057174b700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c15d760 0x7f056c0b2b80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f056400cd70 tx=0x7f056400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.733+0000 7f05697fa700 1 -- 172.21.15.72:0/844086036 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564003a20 con 0x7f056c15d760 2023-10-14T12:34:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.733+0000 7f05697fa700 1 -- 172.21.15.72:0/844086036 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0564003b80 con 0x7f056c15d760 2023-10-14T12:34:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.733+0000 7f05697fa700 1 -- 172.21.15.72:0/844086036 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564004020 con 0x7f056c15d760 2023-10-14T12:34:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.733+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c0cb310 con 0x7f056c15d760 2023-10-14T12:34:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.733+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c0cb8d0 con 0x7f056c15d760 2023-10-14T12:34:12.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.733+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c15e850 con 0x7f056c15d760 2023-10-14T12:34:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.734+0000 7f05697fa700 1 -- 172.21.15.72:0/844086036 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0564004180 con 0x7f056c15d760 2023-10-14T12:34:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.734+0000 7f05697fa700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f055006af00 0x7f055006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.734+0000 7f05697fa700 1 -- 172.21.15.72:0/844086036 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0564012070 con 0x7f056c15d760 2023-10-14T12:34:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.734+0000 7f0570f4a700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f055006af00 0x7f055006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:12.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.735+0000 7f0570f4a700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f055006af00 0x7f055006d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f056000a8d0 tx=0x7f0560008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:12.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.739+0000 7f05697fa700 1 -- 172.21.15.72:0/844086036 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0564054ec0 con 0x7f056c15d760 2023-10-14T12:34:12.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.929+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f056c04ebb0 con 0x7f056c15d760 2023-10-14T12:34:12.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.929+0000 7f05697fa700 1 -- 172.21.15.72:0/844086036 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05640584e0 con 0x7f056c15d760 2023-10-14T12:34:12.931 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:12.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f055006af00 msgr2=0x7f055006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f055006af00 0x7f055006d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f056000a8d0 tx=0x7f0560008040 comp rx=0 tx=0).stop 2023-10-14T12:34:12.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c15d760 msgr2=0x7f056c0b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:12.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c15d760 0x7f056c0b2b80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f056400cd70 tx=0x7f056400a570 comp rx=0 tx=0).stop 2023-10-14T12:34:12.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 shutdown_connections 2023-10-14T12:34:12.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f055006af00 0x7f055006d3c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f056c15d760 0x7f056c0b2b80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f056c06b7e0 0x7f056c160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 --2- 172.21.15.72:0/844086036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f056c0ce0a0 0x7f056c0cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:12.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 >> 172.21.15.72:0/844086036 conn(0x7f056c072340 msgr2=0x7f056c0d1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:12.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 shutdown_connections 2023-10-14T12:34:12.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:12.932+0000 7f05731ae700 1 -- 172.21.15.72:0/844086036 wait complete. 2023-10-14T12:34:12.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:13.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.067+0000 7f119e26f700 1 Processor -- start 2023-10-14T12:34:13.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.067+0000 7f119e26f700 1 -- start start 2023-10-14T12:34:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f119e26f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11980cbec0 0x7f11980cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f119e26f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 0x7f119815e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f119e26f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119815ecd0 con 0x7f11980ced20 2023-10-14T12:34:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f119e26f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1198161830 con 0x7f11980cbec0 2023-10-14T12:34:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f119e26f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1198158280 con 0x7f119815dcb0 2023-10-14T12:34:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f1197fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11980cbec0 0x7f11980cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f1197fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11980cbec0 0x7f11980cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47538/0 (socket says 172.21.15.72:47538) 2023-10-14T12:34:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f11977fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f11980ced20 0x7f1198161c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53838/0 (socket says 172.21.15.72:53838) 2023-10-14T12:34:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f1197fff700 1 -- 172.21.15.72:0/474515577 learned_addr learned my addr 172.21.15.72:0/474515577 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f1197fff700 1 -- 172.21.15.72:0/474515577 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 msgr2=0x7f119815e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f119c80c700 1 --2- 172.21.15.72:0/474515577 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 0x7f119815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f1197fff700 1 --2- 172.21.15.72:0/474515577 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 0x7f119815e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f1197fff700 1 -- 172.21.15.72:0/474515577 >> v1:172.21.15.72:6789/0 conn(0x7f11980ced20 legacy=0x7f1198161c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f1196ffd700 1 -- 172.21.15.72:0/474515577 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21683040 0 0) 0x7f119815ecd0 con 0x7f11980ced20 2023-10-14T12:34:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f1197fff700 1 -- 172.21.15.72:0/474515577 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980cc7e0 con 0x7f11980cbec0 2023-10-14T12:34:13.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f119c80c700 1 --2- 172.21.15.72:0/474515577 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 0x7f119815e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.068+0000 7f1197fff700 1 --2- 172.21.15.72:0/474515577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980cbec0 0x7f11980cc2a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f118c0098f0 tx=0x7f118c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13c33056986079d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f1196ffd700 1 -- 172.21.15.72:0/474515577 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c00b8a0 con 0x7f11980cbec0 2023-10-14T12:34:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f1196ffd700 1 -- 172.21.15.72:0/474515577 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c00ba00 con 0x7f11980cbec0 2023-10-14T12:34:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f1196ffd700 1 -- 172.21.15.72:0/474515577 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c00bd90 con 0x7f11980cbec0 2023-10-14T12:34:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f119e26f700 1 -- 172.21.15.72:0/474515577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980cbec0 msgr2=0x7f11980cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f119e26f700 1 --2- 172.21.15.72:0/474515577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980cbec0 0x7f11980cc2a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f118c0098f0 tx=0x7f118c009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f119e26f700 1 -- 172.21.15.72:0/474515577 shutdown_connections 2023-10-14T12:34:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f119e26f700 1 --2- 172.21.15.72:0/474515577 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 0x7f119815e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f119e26f700 1 --2- 172.21.15.72:0/474515577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980cbec0 0x7f11980cc2a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f119e26f700 1 -- 172.21.15.72:0/474515577 >> 172.21.15.72:0/474515577 conn(0x7f11980b1020 msgr2=0x7f11980b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f119e26f700 1 -- 172.21.15.72:0/474515577 shutdown_connections 2023-10-14T12:34:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.069+0000 7f119e26f700 1 -- 172.21.15.72:0/474515577 wait complete. 2023-10-14T12:34:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.070+0000 7f119e26f700 1 Processor -- start 2023-10-14T12:34:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f119e26f700 1 -- start start 2023-10-14T12:34:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f119e26f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980cbec0 0x7f11981f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f119e26f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980ced20 0x7f11981f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f119e26f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 0x7f11980c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f119e26f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11981f4e70 con 0x7f11980ced20 2023-10-14T12:34:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f119e26f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11980c4f80 con 0x7f11980cbec0 2023-10-14T12:34:13.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f119e26f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980c5260 con 0x7f119815dcb0 2023-10-14T12:34:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f11977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980ced20 0x7f11981f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f11977fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980ced20 0x7f11981f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47546/0 (socket says 172.21.15.72:47546) 2023-10-14T12:34:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f11977fe700 1 -- 172.21.15.72:0/1481853437 learned_addr learned my addr 172.21.15.72:0/1481853437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f1197fff700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980cbec0 0x7f11981f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.071+0000 7f119c80c700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 0x7f11980c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f11977fe700 1 -- 172.21.15.72:0/1481853437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 msgr2=0x7f11980c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f11977fe700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 0x7f11980c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f11977fe700 1 -- 172.21.15.72:0/1481853437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980cbec0 msgr2=0x7f11981f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f11977fe700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980cbec0 0x7f11981f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f11977fe700 1 -- 172.21.15.72:0/1481853437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c009550 con 0x7f11980ced20 2023-10-14T12:34:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f11977fe700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980ced20 0x7f11981f3030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f118800c540 tx=0x7f118800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f1194ff9700 1 -- 172.21.15.72:0/1481853437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188004c80 con 0x7f11980ced20 2023-10-14T12:34:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f1194ff9700 1 -- 172.21.15.72:0/1481853437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188004de0 con 0x7f11980ced20 2023-10-14T12:34:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f1194ff9700 1 -- 172.21.15.72:0/1481853437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188007310 con 0x7f11980ced20 2023-10-14T12:34:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11980c5540 con 0x7f11980ced20 2023-10-14T12:34:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.072+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11980c5820 con 0x7f11980ced20 2023-10-14T12:34:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.073+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1198070d90 con 0x7f11980ced20 2023-10-14T12:34:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.073+0000 7f1194ff9700 1 -- 172.21.15.72:0/1481853437 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1188007470 con 0x7f11980ced20 2023-10-14T12:34:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.074+0000 7f1194ff9700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f118406af00 0x7f118406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.074+0000 7f1194ff9700 1 -- 172.21.15.72:0/1481853437 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1188089480 con 0x7f11980ced20 2023-10-14T12:34:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.074+0000 7f1197fff700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f118406af00 0x7f118406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.074+0000 7f1197fff700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f118406af00 0x7f118406d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f118c009c40 tx=0x7f118c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.078+0000 7f1194ff9700 1 -- 172.21.15.72:0/1481853437 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1198070d90 con 0x7f11980ced20 2023-10-14T12:34:13.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.266+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1198070d90 con 0x7f11980ced20 2023-10-14T12:34:13.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.266+0000 7f1194ff9700 1 -- 172.21.15.72:0/1481853437 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1198070d90 con 0x7f11980ced20 2023-10-14T12:34:13.268 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:13.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.268+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f118406af00 msgr2=0x7f118406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.268+0000 7f119e26f700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f118406af00 0x7f118406d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f118c009c40 tx=0x7f118c008030 comp rx=0 tx=0).stop 2023-10-14T12:34:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.268+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980ced20 msgr2=0x7f11981f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.268+0000 7f119e26f700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980ced20 0x7f11981f3030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f118800c540 tx=0x7f118800c850 comp rx=0 tx=0).stop 2023-10-14T12:34:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.269+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 shutdown_connections 2023-10-14T12:34:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.269+0000 7f119e26f700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f118406af00 0x7f118406d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.269+0000 7f119e26f700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f119815dcb0 0x7f11980c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.269+0000 7f119e26f700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980cbec0 0x7f11981f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.269+0000 7f119e26f700 1 --2- 172.21.15.72:0/1481853437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11980ced20 0x7f11981f3030 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.269+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 >> 172.21.15.72:0/1481853437 conn(0x7f11980b1020 msgr2=0x7f11981578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:13.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.269+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 shutdown_connections 2023-10-14T12:34:13.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.269+0000 7f119e26f700 1 -- 172.21.15.72:0/1481853437 wait complete. 2023-10-14T12:34:13.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:13.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.404+0000 7fe31c15c700 1 Processor -- start 2023-10-14T12:34:13.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.404+0000 7fe31c15c700 1 -- start start 2023-10-14T12:34:13.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.405+0000 7fe31c15c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406a820 0x7fe31415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.405+0000 7fe31c15c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe3140cdd30 0x7fe3140ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.405+0000 7fe31c15c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe314161360 con 0x7fe31406b370 2023-10-14T12:34:13.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.405+0000 7fe31c15c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3140ce6f0 con 0x7fe3140cdd30 2023-10-14T12:34:13.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.405+0000 7fe31c15c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31406b750 con 0x7fe31406a820 2023-10-14T12:34:13.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.405+0000 7fe3196f7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406a820 0x7fe31415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.405+0000 7fe3196f7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406a820 0x7fe31415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:43206/0 (socket says 172.21.15.72:43206) 2023-10-14T12:34:13.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.405+0000 7fe3196f7700 1 -- 172.21.15.72:0/2899903236 learned_addr learned my addr 172.21.15.72:0/2899903236 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:13.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.405+0000 7fe31a6f9700 1 --2- 172.21.15.72:0/2899903236 >> v2:172.21.15.123:3300/0 conn(0x7fe3140cdd30 0x7fe3140ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.406+0000 7fe3196f7700 1 -- 172.21.15.72:0/2899903236 >> v2:172.21.15.123:3300/0 conn(0x7fe3140cdd30 msgr2=0x7fe3140ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:13.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.406+0000 7fe3196f7700 1 --2- 172.21.15.72:0/2899903236 >> v2:172.21.15.123:3300/0 conn(0x7fe3140cdd30 0x7fe3140ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.406+0000 7fe3196f7700 1 -- 172.21.15.72:0/2899903236 >> v1:172.21.15.123:6789/0 conn(0x7fe31406b370 legacy=0x7fe31406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.406+0000 7fe3196f7700 1 -- 172.21.15.72:0/2899903236 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31406dcc0 con 0x7fe31406a820 2023-10-14T12:34:13.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.406+0000 7fe3196f7700 1 --2- 172.21.15.72:0/2899903236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406a820 0x7fe31415dcb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe3100098f0 tx=0x7fe310009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a43210a5950035f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:13.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.406+0000 7fe318ef6700 1 -- 172.21.15.72:0/2899903236 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310011830 con 0x7fe31406a820 2023-10-14T12:34:13.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.406+0000 7fe318ef6700 1 -- 172.21.15.72:0/2899903236 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe310011990 con 0x7fe31406a820 2023-10-14T12:34:13.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.406+0000 7fe318ef6700 1 -- 172.21.15.72:0/2899903236 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310011d20 con 0x7fe31406a820 2023-10-14T12:34:13.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.407+0000 7fe31c15c700 1 -- 172.21.15.72:0/2899903236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406a820 msgr2=0x7fe31415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.407+0000 7fe31c15c700 1 --2- 172.21.15.72:0/2899903236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406a820 0x7fe31415dcb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe3100098f0 tx=0x7fe310009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.407+0000 7fe31c15c700 1 -- 172.21.15.72:0/2899903236 shutdown_connections 2023-10-14T12:34:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.407+0000 7fe31c15c700 1 --2- 172.21.15.72:0/2899903236 >> v2:172.21.15.123:3300/0 conn(0x7fe3140cdd30 0x7fe3140ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.407+0000 7fe31c15c700 1 --2- 172.21.15.72:0/2899903236 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406a820 0x7fe31415dcb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.407+0000 7fe31c15c700 1 -- 172.21.15.72:0/2899903236 >> 172.21.15.72:0/2899903236 conn(0x7fe3140ccbe0 msgr2=0x7fe3140ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.407+0000 7fe31c15c700 1 -- 172.21.15.72:0/2899903236 shutdown_connections 2023-10-14T12:34:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.407+0000 7fe31c15c700 1 -- 172.21.15.72:0/2899903236 wait complete. 2023-10-14T12:34:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.408+0000 7fe31c15c700 1 Processor -- start 2023-10-14T12:34:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.408+0000 7fe31c15c700 1 -- start start 2023-10-14T12:34:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe31c15c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe31406a820 0x7fe3141f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe31c15c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406b370 0x7fe3140b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe31c15c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3140cdd30 0x7fe3140b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe31c15c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3141f74e0 con 0x7fe31406a820 2023-10-14T12:34:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe31c15c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3141f3f00 con 0x7fe3140cdd30 2023-10-14T12:34:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe31c15c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3141f6720 con 0x7fe31406b370 2023-10-14T12:34:13.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe319ef8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe31406a820 0x7fe3141f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe319ef8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe31406a820 0x7fe3141f29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47558/0 (socket says 172.21.15.72:47558) 2023-10-14T12:34:13.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe319ef8700 1 -- 172.21.15.72:0/3662283212 learned_addr learned my addr 172.21.15.72:0/3662283212 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:13.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe3196f7700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406b370 0x7fe3140b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe31a6f9700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3140cdd30 0x7fe3140b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe319ef8700 1 -- 172.21.15.72:0/3662283212 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406b370 msgr2=0x7fe3140b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe319ef8700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406b370 0x7fe3140b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe319ef8700 1 -- 172.21.15.72:0/3662283212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3140cdd30 msgr2=0x7fe3140b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe319ef8700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3140cdd30 0x7fe3140b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe319ef8700 1 -- 172.21.15.72:0/3662283212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009550 con 0x7fe31406a820 2023-10-14T12:34:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.409+0000 7fe319ef8700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe31406a820 0x7fe3141f29a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe30400c4e0 tx=0x7fe30400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.410+0000 7fe30a7fc700 1 -- 172.21.15.72:0/3662283212 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040052d0 con 0x7fe31406a820 2023-10-14T12:34:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.410+0000 7fe30a7fc700 1 -- 172.21.15.72:0/3662283212 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304005430 con 0x7fe31406a820 2023-10-14T12:34:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.410+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3141f6a00 con 0x7fe31406a820 2023-10-14T12:34:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.410+0000 7fe30a7fc700 1 -- 172.21.15.72:0/3662283212 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040038c0 con 0x7fe31406a820 2023-10-14T12:34:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.410+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3141f6fc0 con 0x7fe31406a820 2023-10-14T12:34:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.411+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe314072d10 con 0x7fe31406a820 2023-10-14T12:34:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.411+0000 7fe30a7fc700 1 -- 172.21.15.72:0/3662283212 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe304003a20 con 0x7fe31406a820 2023-10-14T12:34:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.411+0000 7fe30a7fc700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2f806af00 0x7fe2f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.411+0000 7fe30a7fc700 1 -- 172.21.15.72:0/3662283212 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe304088bc0 con 0x7fe31406a820 2023-10-14T12:34:13.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.411+0000 7fe3196f7700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2f806af00 0x7fe2f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.412+0000 7fe3196f7700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2f806af00 0x7fe2f806d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe3100098f0 tx=0x7fe310008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:13.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.416+0000 7fe30a7fc700 1 -- 172.21.15.72:0/3662283212 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe304053a10 con 0x7fe31406a820 2023-10-14T12:34:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.609+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe31404ebb0 con 0x7fe31406a820 2023-10-14T12:34:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.610+0000 7fe30a7fc700 1 -- 172.21.15.72:0/3662283212 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3040170a0 con 0x7fe31406a820 2023-10-14T12:34:13.611 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:13.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2f806af00 msgr2=0x7fe2f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2f806af00 0x7fe2f806d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe3100098f0 tx=0x7fe310008030 comp rx=0 tx=0).stop 2023-10-14T12:34:13.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe31406a820 msgr2=0x7fe3141f29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe31406a820 0x7fe3141f29a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe30400c4e0 tx=0x7fe30400c7f0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 shutdown_connections 2023-10-14T12:34:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe2f806af00 0x7fe2f806d3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3140cdd30 0x7fe3140b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe31406a820 0x7fe3141f29a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 --2- 172.21.15.72:0/3662283212 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe31406b370 0x7fe3140b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 >> 172.21.15.72:0/3662283212 conn(0x7fe3140ccbe0 msgr2=0x7fe3140cd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:13.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 shutdown_connections 2023-10-14T12:34:13.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.612+0000 7fe31c15c700 1 -- 172.21.15.72:0/3662283212 wait complete. 2023-10-14T12:34:13.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:13.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.747+0000 7fc56f40d700 1 Processor -- start 2023-10-14T12:34:13.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.747+0000 7fc56f40d700 1 -- start start 2023-10-14T12:34:13.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56f40d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5680cd770 0x7fc56806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56f40d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc568070620 con 0x7fc56815b4e0 2023-10-14T12:34:13.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56f40d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc568070900 con 0x7fc5680b33f0 2023-10-14T12:34:13.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56f40d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc568070be0 con 0x7fc5680cd770 2023-10-14T12:34:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56d1a9700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc56815b4e0 0x7fc5680b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53866/0 (socket says 172.21.15.72:53866) 2023-10-14T12:34:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56d1a9700 1 -- 172.21.15.72:0/1480963199 learned_addr learned my addr 172.21.15.72:0/1480963199 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56d9aa700 1 --2- 172.21.15.72:0/1480963199 >> v2:172.21.15.123:3300/0 conn(0x7fc5680cd770 0x7fc56806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc55ffff700 1 -- 172.21.15.72:0/1480963199 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14027603 0 0) 0x7fc568070620 con 0x7fc56815b4e0 2023-10-14T12:34:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc55ffff700 1 -- 172.21.15.72:0/1480963199 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5540035b0 con 0x7fc56815b4e0 2023-10-14T12:34:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56d9aa700 1 -- 172.21.15.72:0/1480963199 >> v1:172.21.15.123:6789/0 conn(0x7fc5680b33f0 legacy=0x7fc5680b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc55ffff700 1 -- 172.21.15.72:0/1480963199 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1312031324 0 0) 0x7fc5540035b0 con 0x7fc56815b4e0 2023-10-14T12:34:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56d9aa700 1 -- 172.21.15.72:0/1480963199 >> v1:172.21.15.72:6789/0 conn(0x7fc56815b4e0 legacy=0x7fc5680b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.748+0000 7fc56d9aa700 1 -- 172.21.15.72:0/1480963199 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568070ec0 con 0x7fc5680cd770 2023-10-14T12:34:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc56d9aa700 1 --2- 172.21.15.72:0/1480963199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5680cd770 0x7fc56806f280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc560009d90 tx=0x7fc56000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c70ecb5e1c7ea36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc55ffff700 1 -- 172.21.15.72:0/1480963199 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000e070 con 0x7fc5680cd770 2023-10-14T12:34:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc55ffff700 1 -- 172.21.15.72:0/1480963199 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc560003a20 con 0x7fc5680cd770 2023-10-14T12:34:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc55ffff700 1 -- 172.21.15.72:0/1480963199 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564001670 con 0x7fc5680cd770 2023-10-14T12:34:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc56f40d700 1 -- 172.21.15.72:0/1480963199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5680cd770 msgr2=0x7fc56806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc56f40d700 1 --2- 172.21.15.72:0/1480963199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5680cd770 0x7fc56806f280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc560009d90 tx=0x7fc56000b330 comp rx=0 tx=0).stop 2023-10-14T12:34:13.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc56f40d700 1 -- 172.21.15.72:0/1480963199 shutdown_connections 2023-10-14T12:34:13.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc56f40d700 1 --2- 172.21.15.72:0/1480963199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5680cd770 0x7fc56806f280 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc56f40d700 1 -- 172.21.15.72:0/1480963199 >> 172.21.15.72:0/1480963199 conn(0x7fc5680cdce0 msgr2=0x7fc5680ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:13.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc56f40d700 1 -- 172.21.15.72:0/1480963199 shutdown_connections 2023-10-14T12:34:13.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.749+0000 7fc56f40d700 1 -- 172.21.15.72:0/1480963199 wait complete. 2023-10-14T12:34:13.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.750+0000 7fc56f40d700 1 Processor -- start 2023-10-14T12:34:13.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56f40d700 1 -- start start 2023-10-14T12:34:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56f40d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5680b33f0 0x7fc568154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56f40d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5680cd770 0x7fc5680c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56f40d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc56815b4e0 0x7fc5680c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56f40d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681e7870 con 0x7fc5680b33f0 2023-10-14T12:34:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56f40d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681549d0 con 0x7fc5680cd770 2023-10-14T12:34:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56f40d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56806d580 con 0x7fc56815b4e0 2023-10-14T12:34:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56d1a9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5680b33f0 0x7fc568154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56d1a9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5680b33f0 0x7fc568154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47572/0 (socket says 172.21.15.72:47572) 2023-10-14T12:34:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56d1a9700 1 -- 172.21.15.72:0/3352023551 learned_addr learned my addr 172.21.15.72:0/3352023551 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56c9a8700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5680cd770 0x7fc5680c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.751+0000 7fc56d9aa700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc56815b4e0 0x7fc5680c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc56d1a9700 1 -- 172.21.15.72:0/3352023551 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc56815b4e0 msgr2=0x7fc5680c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc56d1a9700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc56815b4e0 0x7fc5680c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc56d1a9700 1 -- 172.21.15.72:0/3352023551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5680cd770 msgr2=0x7fc5680c72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc56d1a9700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5680cd770 0x7fc5680c72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc56d1a9700 1 -- 172.21.15.72:0/3352023551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc560009a70 con 0x7fc5680b33f0 2023-10-14T12:34:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc56d1a9700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5680b33f0 0x7fc568154490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c520 tx=0x7fc56400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc55dffb700 1 -- 172.21.15.72:0/3352023551 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564004c80 con 0x7fc5680b33f0 2023-10-14T12:34:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc55dffb700 1 -- 172.21.15.72:0/3352023551 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564004de0 con 0x7fc5680b33f0 2023-10-14T12:34:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56806d860 con 0x7fc5680b33f0 2023-10-14T12:34:13.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc55dffb700 1 -- 172.21.15.72:0/3352023551 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564007310 con 0x7fc5680b33f0 2023-10-14T12:34:13.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.752+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5681e7500 con 0x7fc5680b33f0 2023-10-14T12:34:13.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.753+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56804ebb0 con 0x7fc5680b33f0 2023-10-14T12:34:13.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.753+0000 7fc55dffb700 1 -- 172.21.15.72:0/3352023551 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc564007470 con 0x7fc5680b33f0 2023-10-14T12:34:13.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.754+0000 7fc55dffb700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc54c06af00 0x7fc54c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:13.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.754+0000 7fc55dffb700 1 -- 172.21.15.72:0/3352023551 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc564089600 con 0x7fc5680b33f0 2023-10-14T12:34:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.754+0000 7fc56c9a8700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc54c06af00 0x7fc54c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.754+0000 7fc56c9a8700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc54c06af00 0x7fc54c06d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc56806d140 tx=0x7fc558009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:13.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.758+0000 7fc55dffb700 1 -- 172.21.15.72:0/3352023551 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc564054340 con 0x7fc5680b33f0 2023-10-14T12:34:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.947+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc5680d0bf0 con 0x7fc5680b33f0 2023-10-14T12:34:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.947+0000 7fc55dffb700 1 -- 172.21.15.72:0/3352023551 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc564057960 con 0x7fc5680b33f0 2023-10-14T12:34:13.949 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc54c06af00 msgr2=0x7fc54c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc54c06af00 0x7fc54c06d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc56806d140 tx=0x7fc558009040 comp rx=0 tx=0).stop 2023-10-14T12:34:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5680b33f0 msgr2=0x7fc568154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:13.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5680b33f0 0x7fc568154490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c520 tx=0x7fc56400c830 comp rx=0 tx=0).stop 2023-10-14T12:34:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 shutdown_connections 2023-10-14T12:34:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc54c06af00 0x7fc54c06d3c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc56815b4e0 0x7fc5680c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5680b33f0 0x7fc568154490 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 --2- 172.21.15.72:0/3352023551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5680cd770 0x7fc5680c72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 >> 172.21.15.72:0/3352023551 conn(0x7fc5680cdce0 msgr2=0x7fc5680ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 shutdown_connections 2023-10-14T12:34:13.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:13.949+0000 7fc56f40d700 1 -- 172.21.15.72:0/3352023551 wait complete. 2023-10-14T12:34:13.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:14.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.082+0000 7f458be6b700 1 Processor -- start 2023-10-14T12:34:14.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.082+0000 7f458be6b700 1 -- start start 2023-10-14T12:34:14.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f458be6b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f458415daa0 0x7f45840af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f458be6b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458415ed10 con 0x7f45840af560 2023-10-14T12:34:14.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f458be6b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458415de80 con 0x7f4584071f60 2023-10-14T12:34:14.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f458be6b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458415e100 con 0x7f458415daa0 2023-10-14T12:34:14.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4589406700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f45840af560 0x7f4584071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53880/0 (socket says 172.21.15.72:53880) 2023-10-14T12:34:14.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4589406700 1 -- 172.21.15.72:0/196199072 learned_addr learned my addr 172.21.15.72:0/196199072 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4589c07700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f458415daa0 0x7f45840af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520896938 0 0) 0x7f458415ed10 con 0x7f45840af560 2023-10-14T12:34:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45700035b0 con 0x7f45840af560 2023-10-14T12:34:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354614011 0 0) 0x7f458415de80 con 0x7f4584071f60 2023-10-14T12:34:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f458415ed10 con 0x7f4584071f60 2023-10-14T12:34:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1701985843 0 0) 0x7f45700035b0 con 0x7f45840af560 2023-10-14T12:34:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f458415daa0 msgr2=0x7f45840af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f458415daa0 0x7f45840af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 >> v1:172.21.15.123:6789/0 conn(0x7f4584071f60 legacy=0x7f458406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458415e3e0 con 0x7f45840af560 2023-10-14T12:34:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4589c07700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f458415daa0 0x7f45840af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f4574001670 con 0x7f45840af560 2023-10-14T12:34:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 >> v1:172.21.15.72:6789/0 conn(0x7f45840af560 legacy=0x7f4584071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f458415daa0 0x7f4570003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f4570004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4570004d90 0x7f4570005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458415e100 con 0x7f4570004150 2023-10-14T12:34:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457000bb20 con 0x7f4570004d90 2023-10-14T12:34:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457000bce0 con 0x7f458415daa0 2023-10-14T12:34:14.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.083+0000 7f4589406700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f4570004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4589c07700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f458415daa0 0x7f4570003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f458a408700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4570004d90 0x7f4570005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4589406700 1 -- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f458415daa0 msgr2=0x7f4570003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:14.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4589406700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f458415daa0 0x7f4570003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4589406700 1 -- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4570004d90 msgr2=0x7f4570005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:14.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4589406700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4570004d90 0x7f4570005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4589406700 1 -- 172.21.15.72:0/196199072 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800094a0 con 0x7f4570004150 2023-10-14T12:34:14.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4589406700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f4570004850 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4574001eb0 tx=0x7f4570005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57244789c119abe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:14.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457400cc10 con 0x7f4570004150 2023-10-14T12:34:14.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457400cd70 con 0x7f4570004150 2023-10-14T12:34:14.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.084+0000 7f4588c05700 1 -- 172.21.15.72:0/196199072 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574005ba0 con 0x7f4570004150 2023-10-14T12:34:14.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.085+0000 7f458be6b700 1 -- 172.21.15.72:0/196199072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 msgr2=0x7f4570004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.085+0000 7f458be6b700 1 --2- 172.21.15.72:0/196199072 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f4570004850 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4574001eb0 tx=0x7f4570005880 comp rx=0 tx=0).stop 2023-10-14T12:34:14.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.085+0000 7f458a408700 1 -- 172.21.15.72:0/196199072 reap_dead start 2023-10-14T12:34:14.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.085+0000 7f458be6b700 1 -- 172.21.15.72:0/196199072 shutdown_connections 2023-10-14T12:34:14.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.085+0000 7f458be6b700 1 -- 172.21.15.72:0/196199072 >> 172.21.15.72:0/196199072 conn(0x7f45840d0180 msgr2=0x7f45840d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:14.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.085+0000 7f458be6b700 1 -- 172.21.15.72:0/196199072 shutdown_connections 2023-10-14T12:34:14.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.085+0000 7f458be6b700 1 -- 172.21.15.72:0/196199072 wait complete. 2023-10-14T12:34:14.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.086+0000 7f458be6b700 1 Processor -- start 2023-10-14T12:34:14.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.086+0000 7f458be6b700 1 -- start start 2023-10-14T12:34:14.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.086+0000 7f458be6b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f45840c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f458be6b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45841ee440 0x7f45841f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f458be6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f458415c010 0x7f458415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f458be6b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45840c6db0 con 0x7f4570004150 2023-10-14T12:34:14.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f458be6b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458415c9d0 con 0x7f458415c010 2023-10-14T12:34:14.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f458be6b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45841f45b0 con 0x7f45841ee440 2023-10-14T12:34:14.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589c07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f45840c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589c07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f45840c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47592/0 (socket says 172.21.15.72:47592) 2023-10-14T12:34:14.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589c07700 1 -- 172.21.15.72:0/2700076727 learned_addr learned my addr 172.21.15.72:0/2700076727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:14.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589406700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45841ee440 0x7f45841f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f458a408700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f458415c010 0x7f458415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589c07700 1 -- 172.21.15.72:0/2700076727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45841ee440 msgr2=0x7f45841f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589c07700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45841ee440 0x7f45841f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589c07700 1 -- 172.21.15.72:0/2700076727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f458415c010 msgr2=0x7f458415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589c07700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f458415c010 0x7f458415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589c07700 1 -- 172.21.15.72:0/2700076727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45841f4890 con 0x7f4570004150 2023-10-14T12:34:14.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f4589c07700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f45840c6870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4580011cd0 tx=0x7f4580009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:14.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f457a7fc700 1 -- 172.21.15.72:0/2700076727 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458000fa00 con 0x7f4570004150 2023-10-14T12:34:14.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f457a7fc700 1 -- 172.21.15.72:0/2700076727 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458000fb60 con 0x7f4570004150 2023-10-14T12:34:14.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f457a7fc700 1 -- 172.21.15.72:0/2700076727 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580014440 con 0x7f4570004150 2023-10-14T12:34:14.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45841f4b70 con 0x7f4570004150 2023-10-14T12:34:14.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.087+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45841f1de0 con 0x7f4570004150 2023-10-14T12:34:14.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.088+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458404ebb0 con 0x7f4570004150 2023-10-14T12:34:14.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.089+0000 7f457a7fc700 1 -- 172.21.15.72:0/2700076727 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f45800145a0 con 0x7f4570004150 2023-10-14T12:34:14.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.089+0000 7f457a7fc700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f456806af00 0x7f456806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.089+0000 7f457a7fc700 1 -- 172.21.15.72:0/2700076727 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f458008a000 con 0x7f4570004150 2023-10-14T12:34:14.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.089+0000 7f4589406700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f456806af00 0x7f456806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.090+0000 7f4589406700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f456806af00 0x7f456806d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4574015040 tx=0x7f4574007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:14.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.094+0000 7f457a7fc700 1 -- 172.21.15.72:0/2700076727 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4580054dc0 con 0x7f4570004150 2023-10-14T12:34:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.283+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45841f46f0 con 0x7f4570004150 2023-10-14T12:34:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.284+0000 7f457a7fc700 1 -- 172.21.15.72:0/2700076727 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f45841f46f0 con 0x7f4570004150 2023-10-14T12:34:14.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:14.286 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.286+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f456806af00 msgr2=0x7f456806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f456806af00 0x7f456806d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4574015040 tx=0x7f4574007000 comp rx=0 tx=0).stop 2023-10-14T12:34:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 msgr2=0x7f45840c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f45840c6870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4580011cd0 tx=0x7f4580009ed0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 shutdown_connections 2023-10-14T12:34:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f456806af00 0x7f456806d3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f458415c010 0x7f458415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4570004150 0x7f45840c6870 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 --2- 172.21.15.72:0/2700076727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f45841ee440 0x7f45841f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 >> 172.21.15.72:0/2700076727 conn(0x7f45840d0180 msgr2=0x7f45840c9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:14.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 shutdown_connections 2023-10-14T12:34:14.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.287+0000 7f458be6b700 1 -- 172.21.15.72:0/2700076727 wait complete. 2023-10-14T12:34:14.300 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:14.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.422+0000 7fa07f1b6700 1 Processor -- start 2023-10-14T12:34:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.422+0000 7fa07f1b6700 1 -- start start 2023-10-14T12:34:14.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.423+0000 7fa07f1b6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa07815d730 0x7fa07806b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.423+0000 7fa07f1b6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 0x7fa0780cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.423+0000 7fa07f1b6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780cde60 con 0x7fa0780cda40 2023-10-14T12:34:14.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.423+0000 7fa07f1b6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07806c220 con 0x7fa07815d730 2023-10-14T12:34:14.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.423+0000 7fa07f1b6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07806b770 con 0x7fa07806e400 2023-10-14T12:34:14.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.423+0000 7fa07d753700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa0780cda40 0x7fa0781611c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53900/0 (socket says 172.21.15.72:53900) 2023-10-14T12:34:14.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.423+0000 7fa07d753700 1 -- 172.21.15.72:0/2936830911 learned_addr learned my addr 172.21.15.72:0/2936830911 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:14.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.423+0000 7fa07cf52700 1 --2- 172.21.15.72:0/2936830911 >> v2:172.21.15.123:3300/0 conn(0x7fa07815d730 0x7fa07806b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.423+0000 7fa077fff700 1 --2- 172.21.15.72:0/2936830911 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 0x7fa0780cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa0777fe700 1 -- 172.21.15.72:0/2936830911 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186746416 0 0) 0x7fa0780cde60 con 0x7fa0780cda40 2023-10-14T12:34:14.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa0777fe700 1 -- 172.21.15.72:0/2936830911 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0680035b0 con 0x7fa0780cda40 2023-10-14T12:34:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa07cf52700 1 -- 172.21.15.72:0/2936830911 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 msgr2=0x7fa0780cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa07cf52700 1 --2- 172.21.15.72:0/2936830911 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 0x7fa0780cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa07cf52700 1 -- 172.21.15.72:0/2936830911 >> v1:172.21.15.72:6789/0 conn(0x7fa0780cda40 legacy=0x7fa0781611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa07cf52700 1 -- 172.21.15.72:0/2936830911 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07806b980 con 0x7fa07815d730 2023-10-14T12:34:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa07cf52700 1 --2- 172.21.15.72:0/2936830911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa07815d730 0x7fa07806b230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009840 tx=0x7fa06c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc64c88327c06103 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa0777fe700 1 -- 172.21.15.72:0/2936830911 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c011830 con 0x7fa07815d730 2023-10-14T12:34:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa0777fe700 1 -- 172.21.15.72:0/2936830911 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c011990 con 0x7fa07815d730 2023-10-14T12:34:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.424+0000 7fa0777fe700 1 -- 172.21.15.72:0/2936830911 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c011d20 con 0x7fa07815d730 2023-10-14T12:34:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.425+0000 7fa07f1b6700 1 -- 172.21.15.72:0/2936830911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa07815d730 msgr2=0x7fa07806b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.425+0000 7fa07f1b6700 1 --2- 172.21.15.72:0/2936830911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa07815d730 0x7fa07806b230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009840 tx=0x7fa06c009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.425+0000 7fa07f1b6700 1 -- 172.21.15.72:0/2936830911 shutdown_connections 2023-10-14T12:34:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.425+0000 7fa07f1b6700 1 --2- 172.21.15.72:0/2936830911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa07815d730 0x7fa07806b230 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.425+0000 7fa07f1b6700 1 --2- 172.21.15.72:0/2936830911 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 0x7fa0780cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.425+0000 7fa07f1b6700 1 -- 172.21.15.72:0/2936830911 >> 172.21.15.72:0/2936830911 conn(0x7fa0780b14b0 msgr2=0x7fa0780b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.425+0000 7fa07f1b6700 1 -- 172.21.15.72:0/2936830911 shutdown_connections 2023-10-14T12:34:14.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.425+0000 7fa07f1b6700 1 -- 172.21.15.72:0/2936830911 wait complete. 2023-10-14T12:34:14.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.426+0000 7fa07f1b6700 1 Processor -- start 2023-10-14T12:34:14.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.426+0000 7fa07f1b6700 1 -- start start 2023-10-14T12:34:14.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa07f1b6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 0x7fa07815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa07f1b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0780cda40 0x7fa0781545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa07f1b6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa07815d730 0x7fa0780c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa07f1b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c7a70 con 0x7fa0780cda40 2023-10-14T12:34:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa07f1b6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c7210 con 0x7fa07815d730 2023-10-14T12:34:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa07f1b6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c74b0 con 0x7fa07806e400 2023-10-14T12:34:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa077fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0780cda40 0x7fa0781545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa077fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0780cda40 0x7fa0781545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47608/0 (socket says 172.21.15.72:47608) 2023-10-14T12:34:14.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa077fff700 1 -- 172.21.15.72:0/3064092832 learned_addr learned my addr 172.21.15.72:0/3064092832 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:14.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa07cf52700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 0x7fa07815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa07d753700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa07815d730 0x7fa0780c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa077fff700 1 -- 172.21.15.72:0/3064092832 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 msgr2=0x7fa07815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa077fff700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 0x7fa07815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa077fff700 1 -- 172.21.15.72:0/3064092832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa07815d730 msgr2=0x7fa0780c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa077fff700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa07815d730 0x7fa0780c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa077fff700 1 -- 172.21.15.72:0/3064092832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0094a0 con 0x7fa0780cda40 2023-10-14T12:34:14.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa077fff700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0780cda40 0x7fa0781545c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa06400e9b0 tx=0x7fa06400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:14.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.427+0000 7fa0757fa700 1 -- 172.21.15.72:0/3064092832 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064009710 con 0x7fa0780cda40 2023-10-14T12:34:14.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.428+0000 7fa0757fa700 1 -- 172.21.15.72:0/3064092832 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06400ee50 con 0x7fa0780cda40 2023-10-14T12:34:14.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.428+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0780c7790 con 0x7fa0780cda40 2023-10-14T12:34:14.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.428+0000 7fa0757fa700 1 -- 172.21.15.72:0/3064092832 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06400ca50 con 0x7fa0780cda40 2023-10-14T12:34:14.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.428+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07815cdd0 con 0x7fa0780cda40 2023-10-14T12:34:14.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.429+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0780b3210 con 0x7fa0780cda40 2023-10-14T12:34:14.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.429+0000 7fa0757fa700 1 -- 172.21.15.72:0/3064092832 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa06400cbb0 con 0x7fa0780cda40 2023-10-14T12:34:14.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.429+0000 7fa0757fa700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa05c06af30 0x7fa05c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.429+0000 7fa0757fa700 1 -- 172.21.15.72:0/3064092832 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa0640898a0 con 0x7fa0780cda40 2023-10-14T12:34:14.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.429+0000 7fa07cf52700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa05c06af30 0x7fa05c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.430+0000 7fa07cf52700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa05c06af30 0x7fa05c06d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa06c000c00 tx=0x7fa06c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:14.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.434+0000 7fa0757fa700 1 -- 172.21.15.72:0/3064092832 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0780b3210 con 0x7fa0780cda40 2023-10-14T12:34:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.624+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0780b3210 con 0x7fa0780cda40 2023-10-14T12:34:14.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.625+0000 7fa0757fa700 1 -- 172.21.15.72:0/3064092832 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0780b3210 con 0x7fa0780cda40 2023-10-14T12:34:14.626 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:14.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa05c06af30 msgr2=0x7fa05c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa05c06af30 0x7fa05c06d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa06c000c00 tx=0x7fa06c01c040 comp rx=0 tx=0).stop 2023-10-14T12:34:14.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0780cda40 msgr2=0x7fa0781545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0780cda40 0x7fa0781545c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa06400e9b0 tx=0x7fa06400ecc0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 shutdown_connections 2023-10-14T12:34:14.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa05c06af30 0x7fa05c06d3f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa07815d730 0x7fa0780c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa07806e400 0x7fa07815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 --2- 172.21.15.72:0/3064092832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0780cda40 0x7fa0781545c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 >> 172.21.15.72:0/3064092832 conn(0x7fa0780b14b0 msgr2=0x7fa0780cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 shutdown_connections 2023-10-14T12:34:14.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.627+0000 7fa07f1b6700 1 -- 172.21.15.72:0/3064092832 wait complete. 2023-10-14T12:34:14.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.762+0000 7f95a5386700 1 Processor -- start 2023-10-14T12:34:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.762+0000 7f95a5386700 1 -- start start 2023-10-14T12:34:14.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f95a5386700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95a015b4e0 0x7f95a006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f95a5386700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a00b33f0 0x7f95a00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f95a5386700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a0070620 con 0x7f95a00cd770 2023-10-14T12:34:14.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f95a5386700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a0070900 con 0x7f95a015b4e0 2023-10-14T12:34:14.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f95a5386700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0070be0 con 0x7f95a00b33f0 2023-10-14T12:34:14.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959f7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a00b33f0 0x7f95a00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959effd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95a015b4e0 0x7f95a006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959f7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a00b33f0 0x7f95a00b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:43270/0 (socket says 172.21.15.72:43270) 2023-10-14T12:34:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959f7fe700 1 -- 172.21.15.72:0/1954621163 learned_addr learned my addr 172.21.15.72:0/1954621163 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959e7fc700 1 --1- 172.21.15.72:0/1954621163 >> v1:172.21.15.123:6789/0 conn(0x7f95a00cd770 0x7f95a00b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:52112/0 (socket says 172.21.15.72:52112) 2023-10-14T12:34:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959effd700 1 -- 172.21.15.72:0/1954621163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a00b33f0 msgr2=0x7f95a00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959effd700 1 --2- 172.21.15.72:0/1954621163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a00b33f0 0x7f95a00b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959effd700 1 -- 172.21.15.72:0/1954621163 >> v1:172.21.15.123:6789/0 conn(0x7f95a00cd770 legacy=0x7f95a00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959dffb700 1 -- 172.21.15.72:0/1954621163 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097023264 0 0) 0x7f95a0070620 con 0x7f95a00cd770 2023-10-14T12:34:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959effd700 1 -- 172.21.15.72:0/1954621163 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0070ec0 con 0x7f95a015b4e0 2023-10-14T12:34:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959f7fe700 1 --2- 172.21.15.72:0/1954621163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a00b33f0 0x7f95a00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.763+0000 7f959effd700 1 --2- 172.21.15.72:0/1954621163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a015b4e0 0x7f95a006f280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9594009840 tx=0x7f9594009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8694ff8225d3b72b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f959dffb700 1 -- 172.21.15.72:0/1954621163 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594011830 con 0x7f95a015b4e0 2023-10-14T12:34:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f959dffb700 1 -- 172.21.15.72:0/1954621163 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9594011990 con 0x7f95a015b4e0 2023-10-14T12:34:14.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f959dffb700 1 -- 172.21.15.72:0/1954621163 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9594011d20 con 0x7f95a015b4e0 2023-10-14T12:34:14.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f95a5386700 1 -- 172.21.15.72:0/1954621163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a015b4e0 msgr2=0x7f95a006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f95a5386700 1 --2- 172.21.15.72:0/1954621163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a015b4e0 0x7f95a006f280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9594009840 tx=0x7f9594009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:14.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f95a5386700 1 -- 172.21.15.72:0/1954621163 shutdown_connections 2023-10-14T12:34:14.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f95a5386700 1 --2- 172.21.15.72:0/1954621163 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a00b33f0 0x7f95a00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f95a5386700 1 --2- 172.21.15.72:0/1954621163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a015b4e0 0x7f95a006f280 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f95a5386700 1 -- 172.21.15.72:0/1954621163 >> 172.21.15.72:0/1954621163 conn(0x7f95a00cdce0 msgr2=0x7f95a00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:14.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f95a5386700 1 -- 172.21.15.72:0/1954621163 shutdown_connections 2023-10-14T12:34:14.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.764+0000 7f95a5386700 1 -- 172.21.15.72:0/1954621163 wait complete. 2023-10-14T12:34:14.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.765+0000 7f95a5386700 1 Processor -- start 2023-10-14T12:34:14.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f95a5386700 1 -- start start 2023-10-14T12:34:14.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f95a5386700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a00b33f0 0x7f95a014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f95a5386700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00cd770 0x7f95a01e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f95a5386700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a015b4e0 0x7f95a01e3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f95a5386700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a01e1850 con 0x7f95a00cd770 2023-10-14T12:34:14.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f95a5386700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a014bc50 con 0x7f95a00b33f0 2023-10-14T12:34:14.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f95a5386700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a01e0bd0 con 0x7f95a015b4e0 2023-10-14T12:34:14.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f959e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00cd770 0x7f95a01e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f959e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00cd770 0x7f95a01e6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47622/0 (socket says 172.21.15.72:47622) 2023-10-14T12:34:14.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f959e7fc700 1 -- 172.21.15.72:0/1870885479 learned_addr learned my addr 172.21.15.72:0/1870885479 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:14.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f959effd700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a00b33f0 0x7f95a014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.766+0000 7f959f7fe700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a015b4e0 0x7f95a01e3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f959e7fc700 1 -- 172.21.15.72:0/1870885479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a015b4e0 msgr2=0x7f95a01e3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f959e7fc700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a015b4e0 0x7f95a01e3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f959e7fc700 1 -- 172.21.15.72:0/1870885479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a00b33f0 msgr2=0x7f95a014b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f959e7fc700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a00b33f0 0x7f95a014b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f959e7fc700 1 -- 172.21.15.72:0/1870885479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598009b30 con 0x7f95a00cd770 2023-10-14T12:34:14.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f959f7fe700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a015b4e0 0x7f95a01e3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:14.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f959e7fc700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00cd770 0x7f95a01e6fb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f959000c540 tx=0x7f959000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:14.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f95877fe700 1 -- 172.21.15.72:0/1870885479 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590004c80 con 0x7f95a00cd770 2023-10-14T12:34:14.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f95877fe700 1 -- 172.21.15.72:0/1870885479 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590004de0 con 0x7f95a00cd770 2023-10-14T12:34:14.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f95877fe700 1 -- 172.21.15.72:0/1870885479 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590007310 con 0x7f95a00cd770 2023-10-14T12:34:14.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95940094a0 con 0x7f95a00cd770 2023-10-14T12:34:14.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.767+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a01e1190 con 0x7f95a00cd770 2023-10-14T12:34:14.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.768+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a01e1990 con 0x7f95a00cd770 2023-10-14T12:34:14.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.768+0000 7f95877fe700 1 -- 172.21.15.72:0/1870885479 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9590007470 con 0x7f95a00cd770 2023-10-14T12:34:14.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.769+0000 7f95877fe700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f958c06af00 0x7f958c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:14.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.769+0000 7f95877fe700 1 -- 172.21.15.72:0/1870885479 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9590089590 con 0x7f95a00cd770 2023-10-14T12:34:14.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.769+0000 7f959effd700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f958c06af00 0x7f958c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:14.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.769+0000 7f959effd700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f958c06af00 0x7f958c06d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9594000c00 tx=0x7f959401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:14.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.773+0000 7f95877fe700 1 -- 172.21.15.72:0/1870885479 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95a01e1990 con 0x7f95a00cd770 2023-10-14T12:34:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.963+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95a01e1990 con 0x7f95a00cd770 2023-10-14T12:34:14.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.964+0000 7f95877fe700 1 -- 172.21.15.72:0/1870885479 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95a01e1990 con 0x7f95a00cd770 2023-10-14T12:34:14.965 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:14.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f958c06af00 msgr2=0x7f958c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f958c06af00 0x7f958c06d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9594000c00 tx=0x7f959401c040 comp rx=0 tx=0).stop 2023-10-14T12:34:14.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00cd770 msgr2=0x7f95a01e6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:14.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00cd770 0x7f95a01e6fb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f959000c540 tx=0x7f959000c850 comp rx=0 tx=0).stop 2023-10-14T12:34:14.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 shutdown_connections 2023-10-14T12:34:14.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f958c06af00 0x7f958c06d3c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f95a015b4e0 0x7f95a01e3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95a00b33f0 0x7f95a014b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 --2- 172.21.15.72:0/1870885479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00cd770 0x7f95a01e6fb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:14.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 >> 172.21.15.72:0/1870885479 conn(0x7f95a00cdce0 msgr2=0x7f95a00c4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:14.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 shutdown_connections 2023-10-14T12:34:14.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:14.966+0000 7f95a5386700 1 -- 172.21.15.72:0/1870885479 wait complete. 2023-10-14T12:34:14.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.100+0000 7f462ef01700 1 Processor -- start 2023-10-14T12:34:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.100+0000 7f462ef01700 1 -- start start 2023-10-14T12:34:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.101+0000 7f462ef01700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f462806b370 0x7f462815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.101+0000 7f462ef01700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f46280cdd30 0x7f46280ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.101+0000 7f462ef01700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4628161360 con 0x7f462806a820 2023-10-14T12:34:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.101+0000 7f462ef01700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46280ce720 con 0x7f462806b370 2023-10-14T12:34:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.101+0000 7f462ef01700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462806b750 con 0x7f46280cdd30 2023-10-14T12:34:15.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.101+0000 7f4627fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f462806a820 0x7f462806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53928/0 (socket says 172.21.15.72:53928) 2023-10-14T12:34:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.101+0000 7f4627fff700 1 -- 172.21.15.72:0/1354103809 learned_addr learned my addr 172.21.15.72:0/1354103809 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f462cc9d700 1 --2- 172.21.15.72:0/1354103809 >> v2:172.21.15.123:3300/0 conn(0x7f462806b370 0x7f462815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f462d49e700 1 --2- 172.21.15.72:0/1354103809 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f46280cdd30 0x7f46280ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f46277fe700 1 -- 172.21.15.72:0/1354103809 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479552253 0 0) 0x7f4628161360 con 0x7f462806a820 2023-10-14T12:34:15.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f46277fe700 1 -- 172.21.15.72:0/1354103809 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46180035b0 con 0x7f462806a820 2023-10-14T12:34:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f46277fe700 1 -- 172.21.15.72:0/1354103809 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2229412055 0 0) 0x7f46180035b0 con 0x7f462806a820 2023-10-14T12:34:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f462cc9d700 1 -- 172.21.15.72:0/1354103809 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f46280cdd30 msgr2=0x7f46280ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f462cc9d700 1 --2- 172.21.15.72:0/1354103809 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f46280cdd30 0x7f46280ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f462cc9d700 1 -- 172.21.15.72:0/1354103809 >> v1:172.21.15.72:6789/0 conn(0x7f462806a820 legacy=0x7f462806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f462cc9d700 1 -- 172.21.15.72:0/1354103809 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462806dcc0 con 0x7f462806b370 2023-10-14T12:34:15.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f462cc9d700 1 --2- 172.21.15.72:0/1354103809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806b370 0x7f462815dcb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f461c009840 tx=0x7f461c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6344c706e3bb8972 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:15.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f46277fe700 1 -- 172.21.15.72:0/1354103809 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614001670 con 0x7f462806b370 2023-10-14T12:34:15.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f46277fe700 1 -- 172.21.15.72:0/1354103809 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c004030 con 0x7f462806b370 2023-10-14T12:34:15.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.102+0000 7f46277fe700 1 -- 172.21.15.72:0/1354103809 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0043a0 con 0x7f462806b370 2023-10-14T12:34:15.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.103+0000 7f462ef01700 1 -- 172.21.15.72:0/1354103809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806b370 msgr2=0x7f462815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.103+0000 7f462ef01700 1 --2- 172.21.15.72:0/1354103809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806b370 0x7f462815dcb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f461c009840 tx=0x7f461c009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:15.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.103+0000 7f462ef01700 1 -- 172.21.15.72:0/1354103809 shutdown_connections 2023-10-14T12:34:15.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.103+0000 7f462ef01700 1 --2- 172.21.15.72:0/1354103809 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f46280cdd30 0x7f46280ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.103+0000 7f462ef01700 1 --2- 172.21.15.72:0/1354103809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806b370 0x7f462815dcb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.103+0000 7f462ef01700 1 -- 172.21.15.72:0/1354103809 >> 172.21.15.72:0/1354103809 conn(0x7f46280ccbe0 msgr2=0x7f46280ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:15.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.103+0000 7f462ef01700 1 -- 172.21.15.72:0/1354103809 shutdown_connections 2023-10-14T12:34:15.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.103+0000 7f462ef01700 1 -- 172.21.15.72:0/1354103809 wait complete. 2023-10-14T12:34:15.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.104+0000 7f462ef01700 1 Processor -- start 2023-10-14T12:34:15.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.104+0000 7f462ef01700 1 -- start start 2023-10-14T12:34:15.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462ef01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806a820 0x7f46280caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462ef01700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f462806b370 0x7f4628157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462ef01700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46280cdd30 0x7f46280c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462ef01700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280c8be0 con 0x7f46280cdd30 2023-10-14T12:34:15.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462ef01700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280c8ec0 con 0x7f462806a820 2023-10-14T12:34:15.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462ef01700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46280c91a0 con 0x7f462806b370 2023-10-14T12:34:15.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462d49e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46280cdd30 0x7f46280c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462d49e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46280cdd30 0x7f46280c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47638/0 (socket says 172.21.15.72:47638) 2023-10-14T12:34:15.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462d49e700 1 -- 172.21.15.72:0/2950118748 learned_addr learned my addr 172.21.15.72:0/2950118748 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:15.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462cc9d700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806a820 0x7f46280caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f4627fff700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f462806b370 0x7f4628157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462d49e700 1 -- 172.21.15.72:0/2950118748 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f462806b370 msgr2=0x7f4628157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462d49e700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f462806b370 0x7f4628157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462d49e700 1 -- 172.21.15.72:0/2950118748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806a820 msgr2=0x7f46280caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462d49e700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806a820 0x7f46280caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462d49e700 1 -- 172.21.15.72:0/2950118748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0094a0 con 0x7f46280cdd30 2023-10-14T12:34:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.105+0000 7f462cc9d700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806a820 0x7f46280caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.106+0000 7f462d49e700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46280cdd30 0x7f46280c8370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f462000efc0 tx=0x7f462000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.106+0000 7f46257fa700 1 -- 172.21.15.72:0/2950118748 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000cd40 con 0x7f46280cdd30 2023-10-14T12:34:15.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.106+0000 7f46257fa700 1 -- 172.21.15.72:0/2950118748 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462000f040 con 0x7f46280cdd30 2023-10-14T12:34:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.106+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46280c9480 con 0x7f46280cdd30 2023-10-14T12:34:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.106+0000 7f46257fa700 1 -- 172.21.15.72:0/2950118748 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200146c0 con 0x7f46280cdd30 2023-10-14T12:34:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.106+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4628157bb0 con 0x7f46280cdd30 2023-10-14T12:34:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.107+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4628072d10 con 0x7f46280cdd30 2023-10-14T12:34:15.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.107+0000 7f46257fa700 1 -- 172.21.15.72:0/2950118748 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4620014820 con 0x7f46280cdd30 2023-10-14T12:34:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.107+0000 7f46257fa700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f460c06af00 0x7f460c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.107+0000 7f46257fa700 1 -- 172.21.15.72:0/2950118748 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f462008a320 con 0x7f46280cdd30 2023-10-14T12:34:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.107+0000 7f462cc9d700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f460c06af00 0x7f460c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.108+0000 7f462cc9d700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f460c06af00 0x7f460c06d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f461c000c00 tx=0x7f461c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:15.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.112+0000 7f46257fa700 1 -- 172.21.15.72:0/2950118748 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4620055040 con 0x7f46280cdd30 2023-10-14T12:34:15.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.301+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46280c99a0 con 0x7f46280cdd30 2023-10-14T12:34:15.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.302+0000 7f46257fa700 1 -- 172.21.15.72:0/2950118748 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46280c99a0 con 0x7f46280cdd30 2023-10-14T12:34:15.303 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:15.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f460c06af00 msgr2=0x7f460c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f460c06af00 0x7f460c06d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f461c000c00 tx=0x7f461c008030 comp rx=0 tx=0).stop 2023-10-14T12:34:15.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46280cdd30 msgr2=0x7f46280c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46280cdd30 0x7f46280c8370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f462000efc0 tx=0x7f462000c3a0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 shutdown_connections 2023-10-14T12:34:15.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f460c06af00 0x7f460c06d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46280cdd30 0x7f46280c8370 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f462806a820 0x7f46280caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 --2- 172.21.15.72:0/2950118748 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f462806b370 0x7f4628157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 >> 172.21.15.72:0/2950118748 conn(0x7f46280ccbe0 msgr2=0x7f462815d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:15.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 shutdown_connections 2023-10-14T12:34:15.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.304+0000 7f462ef01700 1 -- 172.21.15.72:0/2950118748 wait complete. 2023-10-14T12:34:15.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:15.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.441+0000 7f687cbf2700 1 Processor -- start 2023-10-14T12:34:15.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.441+0000 7f687cbf2700 1 -- start start 2023-10-14T12:34:15.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.441+0000 7f687cbf2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68780cdbd0 0x7f687806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.441+0000 7f687cbf2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687806a820 con 0x7f687815d960 2023-10-14T12:34:15.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.441+0000 7f687cbf2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687806d490 con 0x7f687815d580 2023-10-14T12:34:15.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.441+0000 7f687cbf2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6878066cd0 con 0x7f68780cdbd0 2023-10-14T12:34:15.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f6876d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f687815d960 0x7f687806b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53946/0 (socket says 172.21.15.72:53946) 2023-10-14T12:34:15.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f6876d9d700 1 -- 172.21.15.72:0/2076977048 learned_addr learned my addr 172.21.15.72:0/2076977048 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:15.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f6875d9b700 1 --2- 172.21.15.72:0/2076977048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68780cdbd0 0x7f687806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f687559a700 1 -- 172.21.15.72:0/2076977048 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544185185 0 0) 0x7f687806a820 con 0x7f687815d960 2023-10-14T12:34:15.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f687559a700 1 -- 172.21.15.72:0/2076977048 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68600035b0 con 0x7f687815d960 2023-10-14T12:34:15.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f687559a700 1 -- 172.21.15.72:0/2076977048 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321832295 0 0) 0x7f687806d490 con 0x7f687815d580 2023-10-14T12:34:15.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f6875d9b700 1 -- 172.21.15.72:0/2076977048 >> v1:172.21.15.123:6789/0 conn(0x7f687815d580 legacy=0x7f68780cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f6875d9b700 1 -- 172.21.15.72:0/2076977048 >> v1:172.21.15.72:6789/0 conn(0x7f687815d960 legacy=0x7f687806b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f6875d9b700 1 -- 172.21.15.72:0/2076977048 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687806d770 con 0x7f68780cdbd0 2023-10-14T12:34:15.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.442+0000 7f6875d9b700 1 --2- 172.21.15.72:0/2076977048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68780cdbd0 0x7f687806af90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6868009870 tx=0x7f6868009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5592683ca7e197d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:15.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687559a700 1 -- 172.21.15.72:0/2076977048 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700019f0 con 0x7f68780cdbd0 2023-10-14T12:34:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687559a700 1 -- 172.21.15.72:0/2076977048 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6868004030 con 0x7f68780cdbd0 2023-10-14T12:34:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687559a700 1 -- 172.21.15.72:0/2076977048 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68680043a0 con 0x7f68780cdbd0 2023-10-14T12:34:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687cbf2700 1 -- 172.21.15.72:0/2076977048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68780cdbd0 msgr2=0x7f687806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687cbf2700 1 --2- 172.21.15.72:0/2076977048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68780cdbd0 0x7f687806af90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6868009870 tx=0x7f6868009b80 comp rx=0 tx=0).stop 2023-10-14T12:34:15.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687cbf2700 1 -- 172.21.15.72:0/2076977048 shutdown_connections 2023-10-14T12:34:15.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687cbf2700 1 --2- 172.21.15.72:0/2076977048 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f68780cdbd0 0x7f687806af90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687cbf2700 1 -- 172.21.15.72:0/2076977048 >> 172.21.15.72:0/2076977048 conn(0x7f68780b13e0 msgr2=0x7f68780b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:15.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687cbf2700 1 -- 172.21.15.72:0/2076977048 shutdown_connections 2023-10-14T12:34:15.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.443+0000 7f687cbf2700 1 -- 172.21.15.72:0/2076977048 wait complete. 2023-10-14T12:34:15.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.444+0000 7f687cbf2700 1 Processor -- start 2023-10-14T12:34:15.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f687cbf2700 1 -- start start 2023-10-14T12:34:15.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f687cbf2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68780cdbd0 0x7f687815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f687cbf2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f687815d580 0x7f68781e6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f687cbf2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687815d960 0x7f68781e6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f687cbf2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687815afa0 con 0x7f687815d580 2023-10-14T12:34:15.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f687cbf2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c55b0 con 0x7f68780cdbd0 2023-10-14T12:34:15.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f687cbf2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c5800 con 0x7f687815d960 2023-10-14T12:34:15.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f6875d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f687815d580 0x7f68781e6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f6875d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f687815d580 0x7f68781e6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47650/0 (socket says 172.21.15.72:47650) 2023-10-14T12:34:15.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.445+0000 7f6875d9b700 1 -- 172.21.15.72:0/454513118 learned_addr learned my addr 172.21.15.72:0/454513118 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:15.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f687659c700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68780cdbd0 0x7f687815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6876d9d700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687815d960 0x7f68781e6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6875d9b700 1 -- 172.21.15.72:0/454513118 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687815d960 msgr2=0x7f68781e6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6875d9b700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687815d960 0x7f68781e6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6875d9b700 1 -- 172.21.15.72:0/454513118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68780cdbd0 msgr2=0x7f687815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6875d9b700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68780cdbd0 0x7f687815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6875d9b700 1 -- 172.21.15.72:0/454513118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68680094a0 con 0x7f687815d580 2023-10-14T12:34:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6876d9d700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687815d960 0x7f68781e6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6875d9b700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f687815d580 0x7f68781e6930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6878070c80 tx=0x7f6868004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6866ffd700 1 -- 172.21.15.72:0/454513118 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868010790 con 0x7f687815d580 2023-10-14T12:34:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6866ffd700 1 -- 172.21.15.72:0/454513118 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680108f0 con 0x7f687815d580 2023-10-14T12:34:15.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68780c5ae0 con 0x7f687815d580 2023-10-14T12:34:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f6866ffd700 1 -- 172.21.15.72:0/454513118 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868010c80 con 0x7f687815d580 2023-10-14T12:34:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.446+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68780c60a0 con 0x7f687815d580 2023-10-14T12:34:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.447+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68781e4eb0 con 0x7f687815d580 2023-10-14T12:34:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.447+0000 7f6866ffd700 1 -- 172.21.15.72:0/454513118 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f686801c420 con 0x7f687815d580 2023-10-14T12:34:15.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.448+0000 7f6866ffd700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f685806af00 0x7f685806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.448+0000 7f6866ffd700 1 -- 172.21.15.72:0/454513118 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f686808b2b0 con 0x7f687815d580 2023-10-14T12:34:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.448+0000 7f687659c700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f685806af00 0x7f685806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.448+0000 7f687659c700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f685806af00 0x7f685806d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f686c000f60 tx=0x7f686c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:15.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.452+0000 7f6866ffd700 1 -- 172.21.15.72:0/454513118 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f68781e4eb0 con 0x7f687815d580 2023-10-14T12:34:15.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.645+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f68781e4eb0 con 0x7f687815d580 2023-10-14T12:34:15.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.645+0000 7f6866ffd700 1 -- 172.21.15.72:0/454513118 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f68781e4eb0 con 0x7f687815d580 2023-10-14T12:34:15.647 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f685806af00 msgr2=0x7f685806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f685806af00 0x7f685806d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f686c000f60 tx=0x7f686c009040 comp rx=0 tx=0).stop 2023-10-14T12:34:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f687815d580 msgr2=0x7f68781e6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f687815d580 0x7f68781e6930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6878070c80 tx=0x7f6868004750 comp rx=0 tx=0).stop 2023-10-14T12:34:15.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 shutdown_connections 2023-10-14T12:34:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f685806af00 0x7f685806d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f687815d960 0x7f68781e6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68780cdbd0 0x7f687815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 --2- 172.21.15.72:0/454513118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f687815d580 0x7f68781e6930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 >> 172.21.15.72:0/454513118 conn(0x7f68780b13e0 msgr2=0x7f68780caae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:15.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 shutdown_connections 2023-10-14T12:34:15.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.647+0000 7f687cbf2700 1 -- 172.21.15.72:0/454513118 wait complete. 2023-10-14T12:34:15.692 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-10-14T12:34:15.693 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:15.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.813+0000 7fc058e90700 1 Processor -- start 2023-10-14T12:34:15.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.813+0000 7fc058e90700 1 -- start start 2023-10-14T12:34:15.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.814+0000 7fc058e90700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc05415daa0 0x7fc0540af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.814+0000 7fc058e90700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc054071f60 0x7fc05406d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.814+0000 7fc058e90700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05415ed10 con 0x7fc0540af560 2023-10-14T12:34:15.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.814+0000 7fc058e90700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05415de80 con 0x7fc05415daa0 2023-10-14T12:34:15.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.814+0000 7fc058e90700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05415e100 con 0x7fc054071f60 2023-10-14T12:34:15.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc051d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc0540af560 0x7fc054071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53956/0 (socket says 172.21.15.72:53956) 2023-10-14T12:34:15.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc051d9b700 1 -- 172.21.15.72:0/185796148 learned_addr learned my addr 172.21.15.72:0/185796148 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:15.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645587442 0 0) 0x7fc05415ed10 con 0x7fc0540af560 2023-10-14T12:34:15.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc03c0035b0 con 0x7fc0540af560 2023-10-14T12:34:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc052d9d700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc054071f60 0x7fc05406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05259c700 1 --2- 172.21.15.72:0/185796148 >> v2:172.21.15.123:3300/0 conn(0x7fc05415daa0 0x7fc0540af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 990620865 0 0) 0x7fc03c0035b0 con 0x7fc0540af560 2023-10-14T12:34:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc054071f60 msgr2=0x7fc05406d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc054071f60 0x7fc05406d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 >> v2:172.21.15.123:3300/0 conn(0x7fc05415daa0 msgr2=0x7fc0540af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 --2- 172.21.15.72:0/185796148 >> v2:172.21.15.123:3300/0 conn(0x7fc05415daa0 0x7fc0540af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05415e3e0 con 0x7fc0540af560 2023-10-14T12:34:15.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7fc044001670 con 0x7fc0540af560 2023-10-14T12:34:15.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 >> v1:172.21.15.72:6789/0 conn(0x7fc0540af560 legacy=0x7fc054071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c003a00 0x7fc03c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc054071f60 0x7fc03c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc03c004d90 0x7fc03c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05415de80 con 0x7fc03c004d90 2023-10-14T12:34:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05415e100 con 0x7fc03c003a00 2023-10-14T12:34:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c00ba10 con 0x7fc054071f60 2023-10-14T12:34:15.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc052d9d700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc03c004d90 0x7fc03c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc051d9b700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc054071f60 0x7fc03c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.815+0000 7fc05259c700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c003a00 0x7fc03c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc052d9d700 1 -- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc054071f60 msgr2=0x7fc03c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc052d9d700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc054071f60 0x7fc03c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc052d9d700 1 -- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c003a00 msgr2=0x7fc03c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc052d9d700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c003a00 0x7fc03c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc052d9d700 1 -- 172.21.15.72:0/185796148 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c0035b0 con 0x7fc03c004d90 2023-10-14T12:34:15.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc052d9d700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc03c004d90 0x7fc03c005210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009fc0 tx=0x7fc03c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3506f71d647840b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:15.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00ec30 con 0x7fc03c004d90 2023-10-14T12:34:15.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c00f040 con 0x7fc03c004d90 2023-10-14T12:34:15.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc05159a700 1 -- 172.21.15.72:0/185796148 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c014480 con 0x7fc03c004d90 2023-10-14T12:34:15.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc058e90700 1 -- 172.21.15.72:0/185796148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc03c004d90 msgr2=0x7fc03c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc058e90700 1 --2- 172.21.15.72:0/185796148 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc03c004d90 0x7fc03c005210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009fc0 tx=0x7fc03c005880 comp rx=0 tx=0).stop 2023-10-14T12:34:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.816+0000 7fc052d9d700 1 -- 172.21.15.72:0/185796148 reap_dead start 2023-10-14T12:34:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.817+0000 7fc058e90700 1 -- 172.21.15.72:0/185796148 shutdown_connections 2023-10-14T12:34:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.817+0000 7fc058e90700 1 -- 172.21.15.72:0/185796148 >> 172.21.15.72:0/185796148 conn(0x7fc0540d0180 msgr2=0x7fc0540d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:15.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.817+0000 7fc058e90700 1 -- 172.21.15.72:0/185796148 shutdown_connections 2023-10-14T12:34:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.817+0000 7fc058e90700 1 -- 172.21.15.72:0/185796148 wait complete. 2023-10-14T12:34:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.818+0000 7fc058e90700 1 Processor -- start 2023-10-14T12:34:15.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.818+0000 7fc058e90700 1 -- start start 2023-10-14T12:34:15.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc058e90700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c004d90 0x7fc054158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc058e90700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0540c5610 0x7fc0540c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc058e90700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0540c3c90 0x7fc0540c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc058e90700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0540b2d70 con 0x7fc0540c3c90 2023-10-14T12:34:15.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc058e90700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0540c5fd0 con 0x7fc03c004d90 2023-10-14T12:34:15.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc058e90700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc054158c70 con 0x7fc0540c5610 2023-10-14T12:34:15.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc052d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0540c3c90 0x7fc0540c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc052d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0540c3c90 0x7fc0540c4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47672/0 (socket says 172.21.15.72:47672) 2023-10-14T12:34:15.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc052d9d700 1 -- 172.21.15.72:0/3160426312 learned_addr learned my addr 172.21.15.72:0/3160426312 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:15.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc05259c700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c004d90 0x7fc054158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc051d9b700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0540c5610 0x7fc0540c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc052d9d700 1 -- 172.21.15.72:0/3160426312 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0540c5610 msgr2=0x7fc0540c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc052d9d700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0540c5610 0x7fc0540c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc052d9d700 1 -- 172.21.15.72:0/3160426312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c004d90 msgr2=0x7fc054158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:15.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc052d9d700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c004d90 0x7fc054158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:15.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc052d9d700 1 -- 172.21.15.72:0/3160426312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0540c4930 con 0x7fc0540c3c90 2023-10-14T12:34:15.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc052d9d700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0540c3c90 0x7fc0540c4110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0011e0 tx=0x7fc04c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:15.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc042ffd700 1 -- 172.21.15.72:0/3160426312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c007000 con 0x7fc0540c3c90 2023-10-14T12:34:15.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc042ffd700 1 -- 172.21.15.72:0/3160426312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c004470 con 0x7fc0540c3c90 2023-10-14T12:34:15.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0540c4c10 con 0x7fc0540c3c90 2023-10-14T12:34:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc042ffd700 1 -- 172.21.15.72:0/3160426312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c004860 con 0x7fc0540c3c90 2023-10-14T12:34:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.819+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0540b2f80 con 0x7fc0540c3c90 2023-10-14T12:34:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.820+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05404ebb0 con 0x7fc0540c3c90 2023-10-14T12:34:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.821+0000 7fc042ffd700 1 -- 172.21.15.72:0/3160426312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc04c023070 con 0x7fc0540c3c90 2023-10-14T12:34:15.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.821+0000 7fc042ffd700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc03406af00 0x7fc03406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:15.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.821+0000 7fc042ffd700 1 -- 172.21.15.72:0/3160426312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc04c08aed0 con 0x7fc0540c3c90 2023-10-14T12:34:15.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.821+0000 7fc05259c700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc03406af00 0x7fc03406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:15.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.821+0000 7fc05259c700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc03406af00 0x7fc03406d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc048009c60 tx=0x7fc048009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:15.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:15.825+0000 7fc042ffd700 1 -- 172.21.15.72:0/3160426312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc04c055d20 con 0x7fc0540c3c90 2023-10-14T12:34:16.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.019+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0540c4650 con 0x7fc0540c3c90 2023-10-14T12:34:16.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.020+0000 7fc042ffd700 1 -- 172.21.15.72:0/3160426312 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fc04c018020 con 0x7fc0540c3c90 2023-10-14T12:34:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:16.022 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc03406af00 msgr2=0x7fc03406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc03406af00 0x7fc03406d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc048009c60 tx=0x7fc048009210 comp rx=0 tx=0).stop 2023-10-14T12:34:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0540c3c90 msgr2=0x7fc0540c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0540c3c90 0x7fc0540c4110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0011e0 tx=0x7fc04c009750 comp rx=0 tx=0).stop 2023-10-14T12:34:16.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 shutdown_connections 2023-10-14T12:34:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc03406af00 0x7fc03406d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0540c3c90 0x7fc0540c4110 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc03c004d90 0x7fc054158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 --2- 172.21.15.72:0/3160426312 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0540c5610 0x7fc0540c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 >> 172.21.15.72:0/3160426312 conn(0x7fc0540d0180 msgr2=0x7fc0540ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 shutdown_connections 2023-10-14T12:34:16.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.022+0000 7fc058e90700 1 -- 172.21.15.72:0/3160426312 wait complete. 2023-10-14T12:34:16.036 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:16.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:16.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.158+0000 7fec160d6700 1 Processor -- start 2023-10-14T12:34:16.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.158+0000 7fec160d6700 1 -- start start 2023-10-14T12:34:16.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec160d6700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec1006dcc0 0x7fec100cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec160d6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec100cba90 con 0x7fec1015a250 2023-10-14T12:34:16.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec160d6700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1015ee40 con 0x7fec1015dec0 2023-10-14T12:34:16.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec160d6700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100cb510 con 0x7fec1006dcc0 2023-10-14T12:34:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec0f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fec1015a250 0x7fec100717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:53976/0 (socket says 172.21.15.72:53976) 2023-10-14T12:34:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec0f7fe700 1 -- 172.21.15.72:0/1815496567 learned_addr learned my addr 172.21.15.72:0/1815496567 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec0ffff700 1 --2- 172.21.15.72:0/1815496567 >> v2:172.21.15.123:3300/0 conn(0x7fec1006dcc0 0x7fec100cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300427874 0 0) 0x7fec100cba90 con 0x7fec1015a250 2023-10-14T12:34:16.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febfc0035b0 con 0x7fec1015a250 2023-10-14T12:34:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451431670 0 0) 0x7fec1015ee40 con 0x7fec1015dec0 2023-10-14T12:34:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.159+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec100cba90 con 0x7fec1015dec0 2023-10-14T12:34:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821845326 0 0) 0x7febfc0035b0 con 0x7fec1015a250 2023-10-14T12:34:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 >> v2:172.21.15.123:3300/0 conn(0x7fec1006dcc0 msgr2=0x7fec100cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:16.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 --2- 172.21.15.72:0/1815496567 >> v2:172.21.15.123:3300/0 conn(0x7fec1006dcc0 0x7fec100cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 >> v1:172.21.15.123:6789/0 conn(0x7fec1015dec0 legacy=0x7fec1006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1015e880 con 0x7fec1015a250 2023-10-14T12:34:16.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7febf8001670 con 0x7fec1015a250 2023-10-14T12:34:16.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0ffff700 1 --2- 172.21.15.72:0/1815496567 >> v2:172.21.15.123:3300/0 conn(0x7fec1006dcc0 0x7fec100cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:16.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 >> v1:172.21.15.72:6789/0 conn(0x7fec1015a250 legacy=0x7fec100717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc003b90 0x7febfc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febfc004850 0x7febfc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc005210 0x7febfc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec100cb510 con 0x7febfc003b90 2023-10-14T12:34:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febfc00e2a0 con 0x7febfc005210 2023-10-14T12:34:16.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febfc00e460 con 0x7febfc004850 2023-10-14T12:34:16.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0f7fe700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc003b90 0x7febfc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0effd700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febfc004850 0x7febfc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0ffff700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc005210 0x7febfc00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0f7fe700 1 -- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febfc004850 msgr2=0x7febfc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:16.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0f7fe700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febfc004850 0x7febfc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0f7fe700 1 -- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc005210 msgr2=0x7febfc00dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:16.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0f7fe700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc005210 0x7febfc00dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0f7fe700 1 -- 172.21.15.72:0/1815496567 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc0035b0 con 0x7febfc003b90 2023-10-14T12:34:16.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0ffff700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc005210 0x7febfc00dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:16.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0effd700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febfc004850 0x7febfc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0ffff700 1 -- 172.21.15.72:0/1815496567 reap_dead start 2023-10-14T12:34:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0f7fe700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc003b90 0x7febfc003f90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7febf800c210 tx=0x7febfc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd80c688acd554c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf800cdb0 con 0x7febfc003b90 2023-10-14T12:34:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf8001af0 con 0x7febfc003b90 2023-10-14T12:34:16.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.160+0000 7fec0e7fc700 1 -- 172.21.15.72:0/1815496567 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8005ba0 con 0x7febfc003b90 2023-10-14T12:34:16.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.161+0000 7fec160d6700 1 -- 172.21.15.72:0/1815496567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc003b90 msgr2=0x7febfc003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.161+0000 7fec160d6700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc003b90 0x7febfc003f90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7febf800c210 tx=0x7febfc005880 comp rx=0 tx=0).stop 2023-10-14T12:34:16.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.161+0000 7fec160d6700 1 -- 172.21.15.72:0/1815496567 shutdown_connections 2023-10-14T12:34:16.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.161+0000 7fec160d6700 1 --2- 172.21.15.72:0/1815496567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7febfc003b90 0x7febfc003f90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.161+0000 7fec160d6700 1 -- 172.21.15.72:0/1815496567 >> 172.21.15.72:0/1815496567 conn(0x7fec100ccbe0 msgr2=0x7fec100ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.161+0000 7fec160d6700 1 -- 172.21.15.72:0/1815496567 shutdown_connections 2023-10-14T12:34:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.161+0000 7fec160d6700 1 -- 172.21.15.72:0/1815496567 wait complete. 2023-10-14T12:34:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.162+0000 7fec160d6700 1 Processor -- start 2023-10-14T12:34:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.162+0000 7fec160d6700 1 -- start start 2023-10-14T12:34:16.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec160d6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc003b90 0x7fec100b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec160d6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec100af200 0x7fec100ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec160d6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1014f710 0x7fec100c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec160d6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec100aed70 con 0x7fec1014f710 2023-10-14T12:34:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec160d6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec100ae160 con 0x7febfc003b90 2023-10-14T12:34:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec160d6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec100ae440 con 0x7fec100af200 2023-10-14T12:34:16.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1014f710 0x7fec100c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1014f710 0x7fec100c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47690/0 (socket says 172.21.15.72:47690) 2023-10-14T12:34:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0ffff700 1 -- 172.21.15.72:0/1399222677 learned_addr learned my addr 172.21.15.72:0/1399222677 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0f7fe700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc003b90 0x7fec100b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0effd700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec100af200 0x7fec100ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0ffff700 1 -- 172.21.15.72:0/1399222677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec100af200 msgr2=0x7fec100ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0ffff700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec100af200 0x7fec100ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0ffff700 1 -- 172.21.15.72:0/1399222677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc003b90 msgr2=0x7fec100b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0ffff700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc003b90 0x7fec100b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0ffff700 1 -- 172.21.15.72:0/1399222677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100ae720 con 0x7fec1014f710 2023-10-14T12:34:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0effd700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec100af200 0x7fec100ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:16.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.163+0000 7fec0ffff700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1014f710 0x7fec100c9240 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7febfc0047d0 tx=0x7fec08009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.164+0000 7fec07fff700 1 -- 172.21.15.72:0/1399222677 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800e030 con 0x7fec1014f710 2023-10-14T12:34:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.164+0000 7fec07fff700 1 -- 172.21.15.72:0/1399222677 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec08011c70 con 0x7fec1014f710 2023-10-14T12:34:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.164+0000 7fec07fff700 1 -- 172.21.15.72:0/1399222677 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08016470 con 0x7fec1014f710 2023-10-14T12:34:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.164+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec100aea00 con 0x7fec1014f710 2023-10-14T12:34:16.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.164+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec100c9780 con 0x7fec1014f710 2023-10-14T12:34:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.165+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec100aeee0 con 0x7fec1014f710 2023-10-14T12:34:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.165+0000 7fec07fff700 1 -- 172.21.15.72:0/1399222677 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fec080165d0 con 0x7fec1014f710 2023-10-14T12:34:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.165+0000 7fec07fff700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7febf006af00 0x7febf006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.165+0000 7fec07fff700 1 -- 172.21.15.72:0/1399222677 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec0800f070 con 0x7fec1014f710 2023-10-14T12:34:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.165+0000 7fec0f7fe700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7febf006af00 0x7febf006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.166+0000 7fec0f7fe700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7febf006af00 0x7febf006d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febf8000c00 tx=0x7febf8006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:16.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.170+0000 7fec07fff700 1 -- 172.21.15.72:0/1399222677 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fec08054e50 con 0x7fec1014f710 2023-10-14T12:34:16.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.356+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec1004ebb0 con 0x7fec1014f710 2023-10-14T12:34:16.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.357+0000 7fec07fff700 1 -- 172.21.15.72:0/1399222677 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec08058470 con 0x7fec1014f710 2023-10-14T12:34:16.358 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7febf006af00 msgr2=0x7febf006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7febf006af00 0x7febf006d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febf8000c00 tx=0x7febf8006040 comp rx=0 tx=0).stop 2023-10-14T12:34:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1014f710 msgr2=0x7fec100c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1014f710 0x7fec100c9240 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7febfc0047d0 tx=0x7fec08009f90 comp rx=0 tx=0).stop 2023-10-14T12:34:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 shutdown_connections 2023-10-14T12:34:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7febf006af00 0x7febf006d3c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1014f710 0x7fec100c9240 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febfc003b90 0x7fec100b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 --2- 172.21.15.72:0/1399222677 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fec100af200 0x7fec100ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 >> 172.21.15.72:0/1399222677 conn(0x7fec100ccbe0 msgr2=0x7fec100afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 shutdown_connections 2023-10-14T12:34:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.359+0000 7fec160d6700 1 -- 172.21.15.72:0/1399222677 wait complete. 2023-10-14T12:34:16.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.494+0000 7fb1e8c52700 1 Processor -- start 2023-10-14T12:34:16.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.494+0000 7fb1e8c52700 1 -- start start 2023-10-14T12:34:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.495+0000 7fb1e8c52700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406b370 0x7fb1e415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.495+0000 7fb1e8c52700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1e406a820 0x7fb1e406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.495+0000 7fb1e8c52700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e4161360 con 0x7fb1e40cdd30 2023-10-14T12:34:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.495+0000 7fb1e8c52700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e406b750 con 0x7fb1e406a820 2023-10-14T12:34:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.495+0000 7fb1e8c52700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e415e300 con 0x7fb1e406b370 2023-10-14T12:34:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.495+0000 7fb1e1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1e406a820 0x7fb1e406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.495+0000 7fb1e1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb1e406a820 0x7fb1e406d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47696/0 (socket says 172.21.15.72:47696) 2023-10-14T12:34:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.495+0000 7fb1e1d9b700 1 -- 172.21.15.72:0/3066454708 learned_addr learned my addr 172.21.15.72:0/3066454708 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e259c700 1 --2- 172.21.15.72:0/3066454708 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406b370 0x7fb1e415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e1d9b700 1 -- 172.21.15.72:0/3066454708 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406b370 msgr2=0x7fb1e415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e1d9b700 1 --2- 172.21.15.72:0/3066454708 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406b370 0x7fb1e415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e1d9b700 1 -- 172.21.15.72:0/3066454708 >> v1:172.21.15.123:6789/0 conn(0x7fb1e40cdd30 legacy=0x7fb1e41617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e1d9b700 1 -- 172.21.15.72:0/3066454708 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e415e5e0 con 0x7fb1e406a820 2023-10-14T12:34:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e259c700 1 --2- 172.21.15.72:0/3066454708 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406b370 0x7fb1e415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e1d9b700 1 --2- 172.21.15.72:0/3066454708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e406a820 0x7fb1e406d5b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40098f0 tx=0x7fb1d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4446109316bd501f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e159a700 1 -- 172.21.15.72:0/3066454708 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400b8a0 con 0x7fb1e406a820 2023-10-14T12:34:16.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e159a700 1 -- 172.21.15.72:0/3066454708 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d400ba00 con 0x7fb1e406a820 2023-10-14T12:34:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.496+0000 7fb1e159a700 1 -- 172.21.15.72:0/3066454708 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400bd90 con 0x7fb1e406a820 2023-10-14T12:34:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.497+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3066454708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e406a820 msgr2=0x7fb1e406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.497+0000 7fb1e8c52700 1 --2- 172.21.15.72:0/3066454708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e406a820 0x7fb1e406d5b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1d40098f0 tx=0x7fb1d4009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.497+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3066454708 shutdown_connections 2023-10-14T12:34:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.497+0000 7fb1e8c52700 1 --2- 172.21.15.72:0/3066454708 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406b370 0x7fb1e415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.497+0000 7fb1e8c52700 1 --2- 172.21.15.72:0/3066454708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e406a820 0x7fb1e406d5b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.497+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3066454708 >> 172.21.15.72:0/3066454708 conn(0x7fb1e40ccbe0 msgr2=0x7fb1e40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.497+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3066454708 shutdown_connections 2023-10-14T12:34:16.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.497+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3066454708 wait complete. 2023-10-14T12:34:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.498+0000 7fb1e8c52700 1 Processor -- start 2023-10-14T12:34:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.498+0000 7fb1e8c52700 1 -- start start 2023-10-14T12:34:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e8c52700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406a820 0x7fb1e41f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e8c52700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e406b370 0x7fb1e40c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e8c52700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40cdd30 0x7fb1e415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e8c52700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40ada10 con 0x7fb1e40cdd30 2023-10-14T12:34:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e8c52700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e40c7770 con 0x7fb1e406b370 2023-10-14T12:34:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e8c52700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e41f3b80 con 0x7fb1e406a820 2023-10-14T12:34:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40cdd30 0x7fb1e415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40cdd30 0x7fb1e415c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47704/0 (socket says 172.21.15.72:47704) 2023-10-14T12:34:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e2d9d700 1 -- 172.21.15.72:0/3462592437 learned_addr learned my addr 172.21.15.72:0/3462592437 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e259c700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406a820 0x7fb1e41f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e1d9b700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e406b370 0x7fb1e40c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e2d9d700 1 -- 172.21.15.72:0/3462592437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406a820 msgr2=0x7fb1e41f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e2d9d700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406a820 0x7fb1e41f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e2d9d700 1 -- 172.21.15.72:0/3462592437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e406b370 msgr2=0x7fb1e40c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e2d9d700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e406b370 0x7fb1e40c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e2d9d700 1 -- 172.21.15.72:0/3462592437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4009550 con 0x7fb1e40cdd30 2023-10-14T12:34:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1e2d9d700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40cdd30 0x7fb1e415c4e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00cc50 tx=0x7fb1dc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:16.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1d2ffd700 1 -- 172.21.15.72:0/3462592437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc003c00 con 0x7fb1e40cdd30 2023-10-14T12:34:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.499+0000 7fb1d2ffd700 1 -- 172.21.15.72:0/3462592437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc003d60 con 0x7fb1e40cdd30 2023-10-14T12:34:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.500+0000 7fb1d2ffd700 1 -- 172.21.15.72:0/3462592437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00aab0 con 0x7fb1e40cdd30 2023-10-14T12:34:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.500+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e41f3e60 con 0x7fb1e40cdd30 2023-10-14T12:34:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.500+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e41f4420 con 0x7fb1e40cdd30 2023-10-14T12:34:16.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.501+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e4072d10 con 0x7fb1e40cdd30 2023-10-14T12:34:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.501+0000 7fb1d2ffd700 1 -- 172.21.15.72:0/3462592437 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1dc00ac10 con 0x7fb1e40cdd30 2023-10-14T12:34:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.501+0000 7fb1d2ffd700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1c406af00 0x7fb1c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.501+0000 7fb1d2ffd700 1 -- 172.21.15.72:0/3462592437 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1dc0898a0 con 0x7fb1e40cdd30 2023-10-14T12:34:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.501+0000 7fb1e259c700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1c406af00 0x7fb1c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.502+0000 7fb1e259c700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1c406af00 0x7fb1c406d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80099d0 tx=0x7fb1d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:16.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.506+0000 7fb1d2ffd700 1 -- 172.21.15.72:0/3462592437 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1dc054660 con 0x7fb1e40cdd30 2023-10-14T12:34:16.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.696+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1e404ebb0 con 0x7fb1e40cdd30 2023-10-14T12:34:16.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.697+0000 7fb1d2ffd700 1 -- 172.21.15.72:0/3462592437 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1dc057c80 con 0x7fb1e40cdd30 2023-10-14T12:34:16.699 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1c406af00 msgr2=0x7fb1c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1c406af00 0x7fb1c406d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80099d0 tx=0x7fb1d8008040 comp rx=0 tx=0).stop 2023-10-14T12:34:16.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40cdd30 msgr2=0x7fb1e415c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40cdd30 0x7fb1e415c4e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00cc50 tx=0x7fb1dc00cf60 comp rx=0 tx=0).stop 2023-10-14T12:34:16.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 shutdown_connections 2023-10-14T12:34:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1c406af00 0x7fb1c406d3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb1e40cdd30 0x7fb1e415c4e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb1e406a820 0x7fb1e41f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 --2- 172.21.15.72:0/3462592437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1e406b370 0x7fb1e40c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 >> 172.21.15.72:0/3462592437 conn(0x7fb1e40ccbe0 msgr2=0x7fb1e41605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 shutdown_connections 2023-10-14T12:34:16.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.699+0000 7fb1e8c52700 1 -- 172.21.15.72:0/3462592437 wait complete. 2023-10-14T12:34:16.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:16.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.838+0000 7fbb0919c700 1 Processor -- start 2023-10-14T12:34:16.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.838+0000 7fbb0919c700 1 -- start start 2023-10-14T12:34:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0919c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb040ce390 0x7fbb04143260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0919c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb041437a0 0x7fbb0406cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0919c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb041613d0 con 0x7fbb040cf400 2023-10-14T12:34:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0919c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0415edf0 con 0x7fbb040ce390 2023-10-14T12:34:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0919c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb04161620 con 0x7fbb041437a0 2023-10-14T12:34:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb040ce390 0x7fbb04143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb040ce390 0x7fbb04143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47708/0 (socket says 172.21.15.72:47708) 2023-10-14T12:34:16.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0259c700 1 -- 172.21.15.72:0/2809499264 learned_addr learned my addr 172.21.15.72:0/2809499264 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0359e700 1 --2- 172.21.15.72:0/2809499264 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb041437a0 0x7fbb0406cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0259c700 1 -- 172.21.15.72:0/2809499264 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb041437a0 msgr2=0x7fbb0406cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0259c700 1 --2- 172.21.15.72:0/2809499264 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb041437a0 0x7fbb0406cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0259c700 1 -- 172.21.15.72:0/2809499264 >> v1:172.21.15.123:6789/0 conn(0x7fbb040cf400 legacy=0x7fbb040cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.839+0000 7fbb0259c700 1 -- 172.21.15.72:0/2809499264 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb04161900 con 0x7fbb040ce390 2023-10-14T12:34:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb0259c700 1 --2- 172.21.15.72:0/2809499264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb040ce390 0x7fbb04143260 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80098f0 tx=0x7fbaf8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04d11aee6566b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb01d9b700 1 -- 172.21.15.72:0/2809499264 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800b8a0 con 0x7fbb040ce390 2023-10-14T12:34:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb01d9b700 1 -- 172.21.15.72:0/2809499264 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf800ba00 con 0x7fbb040ce390 2023-10-14T12:34:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb01d9b700 1 -- 172.21.15.72:0/2809499264 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800bd90 con 0x7fbb040ce390 2023-10-14T12:34:16.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb0919c700 1 -- 172.21.15.72:0/2809499264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb040ce390 msgr2=0x7fbb04143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb0919c700 1 --2- 172.21.15.72:0/2809499264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb040ce390 0x7fbb04143260 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80098f0 tx=0x7fbaf8009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:16.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb0919c700 1 -- 172.21.15.72:0/2809499264 shutdown_connections 2023-10-14T12:34:16.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb0919c700 1 --2- 172.21.15.72:0/2809499264 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb041437a0 0x7fbb0406cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb0919c700 1 --2- 172.21.15.72:0/2809499264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb040ce390 0x7fbb04143260 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb0919c700 1 -- 172.21.15.72:0/2809499264 >> 172.21.15.72:0/2809499264 conn(0x7fbb0406a820 msgr2=0x7fbb0406ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:16.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb0919c700 1 -- 172.21.15.72:0/2809499264 shutdown_connections 2023-10-14T12:34:16.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.840+0000 7fbb0919c700 1 -- 172.21.15.72:0/2809499264 wait complete. 2023-10-14T12:34:16.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.842+0000 7fbb0919c700 1 Processor -- start 2023-10-14T12:34:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.842+0000 7fbb0919c700 1 -- start start 2023-10-14T12:34:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0919c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb040ce390 0x7fbb04153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0919c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb040cf400 0x7fbb040b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0919c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb041437a0 0x7fbb040b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0919c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040b15d0 con 0x7fbb041437a0 2023-10-14T12:34:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0919c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040b18b0 con 0x7fbb040ce390 2023-10-14T12:34:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0919c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040b1b90 con 0x7fbb040cf400 2023-10-14T12:34:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb041437a0 0x7fbb040b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb041437a0 0x7fbb040b46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47718/0 (socket says 172.21.15.72:47718) 2023-10-14T12:34:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0359e700 1 -- 172.21.15.72:0/579327038 learned_addr learned my addr 172.21.15.72:0/579327038 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb02d9d700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb040ce390 0x7fbb04153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.843+0000 7fbb0259c700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb040cf400 0x7fbb040b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbb0359e700 1 -- 172.21.15.72:0/579327038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb040cf400 msgr2=0x7fbb040b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbb0359e700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb040cf400 0x7fbb040b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbb0359e700 1 -- 172.21.15.72:0/579327038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb040ce390 msgr2=0x7fbb04153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbb0359e700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb040ce390 0x7fbb04153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbb0359e700 1 -- 172.21.15.72:0/579327038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf8009550 con 0x7fbb041437a0 2023-10-14T12:34:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbb0359e700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb041437a0 0x7fbb040b46d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400e810 tx=0x7fbaf400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbaeb7fe700 1 -- 172.21.15.72:0/579327038 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400c070 con 0x7fbb041437a0 2023-10-14T12:34:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbaeb7fe700 1 -- 172.21.15.72:0/579327038 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf4013610 con 0x7fbb041437a0 2023-10-14T12:34:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb040b1e70 con 0x7fbb041437a0 2023-10-14T12:34:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbaeb7fe700 1 -- 172.21.15.72:0/579327038 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf40139c0 con 0x7fbb041437a0 2023-10-14T12:34:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.844+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb040b1210 con 0x7fbb041437a0 2023-10-14T12:34:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.845+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb040b2390 con 0x7fbb041437a0 2023-10-14T12:34:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.845+0000 7fbaeb7fe700 1 -- 172.21.15.72:0/579327038 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbaf4013b20 con 0x7fbb041437a0 2023-10-14T12:34:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.846+0000 7fbaeb7fe700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbaf006af00 0x7fbaf006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.846+0000 7fbaeb7fe700 1 -- 172.21.15.72:0/579327038 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbaf40895d0 con 0x7fbb041437a0 2023-10-14T12:34:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.846+0000 7fbb02d9d700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbaf006af00 0x7fbaf006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.846+0000 7fbb02d9d700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbaf006af00 0x7fbaf006d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbb040c4770 tx=0x7fbafc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:16.850+0000 7fbaeb7fe700 1 -- 172.21.15.72:0/579327038 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbb040b2390 con 0x7fbb041437a0 2023-10-14T12:34:17.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.040+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb040b2390 con 0x7fbb041437a0 2023-10-14T12:34:17.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.040+0000 7fbaeb7fe700 1 -- 172.21.15.72:0/579327038 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb040b2390 con 0x7fbb041437a0 2023-10-14T12:34:17.042 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:17.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.042+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbaf006af00 msgr2=0x7fbaf006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.042+0000 7fbb0919c700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbaf006af00 0x7fbaf006d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbb040c4770 tx=0x7fbafc009040 comp rx=0 tx=0).stop 2023-10-14T12:34:17.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.042+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb041437a0 msgr2=0x7fbb040b46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.042+0000 7fbb0919c700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb041437a0 0x7fbb040b46d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400e810 tx=0x7fbaf400eb20 comp rx=0 tx=0).stop 2023-10-14T12:34:17.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.043+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 shutdown_connections 2023-10-14T12:34:17.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.043+0000 7fbb0919c700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fbaf006af00 0x7fbaf006d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.043+0000 7fbb0919c700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb041437a0 0x7fbb040b46d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.043+0000 7fbb0919c700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb040ce390 0x7fbb04153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.043+0000 7fbb0919c700 1 --2- 172.21.15.72:0/579327038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fbb040cf400 0x7fbb040b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.043+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 >> 172.21.15.72:0/579327038 conn(0x7fbb0406a820 msgr2=0x7fbb0415ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:17.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.043+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 shutdown_connections 2023-10-14T12:34:17.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.043+0000 7fbb0919c700 1 -- 172.21.15.72:0/579327038 wait complete. 2023-10-14T12:34:17.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.179+0000 7faad2696700 1 Processor -- start 2023-10-14T12:34:17.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.179+0000 7faad2696700 1 -- start start 2023-10-14T12:34:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faad2696700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faacc15dec0 0x7faacc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faad2696700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faacc15e350 0x7faacc06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faad2696700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc0cba90 con 0x7faacc15a250 2023-10-14T12:34:17.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faad2696700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faacc0cb510 con 0x7faacc15dec0 2023-10-14T12:34:17.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faad2696700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faacc071ec0 con 0x7faacc15e350 2023-10-14T12:34:17.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faacb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faacc15dec0 0x7faacc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faacb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faacc15dec0 0x7faacc06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47724/0 (socket says 172.21.15.72:47724) 2023-10-14T12:34:17.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faacb7fe700 1 -- 172.21.15.72:0/1171523555 learned_addr learned my addr 172.21.15.72:0/1171523555 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:17.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faad0c33700 1 --2- 172.21.15.72:0/1171523555 >> v2:172.21.15.123:3300/0 conn(0x7faacc15e350 0x7faacc06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faacb7fe700 1 -- 172.21.15.72:0/1171523555 >> v2:172.21.15.123:3300/0 conn(0x7faacc15e350 msgr2=0x7faacc06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faacb7fe700 1 --2- 172.21.15.72:0/1171523555 >> v2:172.21.15.123:3300/0 conn(0x7faacc15e350 0x7faacc06daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faacb7fe700 1 -- 172.21.15.72:0/1171523555 >> v1:172.21.15.123:6789/0 conn(0x7faacc15a250 legacy=0x7faacc0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faacb7fe700 1 -- 172.21.15.72:0/1171523555 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc15ee40 con 0x7faacc15dec0 2023-10-14T12:34:17.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faacb7fe700 1 --2- 172.21.15.72:0/1171523555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15dec0 0x7faacc06d5b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faacc067ac0 tx=0x7faabc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d740233a0aa015e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.180+0000 7faacaffd700 1 -- 172.21.15.72:0/1171523555 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc011830 con 0x7faacc15dec0 2023-10-14T12:34:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faacaffd700 1 -- 172.21.15.72:0/1171523555 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc011990 con 0x7faacc15dec0 2023-10-14T12:34:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faacaffd700 1 -- 172.21.15.72:0/1171523555 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc011d20 con 0x7faacc15dec0 2023-10-14T12:34:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faad2696700 1 -- 172.21.15.72:0/1171523555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15dec0 msgr2=0x7faacc06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faad2696700 1 --2- 172.21.15.72:0/1171523555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15dec0 0x7faacc06d5b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faacc067ac0 tx=0x7faabc009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faad2696700 1 -- 172.21.15.72:0/1171523555 shutdown_connections 2023-10-14T12:34:17.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faad2696700 1 --2- 172.21.15.72:0/1171523555 >> v2:172.21.15.123:3300/0 conn(0x7faacc15e350 0x7faacc06daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faad2696700 1 --2- 172.21.15.72:0/1171523555 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15dec0 0x7faacc06d5b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faad2696700 1 -- 172.21.15.72:0/1171523555 >> 172.21.15.72:0/1171523555 conn(0x7faacc0ccbe0 msgr2=0x7faacc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:17.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faad2696700 1 -- 172.21.15.72:0/1171523555 shutdown_connections 2023-10-14T12:34:17.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.181+0000 7faad2696700 1 -- 172.21.15.72:0/1171523555 wait complete. 2023-10-14T12:34:17.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.183+0000 7faad2696700 1 Processor -- start 2023-10-14T12:34:17.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.183+0000 7faad2696700 1 -- start start 2023-10-14T12:34:17.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad2696700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faacc15a250 0x7faacc156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad2696700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faacc15dec0 0x7faacc1f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad2696700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15e350 0x7faacc0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad2696700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc0c7580 con 0x7faacc15e350 2023-10-14T12:34:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad2696700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc0ac8c0 con 0x7faacc15dec0 2023-10-14T12:34:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad2696700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc156dc0 con 0x7faacc15a250 2023-10-14T12:34:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad0c33700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15e350 0x7faacc0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad0c33700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15e350 0x7faacc0cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47732/0 (socket says 172.21.15.72:47732) 2023-10-14T12:34:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad0c33700 1 -- 172.21.15.72:0/800111189 learned_addr learned my addr 172.21.15.72:0/800111189 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faacbfff700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faacc15a250 0x7faacc156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faacb7fe700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faacc15dec0 0x7faacc1f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad0c33700 1 -- 172.21.15.72:0/800111189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faacc15a250 msgr2=0x7faacc156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad0c33700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faacc15a250 0x7faacc156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad0c33700 1 -- 172.21.15.72:0/800111189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faacc15dec0 msgr2=0x7faacc1f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad0c33700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faacc15dec0 0x7faacc1f6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad0c33700 1 -- 172.21.15.72:0/800111189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc009550 con 0x7faacc15e350 2023-10-14T12:34:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad0c33700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15e350 0x7faacc0cbe20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faac400efc0 tx=0x7faac400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faac8ff9700 1 -- 172.21.15.72:0/800111189 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4009ba0 con 0x7faacc15e350 2023-10-14T12:34:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faac8ff9700 1 -- 172.21.15.72:0/800111189 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac400f040 con 0x7faacc15e350 2023-10-14T12:34:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc1f71b0 con 0x7faacc15e350 2023-10-14T12:34:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faac8ff9700 1 -- 172.21.15.72:0/800111189 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4014480 con 0x7faacc15e350 2023-10-14T12:34:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.184+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc0acad0 con 0x7faacc15e350 2023-10-14T12:34:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.185+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faacc04ebb0 con 0x7faacc15e350 2023-10-14T12:34:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.186+0000 7faac8ff9700 1 -- 172.21.15.72:0/800111189 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faac40145e0 con 0x7faacc15e350 2023-10-14T12:34:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.186+0000 7faac8ff9700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faab806af30 0x7faab806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.186+0000 7faac8ff9700 1 -- 172.21.15.72:0/800111189 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faac408a120 con 0x7faacc15e350 2023-10-14T12:34:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.186+0000 7faacbfff700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faab806af30 0x7faab806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.187+0000 7faacbfff700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faab806af30 0x7faab806d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faac0000f60 tx=0x7faac0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.191+0000 7faac8ff9700 1 -- 172.21.15.72:0/800111189 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faac4054ee0 con 0x7faacc15e350 2023-10-14T12:34:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.378+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faacc0b60e0 con 0x7faacc15e350 2023-10-14T12:34:17.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.378+0000 7faac8ff9700 1 -- 172.21.15.72:0/800111189 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7faac4058500 con 0x7faacc15e350 2023-10-14T12:34:17.380 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faab806af30 msgr2=0x7faab806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faab806af30 0x7faab806d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faac0000f60 tx=0x7faac0009040 comp rx=0 tx=0).stop 2023-10-14T12:34:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15e350 msgr2=0x7faacc0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15e350 0x7faacc0cbe20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faac400efc0 tx=0x7faac400c3a0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 shutdown_connections 2023-10-14T12:34:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faab806af30 0x7faab806d3f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faacc15e350 0x7faacc0cbe20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faacc15a250 0x7faacc156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 --2- 172.21.15.72:0/800111189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faacc15dec0 0x7faacc1f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 >> 172.21.15.72:0/800111189 conn(0x7faacc0ccbe0 msgr2=0x7faacc159790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 shutdown_connections 2023-10-14T12:34:17.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.381+0000 7faad2696700 1 -- 172.21.15.72:0/800111189 wait complete. 2023-10-14T12:34:17.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2023-10-14T12:34:17.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.513+0000 7fcc693ed700 1 Processor -- start 2023-10-14T12:34:17.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.514+0000 7fcc693ed700 1 -- start start 2023-10-14T12:34:17.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.514+0000 7fcc693ed700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcc640c5730 0x7fcc641652d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.514+0000 7fcc693ed700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc640ccb90 con 0x7fcc64143c50 2023-10-14T12:34:17.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.514+0000 7fcc693ed700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc640cce70 con 0x7fcc6415ec60 2023-10-14T12:34:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.514+0000 7fcc693ed700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc640cb0c0 con 0x7fcc640c5730 2023-10-14T12:34:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.514+0000 7fcc62ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcc64143c50 0x7fcc640ca650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54036/0 (socket says 172.21.15.72:54036) 2023-10-14T12:34:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.514+0000 7fcc62ffd700 1 -- 172.21.15.72:0/2991017176 learned_addr learned my addr 172.21.15.72:0/2991017176 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231315885 0 0) 0x7fcc640ccb90 con 0x7fcc64143c50 2023-10-14T12:34:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc637fe700 1 --2- 172.21.15.72:0/2991017176 >> v2:172.21.15.123:3300/0 conn(0x7fcc640c5730 0x7fcc641652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc500035b0 con 0x7fcc64143c50 2023-10-14T12:34:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1778617092 0 0) 0x7fcc500035b0 con 0x7fcc64143c50 2023-10-14T12:34:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 >> v2:172.21.15.123:3300/0 conn(0x7fcc640c5730 msgr2=0x7fcc641652d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 --2- 172.21.15.72:0/2991017176 >> v2:172.21.15.123:3300/0 conn(0x7fcc640c5730 0x7fcc641652d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 >> v1:172.21.15.123:6789/0 conn(0x7fcc6415ec60 legacy=0x7fcc640c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc640cb3a0 con 0x7fcc64143c50 2023-10-14T12:34:17.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7fcc4c001670 con 0x7fcc64143c50 2023-10-14T12:34:17.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 >> v1:172.21.15.72:6789/0 conn(0x7fcc64143c50 legacy=0x7fcc640ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50003a00 0x7fcc50003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc50004850 0x7fcc50004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc50005210 0x7fcc5000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640cb0c0 con 0x7fcc50004850 2023-10-14T12:34:17.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5000c1b0 con 0x7fcc50003a00 2023-10-14T12:34:17.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5000c370 con 0x7fcc50005210 2023-10-14T12:34:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc627fc700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc50004850 0x7fcc50004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc62ffd700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50003a00 0x7fcc50003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc637fe700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc50005210 0x7fcc5000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc627fc700 1 -- 172.21.15.72:0/2991017176 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc50005210 msgr2=0x7fcc5000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc627fc700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc50005210 0x7fcc5000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc627fc700 1 -- 172.21.15.72:0/2991017176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50003a00 msgr2=0x7fcc50003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc627fc700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50003a00 0x7fcc50003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc627fc700 1 -- 172.21.15.72:0/2991017176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500035b0 con 0x7fcc50004850 2023-10-14T12:34:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc637fe700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc50005210 0x7fcc5000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.515+0000 7fcc637fe700 1 -- 172.21.15.72:0/2991017176 reap_dead start 2023-10-14T12:34:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc627fc700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc50004850 0x7fcc50004cd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcc540017c0 tx=0x7fcc50005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e787d39c6e90005e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540052d0 con 0x7fcc50004850 2023-10-14T12:34:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc54005430 con 0x7fcc50004850 2023-10-14T12:34:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc61ffb700 1 -- 172.21.15.72:0/2991017176 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540038c0 con 0x7fcc50004850 2023-10-14T12:34:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc693ed700 1 -- 172.21.15.72:0/2991017176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc50004850 msgr2=0x7fcc50004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc693ed700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc50004850 0x7fcc50004cd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcc540017c0 tx=0x7fcc50005880 comp rx=0 tx=0).stop 2023-10-14T12:34:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc693ed700 1 -- 172.21.15.72:0/2991017176 shutdown_connections 2023-10-14T12:34:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc693ed700 1 --2- 172.21.15.72:0/2991017176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc50004850 0x7fcc50004cd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc693ed700 1 -- 172.21.15.72:0/2991017176 >> 172.21.15.72:0/2991017176 conn(0x7fcc6406c850 msgr2=0x7fcc6406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc693ed700 1 -- 172.21.15.72:0/2991017176 shutdown_connections 2023-10-14T12:34:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.516+0000 7fcc693ed700 1 -- 172.21.15.72:0/2991017176 wait complete. 2023-10-14T12:34:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc693ed700 1 Processor -- start 2023-10-14T12:34:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc693ed700 1 -- start start 2023-10-14T12:34:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc693ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50004850 0x7fcc641f0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc693ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc640b1150 0x7fcc6413ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc693ed700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc64141550 0x7fcc641419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc693ed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640c9090 con 0x7fcc640b1150 2023-10-14T12:34:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc693ed700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc64141f20 con 0x7fcc50004850 2023-10-14T12:34:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc693ed700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6413f1d0 con 0x7fcc64141550 2023-10-14T12:34:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc627fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc640b1150 0x7fcc6413ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc627fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc640b1150 0x7fcc6413ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47748/0 (socket says 172.21.15.72:47748) 2023-10-14T12:34:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.518+0000 7fcc627fc700 1 -- 172.21.15.72:0/3544850959 learned_addr learned my addr 172.21.15.72:0/3544850959 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc62ffd700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50004850 0x7fcc641f0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc637fe700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc64141550 0x7fcc641419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc627fc700 1 -- 172.21.15.72:0/3544850959 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc64141550 msgr2=0x7fcc641419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc627fc700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc64141550 0x7fcc641419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc627fc700 1 -- 172.21.15.72:0/3544850959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50004850 msgr2=0x7fcc641f0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc627fc700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50004850 0x7fcc641f0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc627fc700 1 -- 172.21.15.72:0/3544850959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc640c8410 con 0x7fcc640b1150 2023-10-14T12:34:17.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc62ffd700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50004850 0x7fcc641f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:17.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc627fc700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc640b1150 0x7fcc6413ec90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcc54015040 tx=0x7fcc54001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:17.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc5b7fe700 1 -- 172.21.15.72:0/3544850959 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54001290 con 0x7fcc640b1150 2023-10-14T12:34:17.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc5b7fe700 1 -- 172.21.15.72:0/3544850959 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5401d480 con 0x7fcc640b1150 2023-10-14T12:34:17.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc5b7fe700 1 -- 172.21.15.72:0/3544850959 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5401d830 con 0x7fcc640b1150 2023-10-14T12:34:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc640c86f0 con 0x7fcc640b1150 2023-10-14T12:34:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.519+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc640c8cb0 con 0x7fcc640b1150 2023-10-14T12:34:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.520+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6404f400 con 0x7fcc640b1150 2023-10-14T12:34:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.521+0000 7fcc5b7fe700 1 -- 172.21.15.72:0/3544850959 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcc54019040 con 0x7fcc640b1150 2023-10-14T12:34:17.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.521+0000 7fcc5b7fe700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcc4406af00 0x7fcc4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:17.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.521+0000 7fcc62ffd700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcc4406af00 0x7fcc4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:17.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.521+0000 7fcc5b7fe700 1 -- 172.21.15.72:0/3544850959 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc5408a4b0 con 0x7fcc640b1150 2023-10-14T12:34:17.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.521+0000 7fcc62ffd700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcc4406af00 0x7fcc4406d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc640b5240 tx=0x7fcc4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:17.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.525+0000 7fcc5b7fe700 1 -- 172.21.15.72:0/3544850959 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc54055300 con 0x7fcc640b1150 2023-10-14T12:34:17.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:17.796+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) v1 -- 0x7fcc6404ebb0 con 0x7fcc640b1150 2023-10-14T12:34:18.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.620+0000 7fcc5b7fe700 1 -- 172.21.15.72:0/3544850959 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v63) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcc54058920 con 0x7fcc640b1150 2023-10-14T12:34:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcc4406af00 msgr2=0x7fcc4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:18.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcc4406af00 0x7fcc4406d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcc640b5240 tx=0x7fcc4c009040 comp rx=0 tx=0).stop 2023-10-14T12:34:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc640b1150 msgr2=0x7fcc6413ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc640b1150 0x7fcc6413ec90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcc54015040 tx=0x7fcc54001120 comp rx=0 tx=0).stop 2023-10-14T12:34:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 shutdown_connections 2023-10-14T12:34:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcc4406af00 0x7fcc4406d3c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcc64141550 0x7fcc641419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc50004850 0x7fcc641f0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 --2- 172.21.15.72:0/3544850959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc640b1150 0x7fcc6413ec90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 >> 172.21.15.72:0/3544850959 conn(0x7fcc6406c850 msgr2=0x7fcc6415a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:18.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 shutdown_connections 2023-10-14T12:34:18.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.623+0000 7fcc693ed700 1 -- 172.21.15.72:0/3544850959 wait complete. 2023-10-14T12:34:18.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T12:34:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.769+0000 7f722d1a4700 1 Processor -- start 2023-10-14T12:34:18.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.769+0000 7f722d1a4700 1 -- start start 2023-10-14T12:34:18.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.769+0000 7f722d1a4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f722815dec0 0x7f722806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:18.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.769+0000 7f722d1a4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72280cba90 con 0x7f722815a250 2023-10-14T12:34:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.769+0000 7f722d1a4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722815ee40 con 0x7f722815e320 2023-10-14T12:34:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.769+0000 7f722d1a4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72280cb510 con 0x7f722815dec0 2023-10-14T12:34:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7226d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f722815a250 0x7f72280717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54054/0 (socket says 172.21.15.72:54054) 2023-10-14T12:34:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7226d9d700 1 -- 172.21.15.72:0/3994536434 learned_addr learned my addr 172.21.15.72:0/3994536434 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:18.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f722659c700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f722815dec0 0x7f722806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143397430 0 0) 0x7f72280cba90 con 0x7f722815a250 2023-10-14T12:34:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72100035b0 con 0x7f722815a250 2023-10-14T12:34:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2153334283 0 0) 0x7f72100035b0 con 0x7f722815a250 2023-10-14T12:34:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f722815dec0 msgr2=0x7f722806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:18.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f722815dec0 0x7f722806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 >> v1:172.21.15.123:6789/0 conn(0x7f722815e320 legacy=0x7f72280cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:18.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722815e880 con 0x7f722815a250 2023-10-14T12:34:18.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f7218001670 con 0x7f722815a250 2023-10-14T12:34:18.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 >> v1:172.21.15.72:6789/0 conn(0x7f722815a250 legacy=0x7f72280717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:18.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7210003a30 0x7f7210003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:18.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f722815dec0 0x7f7210004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:18.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7210004d90 0x7f7210005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:18.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72280cb510 con 0x7f7210004d90 2023-10-14T12:34:18.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721000bac0 con 0x7f7210003a30 2023-10-14T12:34:18.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721000bc80 con 0x7f722815dec0 2023-10-14T12:34:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f722759e700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7210004d90 0x7f7210005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f7226d9d700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7210003a30 0x7f7210003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.770+0000 7f722659c700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f722815dec0 0x7f7210004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722759e700 1 -- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f722815dec0 msgr2=0x7f7210004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:18.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722759e700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f722815dec0 0x7f7210004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722759e700 1 -- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7210003a30 msgr2=0x7f7210003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:18.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722759e700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7210003a30 0x7f7210003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722759e700 1 -- 172.21.15.72:0/3994536434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100035b0 con 0x7f7210004d90 2023-10-14T12:34:18.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722759e700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7210004d90 0x7f7210005210 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f722815e7b0 tx=0x7f7210005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b5f5a58d4e0178 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:18.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220001db0 con 0x7f7210004d90 2023-10-14T12:34:18.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722000cc70 con 0x7f7210004d90 2023-10-14T12:34:18.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f7225d9b700 1 -- 172.21.15.72:0/3994536434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220003a00 con 0x7f7210004d90 2023-10-14T12:34:18.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722d1a4700 1 -- 172.21.15.72:0/3994536434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7210004d90 msgr2=0x7f7210005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:18.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722d1a4700 1 --2- 172.21.15.72:0/3994536434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7210004d90 0x7f7210005210 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f722815e7b0 tx=0x7f7210005880 comp rx=0 tx=0).stop 2023-10-14T12:34:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722759e700 1 -- 172.21.15.72:0/3994536434 reap_dead start 2023-10-14T12:34:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722d1a4700 1 -- 172.21.15.72:0/3994536434 shutdown_connections 2023-10-14T12:34:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722d1a4700 1 -- 172.21.15.72:0/3994536434 >> 172.21.15.72:0/3994536434 conn(0x7f72280ccbe0 msgr2=0x7f72280ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722d1a4700 1 -- 172.21.15.72:0/3994536434 shutdown_connections 2023-10-14T12:34:18.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.771+0000 7f722d1a4700 1 -- 172.21.15.72:0/3994536434 wait complete. 2023-10-14T12:34:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.773+0000 7f722d1a4700 1 Processor -- start 2023-10-14T12:34:18.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.773+0000 7f722d1a4700 1 -- start start 2023-10-14T12:34:18.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722d1a4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7210004d90 0x7f72280c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:18.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722d1a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72280b5470 0x7f7228154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:18.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722d1a4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72280b58f0 0x7f7228154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:18.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722d1a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72280c4bf0 con 0x7f72280b5470 2023-10-14T12:34:18.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722d1a4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72280c6520 con 0x7f7210004d90 2023-10-14T12:34:18.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722d1a4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72280c3c90 con 0x7f72280b58f0 2023-10-14T12:34:18.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72280b5470 0x7f7228154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72280b5470 0x7f7228154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47766/0 (socket says 172.21.15.72:47766) 2023-10-14T12:34:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722659c700 1 -- 172.21.15.72:0/2550193746 learned_addr learned my addr 172.21.15.72:0/2550193746 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f7226d9d700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7210004d90 0x7f72280c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722759e700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72280b58f0 0x7f7228154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:18.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722659c700 1 -- 172.21.15.72:0/2550193746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72280b58f0 msgr2=0x7f7228154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722659c700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72280b58f0 0x7f7228154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722659c700 1 -- 172.21.15.72:0/2550193746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7210004d90 msgr2=0x7f72280c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722659c700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7210004d90 0x7f72280c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722659c700 1 -- 172.21.15.72:0/2550193746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280c3f70 con 0x7f72280b5470 2023-10-14T12:34:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f722659c700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72280b5470 0x7f7228154890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f721c011bb0 tx=0x7f721c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:18.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.774+0000 7f720f7fe700 1 -- 172.21.15.72:0/2550193746 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c016070 con 0x7f72280b5470 2023-10-14T12:34:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.775+0000 7f720f7fe700 1 -- 172.21.15.72:0/2550193746 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721c010b40 con 0x7f72280b5470 2023-10-14T12:34:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.775+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72280c4250 con 0x7f72280b5470 2023-10-14T12:34:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.775+0000 7f720f7fe700 1 -- 172.21.15.72:0/2550193746 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c01a410 con 0x7f72280b5470 2023-10-14T12:34:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.775+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72280c4810 con 0x7f72280b5470 2023-10-14T12:34:18.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.776+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72280c49d0 con 0x7f72280b5470 2023-10-14T12:34:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.776+0000 7f720f7fe700 1 -- 172.21.15.72:0/2550193746 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f721c01a570 con 0x7f72280b5470 2023-10-14T12:34:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.776+0000 7f720f7fe700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f721406af30 0x7f721406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.776+0000 7f720f7fe700 1 -- 172.21.15.72:0/2550193746 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f721c08b970 con 0x7f72280b5470 2023-10-14T12:34:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.776+0000 7f7226d9d700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f721406af30 0x7f721406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:18.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.777+0000 7f7226d9d700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f721406af30 0x7f721406d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7218001050 tx=0x7f7218000fa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:18.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.781+0000 7f720f7fe700 1 -- 172.21.15.72:0/2550193746 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f721c056870 con 0x7f72280b5470 2023-10-14T12:34:18.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.974+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f72280c4d30 con 0x7f72280b5470 2023-10-14T12:34:18.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.977+0000 7f720f7fe700 1 -- 172.21.15.72:0/2550193746 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72280c4d30 con 0x7f72280b5470 2023-10-14T12:34:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.979+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f721406af30 msgr2=0x7f721406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.979+0000 7f722d1a4700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f721406af30 0x7f721406d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7218001050 tx=0x7f7218000fa0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.979+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72280b5470 msgr2=0x7f7228154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.979+0000 7f722d1a4700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72280b5470 0x7f7228154890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f721c011bb0 tx=0x7f721c011ec0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.979+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 shutdown_connections 2023-10-14T12:34:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.980+0000 7f722d1a4700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f721406af30 0x7f721406d3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.980+0000 7f722d1a4700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f72280b58f0 0x7f7228154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.980+0000 7f722d1a4700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7210004d90 0x7f72280c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.980+0000 7f722d1a4700 1 --2- 172.21.15.72:0/2550193746 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72280b5470 0x7f7228154890 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.980+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 >> 172.21.15.72:0/2550193746 conn(0x7f72280ccbe0 msgr2=0x7f722806dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.980+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 shutdown_connections 2023-10-14T12:34:18.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:18.980+0000 7f722d1a4700 1 -- 172.21.15.72:0/2550193746 wait complete. 2023-10-14T12:34:18.993 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T12:34:18.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T12:34:19.031 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T12:34:19.080 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T12:34:19.081 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:19.081 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:19.100 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:19.100 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:19.157 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:19.158 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:19.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:19.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.373+0000 7f2feb8c9700 1 Processor -- start 2023-10-14T12:34:19.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.373+0000 7f2feb8c9700 1 -- start start 2023-10-14T12:34:19.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2feb8c9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 0x7f2fe41612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2feb8c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2fe41617e0 0x7f2fe406c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2feb8c9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe406b9d0 con 0x7f2fe4157d00 2023-10-14T12:34:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2feb8c9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe41580e0 con 0x7f2fe41617e0 2023-10-14T12:34:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2feb8c9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe406c370 con 0x7f2fe40cf550 2023-10-14T12:34:19.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fe9665700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2fe4157d00 0x7f2fe40cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54072/0 (socket says 172.21.15.72:54072) 2023-10-14T12:34:19.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fe9e66700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2fe41617e0 0x7f2fe406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fe9665700 1 -- 172.21.15.72:0/3357539060 learned_addr learned my addr 172.21.15.72:0/3357539060 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:19.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fe8e64700 1 --2- 172.21.15.72:0/3357539060 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 0x7f2fe41612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fe9e66700 1 -- 172.21.15.72:0/3357539060 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 msgr2=0x7f2fe41612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:19.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fe9e66700 1 --2- 172.21.15.72:0/3357539060 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 0x7f2fe41612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fe9e66700 1 -- 172.21.15.72:0/3357539060 >> v1:172.21.15.72:6789/0 conn(0x7f2fe4157d00 legacy=0x7f2fe40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fdbfff700 1 -- 172.21.15.72:0/3357539060 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602967687 0 0) 0x7f2fe406b9d0 con 0x7f2fe4157d00 2023-10-14T12:34:19.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fe9e66700 1 -- 172.21.15.72:0/3357539060 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe406bcb0 con 0x7f2fe41617e0 2023-10-14T12:34:19.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fe9e66700 1 --2- 172.21.15.72:0/3357539060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 0x7f2fe406c790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009d90 tx=0x7f2fdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b99fecb67e77ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:19.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.374+0000 7f2fdbfff700 1 -- 172.21.15.72:0/3357539060 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00e070 con 0x7f2fe41617e0 2023-10-14T12:34:19.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2fdbfff700 1 -- 172.21.15.72:0/3357539060 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc00bbd0 con 0x7f2fe41617e0 2023-10-14T12:34:19.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2fdbfff700 1 -- 172.21.15.72:0/3357539060 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc012430 con 0x7f2fe41617e0 2023-10-14T12:34:19.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3357539060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 msgr2=0x7f2fe406c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2feb8c9700 1 --2- 172.21.15.72:0/3357539060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 0x7f2fe406c790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009d90 tx=0x7f2fdc00b330 comp rx=0 tx=0).stop 2023-10-14T12:34:19.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3357539060 shutdown_connections 2023-10-14T12:34:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2feb8c9700 1 --2- 172.21.15.72:0/3357539060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 0x7f2fe406c790 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2feb8c9700 1 --2- 172.21.15.72:0/3357539060 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 0x7f2fe41612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3357539060 >> 172.21.15.72:0/3357539060 conn(0x7f2fe406a820 msgr2=0x7f2fe406ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3357539060 shutdown_connections 2023-10-14T12:34:19.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.375+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3357539060 wait complete. 2023-10-14T12:34:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.376+0000 7f2feb8c9700 1 Processor -- start 2023-10-14T12:34:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.376+0000 7f2feb8c9700 1 -- start start 2023-10-14T12:34:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2feb8c9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 0x7f2fe40b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2feb8c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe4157d00 0x7f2fe40b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2feb8c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 0x7f2fe414ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2feb8c9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe40b1e20 con 0x7f2fe41617e0 2023-10-14T12:34:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2feb8c9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe40b2100 con 0x7f2fe4157d00 2023-10-14T12:34:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2feb8c9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe40b3e70 con 0x7f2fe40cf550 2023-10-14T12:34:19.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe9e66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 0x7f2fe414ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe9e66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 0x7f2fe414ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47782/0 (socket says 172.21.15.72:47782) 2023-10-14T12:34:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe9e66700 1 -- 172.21.15.72:0/3656087377 learned_addr learned my addr 172.21.15.72:0/3656087377 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe9665700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 0x7f2fe40b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe8e64700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe4157d00 0x7f2fe40b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe9e66700 1 -- 172.21.15.72:0/3656087377 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 msgr2=0x7f2fe40b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe9e66700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 0x7f2fe40b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe9e66700 1 -- 172.21.15.72:0/3656087377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe4157d00 msgr2=0x7f2fe40b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe9e66700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe4157d00 0x7f2fe40b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe9e66700 1 -- 172.21.15.72:0/3656087377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc009a70 con 0x7f2fe41617e0 2023-10-14T12:34:19.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.377+0000 7f2fe8e64700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe4157d00 0x7f2fe40b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:19.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.378+0000 7f2fe9e66700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 0x7f2fe414ad30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40cea00 tx=0x7f2fdc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:19.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.378+0000 7f2fd9ffb700 1 -- 172.21.15.72:0/3656087377 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc012430 con 0x7f2fe41617e0 2023-10-14T12:34:19.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.378+0000 7f2fd9ffb700 1 -- 172.21.15.72:0/3656087377 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc020070 con 0x7f2fe41617e0 2023-10-14T12:34:19.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.378+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe40b4150 con 0x7f2fe41617e0 2023-10-14T12:34:19.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.378+0000 7f2fd9ffb700 1 -- 172.21.15.72:0/3656087377 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc004280 con 0x7f2fe41617e0 2023-10-14T12:34:19.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.378+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe40b23e0 con 0x7f2fe41617e0 2023-10-14T12:34:19.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.379+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe40ce4f0 con 0x7f2fe41617e0 2023-10-14T12:34:19.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.379+0000 7f2fd9ffb700 1 -- 172.21.15.72:0/3656087377 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2fdc0043e0 con 0x7f2fe41617e0 2023-10-14T12:34:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.380+0000 7f2fd9ffb700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2fc806af00 0x7f2fc806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.380+0000 7f2fd9ffb700 1 -- 172.21.15.72:0/3656087377 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fdc022070 con 0x7f2fe41617e0 2023-10-14T12:34:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.380+0000 7f2fe9665700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2fc806af00 0x7f2fc806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.380+0000 7f2fe9665700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2fc806af00 0x7f2fc806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0007fd0 tx=0x7f2fe0007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:19.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.384+0000 7f2fd9ffb700 1 -- 172.21.15.72:0/3656087377 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fdc056980 con 0x7f2fe41617e0 2023-10-14T12:34:19.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.579+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fe404ebb0 con 0x7f2fe41617e0 2023-10-14T12:34:19.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.580+0000 7f2fd9ffb700 1 -- 172.21.15.72:0/3656087377 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f2fdc059fa0 con 0x7f2fe41617e0 2023-10-14T12:34:19.582 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:19.582 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:33:36.244253+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:19.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2fc806af00 msgr2=0x7f2fc806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2fc806af00 0x7f2fc806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0007fd0 tx=0x7f2fe0007de0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 msgr2=0x7f2fe414ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 0x7f2fe414ad30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40cea00 tx=0x7f2fdc004ad0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 shutdown_connections 2023-10-14T12:34:19.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f2fc806af00 0x7f2fc806d3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fe41617e0 0x7f2fe414ad30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f2fe40cf550 0x7f2fe40b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 --2- 172.21.15.72:0/3656087377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe4157d00 0x7f2fe40b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 >> 172.21.15.72:0/3656087377 conn(0x7f2fe406a820 msgr2=0x7f2fe40d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:19.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 shutdown_connections 2023-10-14T12:34:19.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.582+0000 7f2feb8c9700 1 -- 172.21.15.72:0/3656087377 wait complete. 2023-10-14T12:34:19.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:19.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:19.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.718+0000 7fa4e8aa5700 1 Processor -- start 2023-10-14T12:34:19.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.718+0000 7fa4e8aa5700 1 -- start start 2023-10-14T12:34:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e8aa5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e415da20 0x7fa4e40caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e8aa5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4e40cb1e0 0x7fa4e40ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e8aa5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4e4066940 0x7fa4e40ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e8aa5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e40cc1e0 con 0x7fa4e40cb1e0 2023-10-14T12:34:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e8aa5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e415de00 con 0x7fa4e4066940 2023-10-14T12:34:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e8aa5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40cb660 con 0x7fa4e415da20 2023-10-14T12:34:19.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4e40cb1e0 0x7fa4e40ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4e40cb1e0 0x7fa4e40ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47786/0 (socket says 172.21.15.72:47786) 2023-10-14T12:34:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e1d9b700 1 -- 172.21.15.72:0/1672761418 learned_addr learned my addr 172.21.15.72:0/1672761418 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e259c700 1 --2- 172.21.15.72:0/1672761418 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e415da20 0x7fa4e40caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e2d9d700 1 --2- 172.21.15.72:0/1672761418 >> v2:172.21.15.123:3300/0 conn(0x7fa4e4066940 0x7fa4e40ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e1d9b700 1 -- 172.21.15.72:0/1672761418 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e415da20 msgr2=0x7fa4e40caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:19.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e1d9b700 1 --2- 172.21.15.72:0/1672761418 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e415da20 0x7fa4e40caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e1d9b700 1 -- 172.21.15.72:0/1672761418 >> v2:172.21.15.123:3300/0 conn(0x7fa4e4066940 msgr2=0x7fa4e40ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:19.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e1d9b700 1 --2- 172.21.15.72:0/1672761418 >> v2:172.21.15.123:3300/0 conn(0x7fa4e4066940 0x7fa4e40ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.719+0000 7fa4e1d9b700 1 -- 172.21.15.72:0/1672761418 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e40cb940 con 0x7fa4e40cb1e0 2023-10-14T12:34:19.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e1d9b700 1 --2- 172.21.15.72:0/1672761418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e40cb1e0 0x7fa4e40ce110 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40cf260 tx=0x7fa4d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3178b28110fd2a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:19.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e159a700 1 -- 172.21.15.72:0/1672761418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800b870 con 0x7fa4e40cb1e0 2023-10-14T12:34:19.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e159a700 1 -- 172.21.15.72:0/1672761418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800b9d0 con 0x7fa4e40cb1e0 2023-10-14T12:34:19.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e159a700 1 -- 172.21.15.72:0/1672761418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800bd60 con 0x7fa4e40cb1e0 2023-10-14T12:34:19.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/1672761418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e40cb1e0 msgr2=0x7fa4e40ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/1672761418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e40cb1e0 0x7fa4e40ce110 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40cf260 tx=0x7fa4d8009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/1672761418 shutdown_connections 2023-10-14T12:34:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/1672761418 >> v2:172.21.15.123:3300/0 conn(0x7fa4e4066940 0x7fa4e40ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/1672761418 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e415da20 0x7fa4e40caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/1672761418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e40cb1e0 0x7fa4e40ce110 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/1672761418 >> 172.21.15.72:0/1672761418 conn(0x7fa4e40b13e0 msgr2=0x7fa4e40b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:19.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/1672761418 shutdown_connections 2023-10-14T12:34:19.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.720+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/1672761418 wait complete. 2023-10-14T12:34:19.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.722+0000 7fa4e8aa5700 1 Processor -- start 2023-10-14T12:34:19.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.722+0000 7fa4e8aa5700 1 -- start start 2023-10-14T12:34:19.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.722+0000 7fa4e8aa5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e4066940 0x7fa4e414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.722+0000 7fa4e8aa5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e40cb1e0 0x7fa4e406ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.722+0000 7fa4e8aa5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e415da20 0x7fa4e4152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.722+0000 7fa4e8aa5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e415b290 con 0x7fa4e415da20 2023-10-14T12:34:19.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.722+0000 7fa4e8aa5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e4150340 con 0x7fa4e40cb1e0 2023-10-14T12:34:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.722+0000 7fa4e8aa5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e40adc80 con 0x7fa4e4066940 2023-10-14T12:34:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e415da20 0x7fa4e4152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e415da20 0x7fa4e4152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47796/0 (socket says 172.21.15.72:47796) 2023-10-14T12:34:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e2d9d700 1 -- 172.21.15.72:0/3489309049 learned_addr learned my addr 172.21.15.72:0/3489309049 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:19.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e259c700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e4066940 0x7fa4e414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e1d9b700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e40cb1e0 0x7fa4e406ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e2d9d700 1 -- 172.21.15.72:0/3489309049 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e4066940 msgr2=0x7fa4e414fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e2d9d700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e4066940 0x7fa4e414fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e2d9d700 1 -- 172.21.15.72:0/3489309049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e40cb1e0 msgr2=0x7fa4e406ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e2d9d700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e40cb1e0 0x7fa4e406ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e2d9d700 1 -- 172.21.15.72:0/3489309049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8009550 con 0x7fa4e415da20 2023-10-14T12:34:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e2d9d700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e415da20 0x7fa4e4152dd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc007e40 tx=0x7fa4dc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4d2ffd700 1 -- 172.21.15.72:0/3489309049 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc00ed30 con 0x7fa4e415da20 2023-10-14T12:34:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4d2ffd700 1 -- 172.21.15.72:0/3489309049 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc014420 con 0x7fa4e415da20 2023-10-14T12:34:19.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e40adf60 con 0x7fa4e415da20 2023-10-14T12:34:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4d2ffd700 1 -- 172.21.15.72:0/3489309049 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0147d0 con 0x7fa4e415da20 2023-10-14T12:34:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.723+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e40c6a60 con 0x7fa4e415da20 2023-10-14T12:34:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.724+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e404ebb0 con 0x7fa4e415da20 2023-10-14T12:34:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.725+0000 7fa4d2ffd700 1 -- 172.21.15.72:0/3489309049 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa4dc014930 con 0x7fa4e415da20 2023-10-14T12:34:19.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.725+0000 7fa4d2ffd700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa4c406af00 0x7fa4c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.725+0000 7fa4d2ffd700 1 -- 172.21.15.72:0/3489309049 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4dc089f70 con 0x7fa4e415da20 2023-10-14T12:34:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.725+0000 7fa4e259c700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa4c406af00 0x7fa4c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.725+0000 7fa4e259c700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa4c406af00 0x7fa4c406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4006b20 tx=0x7fa4d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:19.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.729+0000 7fa4d2ffd700 1 -- 172.21.15.72:0/3489309049 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4dc0bcca0 con 0x7fa4e415da20 2023-10-14T12:34:19.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.923+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4e40c6c50 con 0x7fa4e415da20 2023-10-14T12:34:19.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.924+0000 7fa4d2ffd700 1 -- 172.21.15.72:0/3489309049 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4dc054d30 con 0x7fa4e415da20 2023-10-14T12:34:19.926 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:19.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa4c406af00 msgr2=0x7fa4c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa4c406af00 0x7fa4c406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4006b20 tx=0x7fa4d4008040 comp rx=0 tx=0).stop 2023-10-14T12:34:19.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e415da20 msgr2=0x7fa4e4152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:19.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e415da20 0x7fa4e4152dd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc007e40 tx=0x7fa4dc00e3c0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 shutdown_connections 2023-10-14T12:34:19.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa4c406af00 0x7fa4c406d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4e415da20 0x7fa4e4152dd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4e4066940 0x7fa4e414fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 --2- 172.21.15.72:0/3489309049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4e40cb1e0 0x7fa4e406ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:19.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 >> 172.21.15.72:0/3489309049 conn(0x7fa4e40b13e0 msgr2=0x7fa4e40af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:19.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 shutdown_connections 2023-10-14T12:34:19.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:19.926+0000 7fa4e8aa5700 1 -- 172.21.15.72:0/3489309049 wait complete. 2023-10-14T12:34:19.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:20.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.067+0000 7f21fede9700 1 Processor -- start 2023-10-14T12:34:20.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.067+0000 7f21fede9700 1 -- start start 2023-10-14T12:34:20.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fede9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21f806a820 0x7f21f806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fede9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21f80717b0 0x7f21f8071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fede9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80cad30 con 0x7f21f8072170 2023-10-14T12:34:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fede9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80ca7b0 con 0x7f21f806a820 2023-10-14T12:34:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fede9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80cb1c0 con 0x7f21f80717b0 2023-10-14T12:34:20.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fcb85700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21f806a820 0x7f21f806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fcb85700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21f806a820 0x7f21f806ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47800/0 (socket says 172.21.15.72:47800) 2023-10-14T12:34:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fcb85700 1 -- 172.21.15.72:0/512370342 learned_addr learned my addr 172.21.15.72:0/512370342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21f7fff700 1 --2- 172.21.15.72:0/512370342 >> v2:172.21.15.123:3300/0 conn(0x7f21f80717b0 0x7f21f8071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fcb85700 1 -- 172.21.15.72:0/512370342 >> v2:172.21.15.123:3300/0 conn(0x7f21f80717b0 msgr2=0x7f21f8071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fcb85700 1 --2- 172.21.15.72:0/512370342 >> v2:172.21.15.123:3300/0 conn(0x7f21f80717b0 0x7f21f8071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fcb85700 1 -- 172.21.15.72:0/512370342 >> v1:172.21.15.72:6789/0 conn(0x7f21f8072170 legacy=0x7f21f815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fcb85700 1 -- 172.21.15.72:0/512370342 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f80725e0 con 0x7f21f806a820 2023-10-14T12:34:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21f77fe700 1 -- 172.21.15.72:0/512370342 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914788220 0 0) 0x7f21f80cad30 con 0x7f21f8072170 2023-10-14T12:34:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21f7fff700 1 --2- 172.21.15.72:0/512370342 >> v2:172.21.15.123:3300/0 conn(0x7f21f80717b0 0x7f21f8071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21fcb85700 1 --2- 172.21.15.72:0/512370342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f806a820 0x7f21f806ac00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f21f8070360 tx=0x7f21ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba5d5cffa5d01fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.068+0000 7f21f77fe700 1 -- 172.21.15.72:0/512370342 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00b870 con 0x7f21f806a820 2023-10-14T12:34:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21f77fe700 1 -- 172.21.15.72:0/512370342 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec00b9d0 con 0x7f21f806a820 2023-10-14T12:34:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21f77fe700 1 -- 172.21.15.72:0/512370342 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00bd60 con 0x7f21f806a820 2023-10-14T12:34:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21fede9700 1 -- 172.21.15.72:0/512370342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f806a820 msgr2=0x7f21f806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21fede9700 1 --2- 172.21.15.72:0/512370342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f806a820 0x7f21f806ac00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f21f8070360 tx=0x7f21ec009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21fede9700 1 -- 172.21.15.72:0/512370342 shutdown_connections 2023-10-14T12:34:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21fede9700 1 --2- 172.21.15.72:0/512370342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f806a820 0x7f21f806ac00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21fede9700 1 --2- 172.21.15.72:0/512370342 >> v2:172.21.15.123:3300/0 conn(0x7f21f80717b0 0x7f21f8071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21fede9700 1 -- 172.21.15.72:0/512370342 >> 172.21.15.72:0/512370342 conn(0x7f21f80ccbe0 msgr2=0x7f21f80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21fede9700 1 -- 172.21.15.72:0/512370342 shutdown_connections 2023-10-14T12:34:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.069+0000 7f21fede9700 1 -- 172.21.15.72:0/512370342 wait complete. 2023-10-14T12:34:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.070+0000 7f21fede9700 1 Processor -- start 2023-10-14T12:34:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.070+0000 7f21fede9700 1 -- start start 2023-10-14T12:34:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21fede9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21f806a820 0x7f21f81572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21fede9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f80717b0 0x7f21f80a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21fede9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21f8072170 0x7f21f80a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21fede9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80aae60 con 0x7f21f80717b0 2023-10-14T12:34:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21fede9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f815da50 con 0x7f21f806a820 2023-10-14T12:34:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21fede9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80aa370 con 0x7f21f8072170 2023-10-14T12:34:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21f7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f80717b0 0x7f21f80a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21f7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f80717b0 0x7f21f80a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47806/0 (socket says 172.21.15.72:47806) 2023-10-14T12:34:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21f7fff700 1 -- 172.21.15.72:0/1753328998 learned_addr learned my addr 172.21.15.72:0/1753328998 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21fcb85700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21f806a820 0x7f21f81572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.071+0000 7f21fd386700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21f8072170 0x7f21f80a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21f7fff700 1 -- 172.21.15.72:0/1753328998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21f8072170 msgr2=0x7f21f80a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21f7fff700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21f8072170 0x7f21f80a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21f7fff700 1 -- 172.21.15.72:0/1753328998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21f806a820 msgr2=0x7f21f81572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21f7fff700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21f806a820 0x7f21f81572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21f7fff700 1 -- 172.21.15.72:0/1753328998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec009550 con 0x7f21f80717b0 2023-10-14T12:34:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21f7fff700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f80717b0 0x7f21f80a84b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c750 tx=0x7f21e400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21f57fa700 1 -- 172.21.15.72:0/1753328998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4011800 con 0x7f21f80717b0 2023-10-14T12:34:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21f57fa700 1 -- 172.21.15.72:0/1753328998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4011960 con 0x7f21f80717b0 2023-10-14T12:34:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f80aa5c0 con 0x7f21f80717b0 2023-10-14T12:34:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21f57fa700 1 -- 172.21.15.72:0/1753328998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4011cd0 con 0x7f21f80717b0 2023-10-14T12:34:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.072+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f80aab80 con 0x7f21f80717b0 2023-10-14T12:34:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.073+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f804ebb0 con 0x7f21f80717b0 2023-10-14T12:34:20.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.073+0000 7f21f57fa700 1 -- 172.21.15.72:0/1753328998 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f21e4021350 con 0x7f21f80717b0 2023-10-14T12:34:20.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.074+0000 7f21f57fa700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f21dc06af00 0x7f21dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.074+0000 7f21fcb85700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f21dc06af00 0x7f21dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.074+0000 7f21f57fa700 1 -- 172.21.15.72:0/1753328998 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f21e40897d0 con 0x7f21f80717b0 2023-10-14T12:34:20.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.074+0000 7f21fcb85700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f21dc06af00 0x7f21dc06d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f21ec000c00 tx=0x7f21ec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:20.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.078+0000 7f21f57fa700 1 -- 172.21.15.72:0/1753328998 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21e40544c0 con 0x7f21f80717b0 2023-10-14T12:34:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.266+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21f806b710 con 0x7f21f80717b0 2023-10-14T12:34:20.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.267+0000 7f21f57fa700 1 -- 172.21.15.72:0/1753328998 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21e401e020 con 0x7f21f80717b0 2023-10-14T12:34:20.268 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:20.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f21dc06af00 msgr2=0x7f21dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f21dc06af00 0x7f21dc06d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f21ec000c00 tx=0x7f21ec008030 comp rx=0 tx=0).stop 2023-10-14T12:34:20.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f80717b0 msgr2=0x7f21f80a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f80717b0 0x7f21f80a84b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c750 tx=0x7f21e400ca60 comp rx=0 tx=0).stop 2023-10-14T12:34:20.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 shutdown_connections 2023-10-14T12:34:20.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f21dc06af00 0x7f21dc06d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f21f8072170 0x7f21f80a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21f806a820 0x7f21f81572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 --2- 172.21.15.72:0/1753328998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21f80717b0 0x7f21f80a84b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 >> 172.21.15.72:0/1753328998 conn(0x7f21f80ccbe0 msgr2=0x7f21f80c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 shutdown_connections 2023-10-14T12:34:20.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.269+0000 7f21fede9700 1 -- 172.21.15.72:0/1753328998 wait complete. 2023-10-14T12:34:20.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:20.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.404+0000 7f199ed0e700 1 Processor -- start 2023-10-14T12:34:20.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.404+0000 7f199ed0e700 1 -- start start 2023-10-14T12:34:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.405+0000 7f199ed0e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 0x7f19980717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.405+0000 7f199ed0e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f199815dec0 0x7f199806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.405+0000 7f199ed0e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f199815e320 0x7f199806daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.405+0000 7f199ed0e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19980cb510 con 0x7f199815dec0 2023-10-14T12:34:20.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.405+0000 7f199ed0e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19980cba90 con 0x7f199815e320 2023-10-14T12:34:20.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.405+0000 7f199ed0e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199815ee40 con 0x7f199815a250 2023-10-14T12:34:20.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.405+0000 7f1997fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f199815dec0 0x7f199806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.405+0000 7f1997fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f199815dec0 0x7f199806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47812/0 (socket says 172.21.15.72:47812) 2023-10-14T12:34:20.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.405+0000 7f1997fff700 1 -- 172.21.15.72:0/2125959391 learned_addr learned my addr 172.21.15.72:0/2125959391 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f199caaa700 1 --2- 172.21.15.72:0/2125959391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 0x7f19980717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f199d2ab700 1 --2- 172.21.15.72:0/2125959391 >> v2:172.21.15.123:3300/0 conn(0x7f199815e320 0x7f199806daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f1997fff700 1 -- 172.21.15.72:0/2125959391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 msgr2=0x7f19980717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f1997fff700 1 --2- 172.21.15.72:0/2125959391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 0x7f19980717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f1997fff700 1 -- 172.21.15.72:0/2125959391 >> v2:172.21.15.123:3300/0 conn(0x7f199815e320 msgr2=0x7f199806daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f1997fff700 1 --2- 172.21.15.72:0/2125959391 >> v2:172.21.15.123:3300/0 conn(0x7f199815e320 0x7f199806daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f1997fff700 1 -- 172.21.15.72:0/2125959391 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199815e880 con 0x7f199815dec0 2023-10-14T12:34:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f199d2ab700 1 --2- 172.21.15.72:0/2125959391 >> v2:172.21.15.123:3300/0 conn(0x7f199815e320 0x7f199806daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f1997fff700 1 --2- 172.21.15.72:0/2125959391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815dec0 0x7f199806d5b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1998071740 tx=0x7f1984009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9149907b24351520 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:20.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f19977fe700 1 -- 172.21.15.72:0/2125959391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400b870 con 0x7f199815dec0 2023-10-14T12:34:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f19977fe700 1 -- 172.21.15.72:0/2125959391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198400b9d0 con 0x7f199815dec0 2023-10-14T12:34:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f19977fe700 1 -- 172.21.15.72:0/2125959391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400bd60 con 0x7f199815dec0 2023-10-14T12:34:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f199ed0e700 1 -- 172.21.15.72:0/2125959391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815dec0 msgr2=0x7f199806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.406+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2125959391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815dec0 0x7f199806d5b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1998071740 tx=0x7f1984009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.407+0000 7f199ed0e700 1 -- 172.21.15.72:0/2125959391 shutdown_connections 2023-10-14T12:34:20.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.407+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2125959391 >> v2:172.21.15.123:3300/0 conn(0x7f199815e320 0x7f199806daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.407+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2125959391 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 0x7f19980717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.407+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2125959391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815dec0 0x7f199806d5b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.407+0000 7f199ed0e700 1 -- 172.21.15.72:0/2125959391 >> 172.21.15.72:0/2125959391 conn(0x7f19980ccbe0 msgr2=0x7f19980ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.407+0000 7f199ed0e700 1 -- 172.21.15.72:0/2125959391 shutdown_connections 2023-10-14T12:34:20.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.407+0000 7f199ed0e700 1 -- 172.21.15.72:0/2125959391 wait complete. 2023-10-14T12:34:20.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.408+0000 7f199ed0e700 1 Processor -- start 2023-10-14T12:34:20.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.408+0000 7f199ed0e700 1 -- start start 2023-10-14T12:34:20.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199ed0e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 0x7f19981f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199ed0e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f199815dec0 0x7f19981577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199ed0e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815e320 0x7f19980b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199ed0e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199814e0b0 con 0x7f199815e320 2023-10-14T12:34:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199ed0e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19980ac8c0 con 0x7f199815dec0 2023-10-14T12:34:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199ed0e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1998158070 con 0x7f199815a250 2023-10-14T12:34:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199d2ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815e320 0x7f19980b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199d2ab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815e320 0x7f19980b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47820/0 (socket says 172.21.15.72:47820) 2023-10-14T12:34:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199d2ab700 1 -- 172.21.15.72:0/2137231519 learned_addr learned my addr 172.21.15.72:0/2137231519 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f1997fff700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f199815dec0 0x7f19981577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199caaa700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 0x7f19981f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199d2ab700 1 -- 172.21.15.72:0/2137231519 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 msgr2=0x7f19981f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199d2ab700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 0x7f19981f2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199d2ab700 1 -- 172.21.15.72:0/2137231519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f199815dec0 msgr2=0x7f19981577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199d2ab700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f199815dec0 0x7f19981577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199d2ab700 1 -- 172.21.15.72:0/2137231519 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1984009550 con 0x7f199815e320 2023-10-14T12:34:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f1997fff700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f199815dec0 0x7f19981577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199d2ab700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815e320 0x7f19980b4350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f199000cea0 tx=0x7f199000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f19957fa700 1 -- 172.21.15.72:0/2137231519 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000ae50 con 0x7f199815e320 2023-10-14T12:34:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f19957fa700 1 -- 172.21.15.72:0/2137231519 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990003a20 con 0x7f199815e320 2023-10-14T12:34:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f19957fa700 1 -- 172.21.15.72:0/2137231519 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990003dd0 con 0x7f199815e320 2023-10-14T12:34:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1998158350 con 0x7f199815e320 2023-10-14T12:34:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.409+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19980acb60 con 0x7f199815e320 2023-10-14T12:34:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.410+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199804ebb0 con 0x7f199815e320 2023-10-14T12:34:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.411+0000 7f19957fa700 1 -- 172.21.15.72:0/2137231519 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1990003f30 con 0x7f199815e320 2023-10-14T12:34:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.411+0000 7f19957fa700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f197c06af00 0x7f197c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.411+0000 7f19957fa700 1 -- 172.21.15.72:0/2137231519 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1990089d00 con 0x7f199815e320 2023-10-14T12:34:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.411+0000 7f199caaa700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f197c06af00 0x7f197c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.412+0000 7f199caaa700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f197c06af00 0x7f197c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f198c00b840 tx=0x7f198c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:20.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.416+0000 7f19957fa700 1 -- 172.21.15.72:0/2137231519 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1990054a80 con 0x7f199815e320 2023-10-14T12:34:20.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.605+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19980b60e0 con 0x7f199815e320 2023-10-14T12:34:20.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.605+0000 7f19957fa700 1 -- 172.21.15.72:0/2137231519 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19900580a0 con 0x7f199815e320 2023-10-14T12:34:20.607 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:20.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f197c06af00 msgr2=0x7f197c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f197c06af00 0x7f197c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f198c00b840 tx=0x7f198c008040 comp rx=0 tx=0).stop 2023-10-14T12:34:20.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815e320 msgr2=0x7f19980b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815e320 0x7f19980b4350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f199000cea0 tx=0x7f199000cf80 comp rx=0 tx=0).stop 2023-10-14T12:34:20.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 shutdown_connections 2023-10-14T12:34:20.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f197c06af00 0x7f197c06d3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f199815e320 0x7f19980b4350 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f199815a250 0x7f19981f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 --2- 172.21.15.72:0/2137231519 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f199815dec0 0x7f19981577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.607+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 >> 172.21.15.72:0/2137231519 conn(0x7f19980ccbe0 msgr2=0x7f199806d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:20.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.608+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 shutdown_connections 2023-10-14T12:34:20.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.608+0000 7f199ed0e700 1 -- 172.21.15.72:0/2137231519 wait complete. 2023-10-14T12:34:20.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:20.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.744+0000 7f9918ffa700 1 Processor -- start 2023-10-14T12:34:20.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.744+0000 7f9918ffa700 1 -- start start 2023-10-14T12:34:20.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f9918ffa700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f99140ce450 0x7f99140ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f9918ffa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9914159f30 con 0x7f991406bd30 2023-10-14T12:34:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f9918ffa700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991406ea20 con 0x7f9914159b50 2023-10-14T12:34:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f9918ffa700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991406c1e0 con 0x7f99140ce450 2023-10-14T12:34:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f9911d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f991406bd30 0x7f99140cdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54124/0 (socket says 172.21.15.72:54124) 2023-10-14T12:34:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f9911d9b700 1 -- 172.21.15.72:0/4019981454 learned_addr learned my addr 172.21.15.72:0/4019981454 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f9912d9d700 1 --2- 172.21.15.72:0/4019981454 >> v2:172.21.15.123:3300/0 conn(0x7f99140ce450 0x7f99140ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315358072 0 0) 0x7f9914159f30 con 0x7f991406bd30 2023-10-14T12:34:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98fc0035b0 con 0x7f991406bd30 2023-10-14T12:34:20.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 422825267 0 0) 0x7f98fc0035b0 con 0x7f991406bd30 2023-10-14T12:34:20.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 >> v2:172.21.15.123:3300/0 conn(0x7f99140ce450 msgr2=0x7f99140ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:20.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 --2- 172.21.15.72:0/4019981454 >> v2:172.21.15.123:3300/0 conn(0x7f99140ce450 0x7f99140ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 >> v1:172.21.15.123:6789/0 conn(0x7f9914159b50 legacy=0x7f991406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991406ac90 con 0x7f991406bd30 2023-10-14T12:34:20.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f9908001670 con 0x7f991406bd30 2023-10-14T12:34:20.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 >> v1:172.21.15.72:6789/0 conn(0x7f991406bd30 legacy=0x7f99140cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc003a00 0x7f98fc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f98fc004850 0x7f98fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc005210 0x7f98fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991406c1e0 con 0x7f98fc003a00 2023-10-14T12:34:20.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc00c0b0 con 0x7f98fc005210 2023-10-14T12:34:20.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc00c270 con 0x7f98fc004850 2023-10-14T12:34:20.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f991259c700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc003a00 0x7f98fc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.745+0000 7f9912d9d700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc005210 0x7f98fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f9911d9b700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f98fc004850 0x7f98fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f991259c700 1 -- 172.21.15.72:0/4019981454 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f98fc004850 msgr2=0x7f98fc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f991259c700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f98fc004850 0x7f98fc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f991259c700 1 -- 172.21.15.72:0/4019981454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc005210 msgr2=0x7f98fc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:20.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f991259c700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc005210 0x7f98fc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f991259c700 1 -- 172.21.15.72:0/4019981454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0035b0 con 0x7f98fc003a00 2023-10-14T12:34:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f9912d9d700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc005210 0x7f98fc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f9912d9d700 1 -- 172.21.15.72:0/4019981454 reap_dead start 2023-10-14T12:34:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f991259c700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc003a00 0x7f98fc003e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f99040017c0 tx=0x7f98fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2380e9fb3b3a332 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:20.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040052d0 con 0x7f98fc003a00 2023-10-14T12:34:20.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904005430 con 0x7f98fc003a00 2023-10-14T12:34:20.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f991159a700 1 -- 172.21.15.72:0/4019981454 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040038c0 con 0x7f98fc003a00 2023-10-14T12:34:20.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f9918ffa700 1 -- 172.21.15.72:0/4019981454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc003a00 msgr2=0x7f98fc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.746+0000 7f9918ffa700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc003a00 0x7f98fc003e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f99040017c0 tx=0x7f98fc005880 comp rx=0 tx=0).stop 2023-10-14T12:34:20.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.747+0000 7f9918ffa700 1 -- 172.21.15.72:0/4019981454 shutdown_connections 2023-10-14T12:34:20.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.747+0000 7f9918ffa700 1 --2- 172.21.15.72:0/4019981454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98fc003a00 0x7f98fc003e20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.747+0000 7f9918ffa700 1 -- 172.21.15.72:0/4019981454 >> 172.21.15.72:0/4019981454 conn(0x7f99140b13e0 msgr2=0x7f99140b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:20.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.747+0000 7f9918ffa700 1 -- 172.21.15.72:0/4019981454 shutdown_connections 2023-10-14T12:34:20.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.747+0000 7f9918ffa700 1 -- 172.21.15.72:0/4019981454 wait complete. 2023-10-14T12:34:20.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.748+0000 7f9918ffa700 1 Processor -- start 2023-10-14T12:34:20.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.748+0000 7f9918ffa700 1 -- start start 2023-10-14T12:34:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9918ffa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc003a00 0x7f99140c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9918ffa700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9914151ff0 0x7f9914151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9918ffa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99140c3c80 0x7f99140cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9918ffa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991415ab30 con 0x7f99140c3c80 2023-10-14T12:34:20.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9918ffa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991415b3d0 con 0x7f98fc003a00 2023-10-14T12:34:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9918ffa700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99140c8af0 con 0x7f9914151ff0 2023-10-14T12:34:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9912d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99140c3c80 0x7f99140cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9912d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99140c3c80 0x7f99140cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47840/0 (socket says 172.21.15.72:47840) 2023-10-14T12:34:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9912d9d700 1 -- 172.21.15.72:0/3603569882 learned_addr learned my addr 172.21.15.72:0/3603569882 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9911d9b700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9914151ff0 0x7f9914151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f991259c700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc003a00 0x7f99140c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9912d9d700 1 -- 172.21.15.72:0/3603569882 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9914151ff0 msgr2=0x7f9914151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9912d9d700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9914151ff0 0x7f9914151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9912d9d700 1 -- 172.21.15.72:0/3603569882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc003a00 msgr2=0x7f99140c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9912d9d700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc003a00 0x7f99140c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9912d9d700 1 -- 172.21.15.72:0/3603569882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99140c45d0 con 0x7f99140c3c80 2023-10-14T12:34:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9912d9d700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99140c3c80 0x7f99140cac50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f99140ca110 tx=0x7f990c007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9902ffd700 1 -- 172.21.15.72:0/3603569882 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00f040 con 0x7f99140c3c80 2023-10-14T12:34:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9902ffd700 1 -- 172.21.15.72:0/3603569882 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c003a20 con 0x7f99140c3c80 2023-10-14T12:34:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9902ffd700 1 -- 172.21.15.72:0/3603569882 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c003db0 con 0x7f99140c3c80 2023-10-14T12:34:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991415ad80 con 0x7f99140c3c80 2023-10-14T12:34:20.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.749+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99140c4100 con 0x7f99140c3c80 2023-10-14T12:34:20.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.750+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99140c4320 con 0x7f99140c3c80 2023-10-14T12:34:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.751+0000 7f9902ffd700 1 -- 172.21.15.72:0/3603569882 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f990c0106b0 con 0x7f99140c3c80 2023-10-14T12:34:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.751+0000 7f9902ffd700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98f406af30 0x7f98f406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.751+0000 7f9902ffd700 1 -- 172.21.15.72:0/3603569882 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f990c089690 con 0x7f99140c3c80 2023-10-14T12:34:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.751+0000 7f991259c700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98f406af30 0x7f98f406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.752+0000 7f991259c700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98f406af30 0x7f98f406d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9904000c00 tx=0x7f9904009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.756+0000 7f9902ffd700 1 -- 172.21.15.72:0/3603569882 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f990c054410 con 0x7f99140c3c80 2023-10-14T12:34:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.946+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f991404ebb0 con 0x7f99140c3c80 2023-10-14T12:34:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.946+0000 7f9902ffd700 1 -- 172.21.15.72:0/3603569882 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f990c00a3a0 con 0x7f99140c3c80 2023-10-14T12:34:20.948 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:20.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98f406af30 msgr2=0x7f98f406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98f406af30 0x7f98f406d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9904000c00 tx=0x7f9904009030 comp rx=0 tx=0).stop 2023-10-14T12:34:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99140c3c80 msgr2=0x7f99140cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99140c3c80 0x7f99140cac50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f99140ca110 tx=0x7f990c007e70 comp rx=0 tx=0).stop 2023-10-14T12:34:20.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 shutdown_connections 2023-10-14T12:34:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f98f406af30 0x7f98f406d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99140c3c80 0x7f99140cac50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98fc003a00 0x7f99140c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 --2- 172.21.15.72:0/3603569882 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9914151ff0 0x7f9914151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:20.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 >> 172.21.15.72:0/3603569882 conn(0x7f99140b13e0 msgr2=0x7f99140aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 shutdown_connections 2023-10-14T12:34:20.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:20.948+0000 7f9918ffa700 1 -- 172.21.15.72:0/3603569882 wait complete. 2023-10-14T12:34:20.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:34:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.086+0000 7f7b0086c700 1 Processor -- start 2023-10-14T12:34:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.086+0000 7f7b0086c700 1 -- start start 2023-10-14T12:34:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.086+0000 7f7b0086c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7afc071850 0x7f7afc071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.086+0000 7f7b0086c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7afc0721f0 con 0x7f7afc06d100 2023-10-14T12:34:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.086+0000 7f7b0086c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7afc15ed10 con 0x7f7afc15daa0 2023-10-14T12:34:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.086+0000 7f7b0086c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7afc15de80 con 0x7f7afc071850 2023-10-14T12:34:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7afc071850 0x7f7afc071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7afc071850 0x7f7afc071cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47846/0 (socket says 172.21.15.72:47846) 2023-10-14T12:34:21.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af9d9b700 1 -- 172.21.15.72:0/2125249275 learned_addr learned my addr 172.21.15.72:0/2125249275 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7afad9d700 1 --1- 172.21.15.72:0/2125249275 >> v1:172.21.15.72:6789/0 conn(0x7f7afc06d100 0x7f7afc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54148/0 (socket says 172.21.15.72:54148) 2023-10-14T12:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af9d9b700 1 -- 172.21.15.72:0/2125249275 >> v1:172.21.15.123:6789/0 conn(0x7f7afc15daa0 legacy=0x7f7afc0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af9d9b700 1 -- 172.21.15.72:0/2125249275 >> v1:172.21.15.72:6789/0 conn(0x7f7afc06d100 legacy=0x7f7afc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af9d9b700 1 -- 172.21.15.72:0/2125249275 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc15e100 con 0x7f7afc071850 2023-10-14T12:34:21.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af959a700 1 -- 172.21.15.72:0/2125249275 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403561134 0 0) 0x7f7afc0721f0 con 0x7f7afc06d100 2023-10-14T12:34:21.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af9d9b700 1 --2- 172.21.15.72:0/2125249275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc071850 0x7f7afc071cb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7af000bb90 tx=0x7f7af000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9291b098ed251b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:21.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af959a700 1 -- 172.21.15.72:0/2125249275 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af000dd50 con 0x7f7afc071850 2023-10-14T12:34:21.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af959a700 1 -- 172.21.15.72:0/2125249275 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af0010470 con 0x7f7afc071850 2023-10-14T12:34:21.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.087+0000 7f7af959a700 1 -- 172.21.15.72:0/2125249275 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0010800 con 0x7f7afc071850 2023-10-14T12:34:21.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.088+0000 7f7b0086c700 1 -- 172.21.15.72:0/2125249275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc071850 msgr2=0x7f7afc071cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.088+0000 7f7b0086c700 1 --2- 172.21.15.72:0/2125249275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc071850 0x7f7afc071cb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7af000bb90 tx=0x7f7af000bea0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.088+0000 7f7b0086c700 1 -- 172.21.15.72:0/2125249275 shutdown_connections 2023-10-14T12:34:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.088+0000 7f7b0086c700 1 --2- 172.21.15.72:0/2125249275 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc071850 0x7f7afc071cb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.088+0000 7f7b0086c700 1 -- 172.21.15.72:0/2125249275 >> 172.21.15.72:0/2125249275 conn(0x7f7afc0d0180 msgr2=0x7f7afc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:21.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.088+0000 7f7b0086c700 1 -- 172.21.15.72:0/2125249275 shutdown_connections 2023-10-14T12:34:21.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.088+0000 7f7b0086c700 1 -- 172.21.15.72:0/2125249275 wait complete. 2023-10-14T12:34:21.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.089+0000 7f7b0086c700 1 Processor -- start 2023-10-14T12:34:21.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.089+0000 7f7b0086c700 1 -- start start 2023-10-14T12:34:21.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7b0086c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc06d100 0x7f7afc0b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7b0086c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7afc071850 0x7f7afc0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7b0086c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7afc15daa0 0x7f7afc0c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7b0086c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0b18c0 con 0x7f7afc06d100 2023-10-14T12:34:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7b0086c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0c4a00 con 0x7f7afc071850 2023-10-14T12:34:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7b0086c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7afc0b08a0 con 0x7f7afc15daa0 2023-10-14T12:34:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc06d100 0x7f7afc0b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc06d100 0x7f7afc0b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47850/0 (socket says 172.21.15.72:47850) 2023-10-14T12:34:21.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afa59c700 1 -- 172.21.15.72:0/1867188140 learned_addr learned my addr 172.21.15.72:0/1867188140 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7af9d9b700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7afc071850 0x7f7afc0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afad9d700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7afc15daa0 0x7f7afc0c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afa59c700 1 -- 172.21.15.72:0/1867188140 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7afc15daa0 msgr2=0x7f7afc0c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afa59c700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7afc15daa0 0x7f7afc0c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afa59c700 1 -- 172.21.15.72:0/1867188140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7afc071850 msgr2=0x7f7afc0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afa59c700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7afc071850 0x7f7afc0c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afa59c700 1 -- 172.21.15.72:0/1867188140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af000b7f0 con 0x7f7afc06d100 2023-10-14T12:34:21.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.090+0000 7f7afad9d700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7afc15daa0 0x7f7afc0c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:21.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.091+0000 7f7afa59c700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc06d100 0x7f7afc0b1380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00c4d0 tx=0x7f7aec00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:21.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.091+0000 7f7aeaffd700 1 -- 172.21.15.72:0/1867188140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec0052d0 con 0x7f7afc06d100 2023-10-14T12:34:21.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.091+0000 7f7aeaffd700 1 -- 172.21.15.72:0/1867188140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aec005430 con 0x7f7afc06d100 2023-10-14T12:34:21.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.091+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7afc0b0b80 con 0x7f7afc06d100 2023-10-14T12:34:21.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.091+0000 7f7aeaffd700 1 -- 172.21.15.72:0/1867188140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec003880 con 0x7f7afc06d100 2023-10-14T12:34:21.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.091+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7afc0ca010 con 0x7f7afc06d100 2023-10-14T12:34:21.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.092+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7afc06eb50 con 0x7f7afc06d100 2023-10-14T12:34:21.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.092+0000 7f7aeaffd700 1 -- 172.21.15.72:0/1867188140 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7aec0039e0 con 0x7f7afc06d100 2023-10-14T12:34:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.092+0000 7f7aeaffd700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7adc06af00 0x7f7adc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.092+0000 7f7aeaffd700 1 -- 172.21.15.72:0/1867188140 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7aec088c80 con 0x7f7afc06d100 2023-10-14T12:34:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.092+0000 7f7af9d9b700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7adc06af00 0x7f7adc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.093+0000 7f7af9d9b700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7adc06af00 0x7f7adc06d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7af000bee0 tx=0x7f7af0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:21.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.098+0000 7f7aeaffd700 1 -- 172.21.15.72:0/1867188140 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7aec053a20 con 0x7f7afc06d100 2023-10-14T12:34:21.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.303+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7afc04ebb0 con 0x7f7afc06d100 2023-10-14T12:34:21.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.304+0000 7f7aeaffd700 1 -- 172.21.15.72:0/1867188140 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7aec017080 con 0x7f7afc06d100 2023-10-14T12:34:21.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.305+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7adc06af00 msgr2=0x7f7adc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.305+0000 7f7b0086c700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7adc06af00 0x7f7adc06d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7af000bee0 tx=0x7f7af0008040 comp rx=0 tx=0).stop 2023-10-14T12:34:21.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.305+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc06d100 msgr2=0x7f7afc0b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.305+0000 7f7b0086c700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc06d100 0x7f7afc0b1380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7aec00c4d0 tx=0x7f7aec00c7e0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.306+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 shutdown_connections 2023-10-14T12:34:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.306+0000 7f7b0086c700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7adc06af00 0x7f7adc06d3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.306+0000 7f7b0086c700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7afc15daa0 0x7f7afc0c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.306+0000 7f7b0086c700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7afc06d100 0x7f7afc0b1380 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.306+0000 7f7b0086c700 1 --2- 172.21.15.72:0/1867188140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7afc071850 0x7f7afc0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.306+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 >> 172.21.15.72:0/1867188140 conn(0x7f7afc0d0180 msgr2=0x7f7afc0cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.306+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 shutdown_connections 2023-10-14T12:34:21.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.306+0000 7f7b0086c700 1 -- 172.21.15.72:0/1867188140 wait complete. 2023-10-14T12:34:21.310 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-10-14T12:34:21.319 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T12:34:21.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:21.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-14T12:34:21.360 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:34:21.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:21.361 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T12:34:21.417 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:21.417 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:21.440 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:21.441 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:21.501 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:21.502 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:21.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.682+0000 7efd81e98700 1 Processor -- start 2023-10-14T12:34:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.682+0000 7efd81e98700 1 -- start start 2023-10-14T12:34:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.683+0000 7efd81e98700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd7c0cf7d0 0x7efd7c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.683+0000 7efd81e98700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd7c0ca7d0 0x7efd7c071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.683+0000 7efd81e98700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c0cfeb0 con 0x7efd7c06a820 2023-10-14T12:34:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.683+0000 7efd81e98700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c0ce410 con 0x7efd7c0ca7d0 2023-10-14T12:34:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.683+0000 7efd81e98700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c0cfc30 con 0x7efd7c0cf7d0 2023-10-14T12:34:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.683+0000 7efd7bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd7c0ca7d0 0x7efd7c071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.683+0000 7efd7bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd7c0ca7d0 0x7efd7c071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47862/0 (socket says 172.21.15.72:47862) 2023-10-14T12:34:21.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.683+0000 7efd7bfff700 1 -- 172.21.15.72:0/1874602324 learned_addr learned my addr 172.21.15.72:0/1874602324 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.683+0000 7efd7b7fe700 1 --1- 172.21.15.72:0/1874602324 >> v1:172.21.15.72:6789/0 conn(0x7efd7c06a820 0x7efd7c06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54158/0 (socket says 172.21.15.72:54158) 2023-10-14T12:34:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7affd700 1 --2- 172.21.15.72:0/1874602324 >> v2:172.21.15.123:3300/0 conn(0x7efd7c0cf7d0 0x7efd7c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7bfff700 1 -- 172.21.15.72:0/1874602324 >> v2:172.21.15.123:3300/0 conn(0x7efd7c0cf7d0 msgr2=0x7efd7c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7bfff700 1 --2- 172.21.15.72:0/1874602324 >> v2:172.21.15.123:3300/0 conn(0x7efd7c0cf7d0 0x7efd7c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7bfff700 1 -- 172.21.15.72:0/1874602324 >> v1:172.21.15.72:6789/0 conn(0x7efd7c06a820 legacy=0x7efd7c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7a7fc700 1 -- 172.21.15.72:0/1874602324 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787968758 0 0) 0x7efd7c0cfeb0 con 0x7efd7c06a820 2023-10-14T12:34:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7bfff700 1 -- 172.21.15.72:0/1874602324 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0af9d0 con 0x7efd7c0ca7d0 2023-10-14T12:34:21.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7bfff700 1 --2- 172.21.15.72:0/1874602324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c0ca7d0 0x7efd7c071ea0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efd7c06c8a0 tx=0x7efd7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13ad949783680cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7a7fc700 1 -- 172.21.15.72:0/1874602324 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400e070 con 0x7efd7c0ca7d0 2023-10-14T12:34:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7a7fc700 1 -- 172.21.15.72:0/1874602324 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7400b9c0 con 0x7efd7c0ca7d0 2023-10-14T12:34:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.684+0000 7efd7a7fc700 1 -- 172.21.15.72:0/1874602324 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400bd70 con 0x7efd7c0ca7d0 2023-10-14T12:34:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.685+0000 7efd81e98700 1 -- 172.21.15.72:0/1874602324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c0ca7d0 msgr2=0x7efd7c071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.685+0000 7efd81e98700 1 --2- 172.21.15.72:0/1874602324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c0ca7d0 0x7efd7c071ea0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efd7c06c8a0 tx=0x7efd7400b330 comp rx=0 tx=0).stop 2023-10-14T12:34:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.685+0000 7efd81e98700 1 -- 172.21.15.72:0/1874602324 shutdown_connections 2023-10-14T12:34:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.685+0000 7efd81e98700 1 --2- 172.21.15.72:0/1874602324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c0ca7d0 0x7efd7c071ea0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.685+0000 7efd81e98700 1 --2- 172.21.15.72:0/1874602324 >> v2:172.21.15.123:3300/0 conn(0x7efd7c0cf7d0 0x7efd7c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.685+0000 7efd81e98700 1 -- 172.21.15.72:0/1874602324 >> 172.21.15.72:0/1874602324 conn(0x7efd7c0d0180 msgr2=0x7efd7c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.685+0000 7efd81e98700 1 -- 172.21.15.72:0/1874602324 shutdown_connections 2023-10-14T12:34:21.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.685+0000 7efd81e98700 1 -- 172.21.15.72:0/1874602324 wait complete. 2023-10-14T12:34:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.686+0000 7efd81e98700 1 Processor -- start 2023-10-14T12:34:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.686+0000 7efd81e98700 1 -- start start 2023-10-14T12:34:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd81e98700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c06a820 0x7efd7c1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd81e98700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd7c0ca7d0 0x7efd7c0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd81e98700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd7c0cf7d0 0x7efd7c0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd81e98700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0c30e0 con 0x7efd7c06a820 2023-10-14T12:34:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd81e98700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c15eed0 con 0x7efd7c0cf7d0 2023-10-14T12:34:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd81e98700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c15f490 con 0x7efd7c0ca7d0 2023-10-14T12:34:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c06a820 0x7efd7c1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c06a820 0x7efd7c1577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47864/0 (socket says 172.21.15.72:47864) 2023-10-14T12:34:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7b7fe700 1 -- 172.21.15.72:0/1507360715 learned_addr learned my addr 172.21.15.72:0/1507360715 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7bfff700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd7c0cf7d0 0x7efd7c0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7affd700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd7c0ca7d0 0x7efd7c0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7b7fe700 1 -- 172.21.15.72:0/1507360715 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd7c0ca7d0 msgr2=0x7efd7c0ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7b7fe700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd7c0ca7d0 0x7efd7c0ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7b7fe700 1 -- 172.21.15.72:0/1507360715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd7c0cf7d0 msgr2=0x7efd7c0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7b7fe700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd7c0cf7d0 0x7efd7c0ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7b7fe700 1 -- 172.21.15.72:0/1507360715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74009b30 con 0x7efd7c06a820 2023-10-14T12:34:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7bfff700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd7c0cf7d0 0x7efd7c0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd7b7fe700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c06a820 0x7efd7c1577b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c750 tx=0x7efd6400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd73fff700 1 -- 172.21.15.72:0/1507360715 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64004c80 con 0x7efd7c06a820 2023-10-14T12:34:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd73fff700 1 -- 172.21.15.72:0/1507360715 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64004e00 con 0x7efd7c06a820 2023-10-14T12:34:21.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.687+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c0c68f0 con 0x7efd7c06a820 2023-10-14T12:34:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.688+0000 7efd73fff700 1 -- 172.21.15.72:0/1507360715 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64007310 con 0x7efd7c06a820 2023-10-14T12:34:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.688+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c0c2d00 con 0x7efd7c06a820 2023-10-14T12:34:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.688+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c0c6b30 con 0x7efd7c06a820 2023-10-14T12:34:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.689+0000 7efd73fff700 1 -- 172.21.15.72:0/1507360715 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efd64007470 con 0x7efd7c06a820 2023-10-14T12:34:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.689+0000 7efd73fff700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7efd5c06af00 0x7efd5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.689+0000 7efd73fff700 1 -- 172.21.15.72:0/1507360715 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efd64089790 con 0x7efd7c06a820 2023-10-14T12:34:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.689+0000 7efd7affd700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7efd5c06af00 0x7efd5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.690+0000 7efd7affd700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7efd5c06af00 0x7efd5c06d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd7c1fa680 tx=0x7efd6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.694+0000 7efd73fff700 1 -- 172.21.15.72:0/1507360715 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efd64054480 con 0x7efd7c06a820 2023-10-14T12:34:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.886+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd7c04ebb0 con 0x7efd7c06a820 2023-10-14T12:34:21.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.888+0000 7efd73fff700 1 -- 172.21.15.72:0/1507360715 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18678 (secure 0 0 0) 0x7efd64057aa0 con 0x7efd7c06a820 2023-10-14T12:34:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:21.890 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:20.981579+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.889+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7efd5c06af00 msgr2=0x7efd5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.889+0000 7efd81e98700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7efd5c06af00 0x7efd5c06d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd7c1fa680 tx=0x7efd6c008040 comp rx=0 tx=0).stop 2023-10-14T12:34:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.889+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c06a820 msgr2=0x7efd7c1577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.889+0000 7efd81e98700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c06a820 0x7efd7c1577b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c750 tx=0x7efd6400cb10 comp rx=0 tx=0).stop 2023-10-14T12:34:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.890+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 shutdown_connections 2023-10-14T12:34:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.890+0000 7efd81e98700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7efd5c06af00 0x7efd5c06d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.890+0000 7efd81e98700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd7c0cf7d0 0x7efd7c0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.890+0000 7efd81e98700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd7c06a820 0x7efd7c1577b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.890+0000 7efd81e98700 1 --2- 172.21.15.72:0/1507360715 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7efd7c0ca7d0 0x7efd7c0ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:21.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.890+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 >> 172.21.15.72:0/1507360715 conn(0x7efd7c0d0180 msgr2=0x7efd7c0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:21.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.890+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 shutdown_connections 2023-10-14T12:34:21.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:21.890+0000 7efd81e98700 1 -- 172.21.15.72:0/1507360715 wait complete. 2023-10-14T12:34:21.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:21.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.028+0000 7f92996e2700 1 Processor -- start 2023-10-14T12:34:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.028+0000 7f92996e2700 1 -- start start 2023-10-14T12:34:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f92940ce0a0 0x7f92940cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92940cf420 con 0x7f929406b7e0 2023-10-14T12:34:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92940b95a0 con 0x7f92940ce0a0 2023-10-14T12:34:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92940cfdf0 con 0x7f929415d760 2023-10-14T12:34:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92937fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f929406b7e0 0x7f92940b65c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54176/0 (socket says 172.21.15.72:54176) 2023-10-14T12:34:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92937fe700 1 -- 172.21.15.72:0/1664249930 learned_addr learned my addr 172.21.15.72:0/1664249930 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92927fc700 1 --2- 172.21.15.72:0/1664249930 >> v2:172.21.15.123:3300/0 conn(0x7f92940ce0a0 0x7f92940cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9292ffd700 1 --2- 172.21.15.72:0/1664249930 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9291ffb700 1 -- 172.21.15.72:0/1664249930 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407073579 0 0) 0x7f92940cf420 con 0x7f929406b7e0 2023-10-14T12:34:22.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9291ffb700 1 -- 172.21.15.72:0/1664249930 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f927c0035b0 con 0x7f929406b7e0 2023-10-14T12:34:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9292ffd700 1 -- 172.21.15.72:0/1664249930 >> v2:172.21.15.123:3300/0 conn(0x7f92940ce0a0 msgr2=0x7f92940cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9292ffd700 1 --2- 172.21.15.72:0/1664249930 >> v2:172.21.15.123:3300/0 conn(0x7f92940ce0a0 0x7f92940cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9292ffd700 1 -- 172.21.15.72:0/1664249930 >> v1:172.21.15.72:6789/0 conn(0x7f929406b7e0 legacy=0x7f92940b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9292ffd700 1 -- 172.21.15.72:0/1664249930 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92940ce810 con 0x7f929415d760 2023-10-14T12:34:22.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92927fc700 1 --2- 172.21.15.72:0/1664249930 >> v2:172.21.15.123:3300/0 conn(0x7f92940ce0a0 0x7f92940cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9292ffd700 1 --2- 172.21.15.72:0/1664249930 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940b9060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9288009840 tx=0x7f9288009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=739ec20f2933842d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9291ffb700 1 -- 172.21.15.72:0/1664249930 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288011830 con 0x7f929415d760 2023-10-14T12:34:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9291ffb700 1 -- 172.21.15.72:0/1664249930 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9288011990 con 0x7f929415d760 2023-10-14T12:34:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f9291ffb700 1 -- 172.21.15.72:0/1664249930 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288011d20 con 0x7f929415d760 2023-10-14T12:34:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 -- 172.21.15.72:0/1664249930 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 msgr2=0x7f92940b9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 --2- 172.21.15.72:0/1664249930 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940b9060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9288009840 tx=0x7f9288009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 -- 172.21.15.72:0/1664249930 shutdown_connections 2023-10-14T12:34:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 --2- 172.21.15.72:0/1664249930 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940b9060 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 --2- 172.21.15.72:0/1664249930 >> v2:172.21.15.123:3300/0 conn(0x7f92940ce0a0 0x7f92940cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 -- 172.21.15.72:0/1664249930 >> 172.21.15.72:0/1664249930 conn(0x7f9294072340 msgr2=0x7f9294072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 -- 172.21.15.72:0/1664249930 shutdown_connections 2023-10-14T12:34:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.029+0000 7f92996e2700 1 -- 172.21.15.72:0/1664249930 wait complete. 2023-10-14T12:34:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.031+0000 7f92996e2700 1 Processor -- start 2023-10-14T12:34:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.031+0000 7f92996e2700 1 -- start start 2023-10-14T12:34:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.031+0000 7f92996e2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f929406b7e0 0x7f9294159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.031+0000 7f92996e2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92940ce0a0 0x7f92940c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.031+0000 7f92996e2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.031+0000 7f92996e2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92941f5f70 con 0x7f92940ce0a0 2023-10-14T12:34:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.031+0000 7f92996e2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92941f6250 con 0x7f929406b7e0 2023-10-14T12:34:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.031+0000 7f92996e2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92941f6530 con 0x7f929415d760 2023-10-14T12:34:22.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92927fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92940ce0a0 0x7f92940c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92927fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92940ce0a0 0x7f92940c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47878/0 (socket says 172.21.15.72:47878) 2023-10-14T12:34:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92927fc700 1 -- 172.21.15.72:0/2178962051 learned_addr learned my addr 172.21.15.72:0/2178962051 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f9292ffd700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f929406b7e0 0x7f9294159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92927fc700 1 -- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 msgr2=0x7f92940c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92937fe700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92927fc700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92927fc700 1 -- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f929406b7e0 msgr2=0x7f9294159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92927fc700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f929406b7e0 0x7f9294159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92927fc700 1 -- 172.21.15.72:0/2178962051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840094a0 con 0x7f92940ce0a0 2023-10-14T12:34:22.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f9292ffd700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f929406b7e0 0x7f9294159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92937fe700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92927fc700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92940ce0a0 0x7f92940c7400 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f928400ebe0 tx=0x7f9284009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f927b7fe700 1 -- 172.21.15.72:0/2178962051 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400c910 con 0x7f92940ce0a0 2023-10-14T12:34:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f927b7fe700 1 -- 172.21.15.72:0/2178962051 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928400ca70 con 0x7f92940ce0a0 2023-10-14T12:34:22.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92880094a0 con 0x7f92940ce0a0 2023-10-14T12:34:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f927b7fe700 1 -- 172.21.15.72:0/2178962051 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400cde0 con 0x7f92940ce0a0 2023-10-14T12:34:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.032+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92941f6af0 con 0x7f92940ce0a0 2023-10-14T12:34:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.033+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929415e140 con 0x7f92940ce0a0 2023-10-14T12:34:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.034+0000 7f927b7fe700 1 -- 172.21.15.72:0/2178962051 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9284013470 con 0x7f92940ce0a0 2023-10-14T12:34:22.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.034+0000 7f927b7fe700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f928006af00 0x7f928006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.034+0000 7f9292ffd700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f928006af00 0x7f928006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.034+0000 7f927b7fe700 1 -- 172.21.15.72:0/2178962051 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9284089be0 con 0x7f92940ce0a0 2023-10-14T12:34:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.035+0000 7f9292ffd700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f928006af00 0x7f928006d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f92941f5ed0 tx=0x7f9288008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:22.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.039+0000 7f927b7fe700 1 -- 172.21.15.72:0/2178962051 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92840548d0 con 0x7f92940ce0a0 2023-10-14T12:34:22.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.225+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f929404ebb0 con 0x7f92940ce0a0 2023-10-14T12:34:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.225+0000 7f927b7fe700 1 -- 172.21.15.72:0/2178962051 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92840170a0 con 0x7f92940ce0a0 2023-10-14T12:34:22.227 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f928006af00 msgr2=0x7f928006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f928006af00 0x7f928006d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f92941f5ed0 tx=0x7f9288008030 comp rx=0 tx=0).stop 2023-10-14T12:34:22.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92940ce0a0 msgr2=0x7f92940c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92940ce0a0 0x7f92940c7400 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f928400ebe0 tx=0x7f9284009ec0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 shutdown_connections 2023-10-14T12:34:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f928006af00 0x7f928006d3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f929415d760 0x7f92940c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f929406b7e0 0x7f9294159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 --2- 172.21.15.72:0/2178962051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92940ce0a0 0x7f92940c7400 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 >> 172.21.15.72:0/2178962051 conn(0x7f9294072340 msgr2=0x7f929415cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 shutdown_connections 2023-10-14T12:34:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.228+0000 7f92996e2700 1 -- 172.21.15.72:0/2178962051 wait complete. 2023-10-14T12:34:22.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:22.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.363+0000 7f470729d700 1 Processor -- start 2023-10-14T12:34:22.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.364+0000 7f470729d700 1 -- start start 2023-10-14T12:34:22.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.364+0000 7f470729d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f470015b4e0 0x7f470006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.364+0000 7f470729d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000cd770 0x7f47000b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.364+0000 7f470729d700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4700070620 con 0x7f47000b3220 2023-10-14T12:34:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.364+0000 7f470729d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47000b36b0 con 0x7f470015b4e0 2023-10-14T12:34:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.364+0000 7f470729d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4700070900 con 0x7f47000cd770 2023-10-14T12:34:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4705039700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f470015b4e0 0x7f470006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4705039700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f470015b4e0 0x7f470006f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47886/0 (socket says 172.21.15.72:47886) 2023-10-14T12:34:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4705039700 1 -- 172.21.15.72:0/2591893245 learned_addr learned my addr 172.21.15.72:0/2591893245 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4705039700 1 -- 172.21.15.72:0/2591893245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000cd770 msgr2=0x7f47000b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:22.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4704838700 1 --2- 172.21.15.72:0/2591893245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000cd770 0x7f47000b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4705039700 1 --2- 172.21.15.72:0/2591893245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000cd770 0x7f47000b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4705039700 1 -- 172.21.15.72:0/2591893245 >> v1:172.21.15.123:6789/0 conn(0x7f47000b3220 legacy=0x7f47000cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:22.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4705039700 1 -- 172.21.15.72:0/2591893245 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700070be0 con 0x7f470015b4e0 2023-10-14T12:34:22.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4704838700 1 --2- 172.21.15.72:0/2591893245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000cd770 0x7f47000b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:22.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f4705039700 1 --2- 172.21.15.72:0/2591893245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f470015b4e0 0x7f470006f280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f46f00098f0 tx=0x7f46f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9265ade359620ff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:22.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f46f7fff700 1 -- 172.21.15.72:0/2591893245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0004230 con 0x7f470015b4e0 2023-10-14T12:34:22.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f46f7fff700 1 -- 172.21.15.72:0/2591893245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f0004390 con 0x7f470015b4e0 2023-10-14T12:34:22.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.365+0000 7f46f7fff700 1 -- 172.21.15.72:0/2591893245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f00036a0 con 0x7f470015b4e0 2023-10-14T12:34:22.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.366+0000 7f470729d700 1 -- 172.21.15.72:0/2591893245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f470015b4e0 msgr2=0x7f470006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.366+0000 7f470729d700 1 --2- 172.21.15.72:0/2591893245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f470015b4e0 0x7f470006f280 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f46f00098f0 tx=0x7f46f0009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.366+0000 7f470729d700 1 -- 172.21.15.72:0/2591893245 shutdown_connections 2023-10-14T12:34:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.366+0000 7f470729d700 1 --2- 172.21.15.72:0/2591893245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f470015b4e0 0x7f470006f280 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.366+0000 7f470729d700 1 --2- 172.21.15.72:0/2591893245 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000cd770 0x7f47000b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.366+0000 7f470729d700 1 -- 172.21.15.72:0/2591893245 >> 172.21.15.72:0/2591893245 conn(0x7f47000cdce0 msgr2=0x7f47000ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.366+0000 7f470729d700 1 -- 172.21.15.72:0/2591893245 shutdown_connections 2023-10-14T12:34:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.366+0000 7f470729d700 1 -- 172.21.15.72:0/2591893245 wait complete. 2023-10-14T12:34:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.367+0000 7f470729d700 1 Processor -- start 2023-10-14T12:34:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.367+0000 7f470729d700 1 -- start start 2023-10-14T12:34:22.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f470729d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000b3220 0x7f4700147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f470729d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47000cd770 0x7f47001e1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f470729d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470015b4e0 0x7f47000ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f470729d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47001e3360 con 0x7f47000cd770 2023-10-14T12:34:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f470729d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4700152140 con 0x7f470015b4e0 2023-10-14T12:34:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f470729d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4700147ba0 con 0x7f47000b3220 2023-10-14T12:34:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4704838700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47000cd770 0x7f47001e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4704838700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47000cd770 0x7f47001e1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47894/0 (socket says 172.21.15.72:47894) 2023-10-14T12:34:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4704838700 1 -- 172.21.15.72:0/3137331678 learned_addr learned my addr 172.21.15.72:0/3137331678 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:22.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4705039700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000b3220 0x7f4700147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f470583a700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470015b4e0 0x7f47000ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4704838700 1 -- 172.21.15.72:0/3137331678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000b3220 msgr2=0x7f4700147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4704838700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000b3220 0x7f4700147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4704838700 1 -- 172.21.15.72:0/3137331678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470015b4e0 msgr2=0x7f47000ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4704838700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470015b4e0 0x7f47000ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4704838700 1 -- 172.21.15.72:0/3137331678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0009550 con 0x7f47000cd770 2023-10-14T12:34:22.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f4704838700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47000cd770 0x7f47001e1060 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c7f0 tx=0x7f46fc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:22.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.368+0000 7f46f5ffb700 1 -- 172.21.15.72:0/3137331678 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc011800 con 0x7f47000cd770 2023-10-14T12:34:22.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.369+0000 7f46f5ffb700 1 -- 172.21.15.72:0/3137331678 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc011960 con 0x7f47000cd770 2023-10-14T12:34:22.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.369+0000 7f46f5ffb700 1 -- 172.21.15.72:0/3137331678 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc011cf0 con 0x7f47000cd770 2023-10-14T12:34:22.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.369+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47001e1a00 con 0x7f47000cd770 2023-10-14T12:34:22.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.369+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47001e1fc0 con 0x7f47000cd770 2023-10-14T12:34:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.370+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4700067230 con 0x7f47000cd770 2023-10-14T12:34:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.370+0000 7f46f5ffb700 1 -- 172.21.15.72:0/3137331678 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f46fc018360 con 0x7f47000cd770 2023-10-14T12:34:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.370+0000 7f46f5ffb700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f46e406af00 0x7f46e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.370+0000 7f46f5ffb700 1 -- 172.21.15.72:0/3137331678 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46fc0897e0 con 0x7f47000cd770 2023-10-14T12:34:22.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.371+0000 7f4705039700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f46e406af00 0x7f46e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.371+0000 7f4705039700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f46e406af00 0x7f46e406d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009130 tx=0x7f46f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:22.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.375+0000 7f46f5ffb700 1 -- 172.21.15.72:0/3137331678 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46fc0544d0 con 0x7f47000cd770 2023-10-14T12:34:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.562+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f470004ebb0 con 0x7f47000cd770 2023-10-14T12:34:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.563+0000 7f46f5ffb700 1 -- 172.21.15.72:0/3137331678 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46fc057af0 con 0x7f47000cd770 2023-10-14T12:34:22.563 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:22.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f46e406af00 msgr2=0x7f46e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f46e406af00 0x7f46e406d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009130 tx=0x7f46f0008030 comp rx=0 tx=0).stop 2023-10-14T12:34:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47000cd770 msgr2=0x7f47001e1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47000cd770 0x7f47001e1060 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c7f0 tx=0x7f46fc00cb00 comp rx=0 tx=0).stop 2023-10-14T12:34:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 shutdown_connections 2023-10-14T12:34:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f46e406af00 0x7f46e406d3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470015b4e0 0x7f47000ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47000b3220 0x7f4700147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 --2- 172.21.15.72:0/3137331678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47000cd770 0x7f47001e1060 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 >> 172.21.15.72:0/3137331678 conn(0x7f47000cdce0 msgr2=0x7f47000c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 shutdown_connections 2023-10-14T12:34:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.565+0000 7f470729d700 1 -- 172.21.15.72:0/3137331678 wait complete. 2023-10-14T12:34:22.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:22.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.700+0000 7f02ff936700 1 Processor -- start 2023-10-14T12:34:22.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.700+0000 7f02ff936700 1 -- start start 2023-10-14T12:34:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02ff936700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02f80b33f0 0x7f02f806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02ff936700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f8070620 con 0x7f02f815b4e0 2023-10-14T12:34:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02ff936700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f8070900 con 0x7f02f80cd770 2023-10-14T12:34:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02ff936700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f8070be0 con 0x7f02f80b33f0 2023-10-14T12:34:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02fced1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02f80b33f0 0x7f02f806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02fd6d2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f02f815b4e0 0x7f02f80b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54200/0 (socket says 172.21.15.72:54200) 2023-10-14T12:34:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02fced1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02f80b33f0 0x7f02f806f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47902/0 (socket says 172.21.15.72:47902) 2023-10-14T12:34:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02fd6d2700 1 -- 172.21.15.72:0/4251658014 learned_addr learned my addr 172.21.15.72:0/4251658014 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02fced1700 1 -- 172.21.15.72:0/4251658014 >> v1:172.21.15.123:6789/0 conn(0x7f02f80cd770 legacy=0x7f02f80b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02effff700 1 -- 172.21.15.72:0/4251658014 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917167300 0 0) 0x7f02f8070620 con 0x7f02f815b4e0 2023-10-14T12:34:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02fced1700 1 -- 172.21.15.72:0/4251658014 >> v1:172.21.15.72:6789/0 conn(0x7f02f815b4e0 legacy=0x7f02f80b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02fced1700 1 -- 172.21.15.72:0/4251658014 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f8070ec0 con 0x7f02f80b33f0 2023-10-14T12:34:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02fced1700 1 --2- 172.21.15.72:0/4251658014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f80b33f0 0x7f02f806f280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009870 tx=0x7f02e8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56d5068c1c16e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02effff700 1 -- 172.21.15.72:0/4251658014 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8004230 con 0x7f02f80b33f0 2023-10-14T12:34:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02effff700 1 -- 172.21.15.72:0/4251658014 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e8004390 con 0x7f02f80b33f0 2023-10-14T12:34:22.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.701+0000 7f02effff700 1 -- 172.21.15.72:0/4251658014 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e80036a0 con 0x7f02f80b33f0 2023-10-14T12:34:22.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.702+0000 7f02ff936700 1 -- 172.21.15.72:0/4251658014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f80b33f0 msgr2=0x7f02f806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.702+0000 7f02ff936700 1 --2- 172.21.15.72:0/4251658014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f80b33f0 0x7f02f806f280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009870 tx=0x7f02e8009b80 comp rx=0 tx=0).stop 2023-10-14T12:34:22.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.702+0000 7f02ff936700 1 -- 172.21.15.72:0/4251658014 shutdown_connections 2023-10-14T12:34:22.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.702+0000 7f02ff936700 1 --2- 172.21.15.72:0/4251658014 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f80b33f0 0x7f02f806f280 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.702+0000 7f02ff936700 1 -- 172.21.15.72:0/4251658014 >> 172.21.15.72:0/4251658014 conn(0x7f02f80cdce0 msgr2=0x7f02f80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.702+0000 7f02ff936700 1 -- 172.21.15.72:0/4251658014 shutdown_connections 2023-10-14T12:34:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.702+0000 7f02ff936700 1 -- 172.21.15.72:0/4251658014 wait complete. 2023-10-14T12:34:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.703+0000 7f02ff936700 1 Processor -- start 2023-10-14T12:34:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.703+0000 7f02ff936700 1 -- start start 2023-10-14T12:34:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02ff936700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02f80b33f0 0x7f02f81f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02ff936700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02f80cd770 0x7f02f81e2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02ff936700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f815b4e0 0x7f02f81e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02ff936700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81e4400 con 0x7f02f815b4e0 2023-10-14T12:34:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02ff936700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81e6bf0 con 0x7f02f80cd770 2023-10-14T12:34:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02ff936700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81e6e90 con 0x7f02f80b33f0 2023-10-14T12:34:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02fded3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f815b4e0 0x7f02f81e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02fded3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f815b4e0 0x7f02f81e4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47910/0 (socket says 172.21.15.72:47910) 2023-10-14T12:34:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02fded3700 1 -- 172.21.15.72:0/1045228648 learned_addr learned my addr 172.21.15.72:0/1045228648 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02fced1700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02f80cd770 0x7f02f81e2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02fd6d2700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02f80b33f0 0x7f02f81f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.704+0000 7f02fded3700 1 -- 172.21.15.72:0/1045228648 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02f80b33f0 msgr2=0x7f02f81f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02fded3700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02f80b33f0 0x7f02f81f0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02fded3700 1 -- 172.21.15.72:0/1045228648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02f80cd770 msgr2=0x7f02f81e2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02fded3700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02f80cd770 0x7f02f81e2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02fded3700 1 -- 172.21.15.72:0/1045228648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80094a0 con 0x7f02f815b4e0 2023-10-14T12:34:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02fded3700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f815b4e0 0x7f02f81e4b40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f02f000cba0 tx=0x7f02f000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02edffb700 1 -- 172.21.15.72:0/1045228648 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f000aaa0 con 0x7f02f815b4e0 2023-10-14T12:34:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02edffb700 1 -- 172.21.15.72:0/1045228648 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f000ac00 con 0x7f02f815b4e0 2023-10-14T12:34:22.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f81e2790 con 0x7f02f815b4e0 2023-10-14T12:34:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02edffb700 1 -- 172.21.15.72:0/1045228648 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0012420 con 0x7f02f815b4e0 2023-10-14T12:34:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.705+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f81e7130 con 0x7f02f815b4e0 2023-10-14T12:34:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.706+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f80d1fd0 con 0x7f02f815b4e0 2023-10-14T12:34:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.706+0000 7f02edffb700 1 -- 172.21.15.72:0/1045228648 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f02f0012580 con 0x7f02f815b4e0 2023-10-14T12:34:22.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.707+0000 7f02edffb700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02dc06af00 0x7f02dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.707+0000 7f02fd6d2700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02dc06af00 0x7f02dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.707+0000 7f02edffb700 1 -- 172.21.15.72:0/1045228648 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f02f0089fa0 con 0x7f02f815b4e0 2023-10-14T12:34:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.707+0000 7f02fd6d2700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02dc06af00 0x7f02dc06d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f02f4000f60 tx=0x7f02f4007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:22.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.711+0000 7f02edffb700 1 -- 172.21.15.72:0/1045228648 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02f00bcca0 con 0x7f02f815b4e0 2023-10-14T12:34:22.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.901+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02f804ebb0 con 0x7f02f815b4e0 2023-10-14T12:34:22.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.902+0000 7f02edffb700 1 -- 172.21.15.72:0/1045228648 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02f0016070 con 0x7f02f815b4e0 2023-10-14T12:34:22.903 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:22.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02dc06af00 msgr2=0x7f02dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02dc06af00 0x7f02dc06d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f02f4000f60 tx=0x7f02f4007e70 comp rx=0 tx=0).stop 2023-10-14T12:34:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f815b4e0 msgr2=0x7f02f81e4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f815b4e0 0x7f02f81e4b40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f02f000cba0 tx=0x7f02f000ceb0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 shutdown_connections 2023-10-14T12:34:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f02dc06af00 0x7f02dc06d3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02f815b4e0 0x7f02f81e4b40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f02f80b33f0 0x7f02f81f0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 --2- 172.21.15.72:0/1045228648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02f80cd770 0x7f02f81e2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 >> 172.21.15.72:0/1045228648 conn(0x7f02f80cdce0 msgr2=0x7f02f8158260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 shutdown_connections 2023-10-14T12:34:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:22.904+0000 7f02ff936700 1 -- 172.21.15.72:0/1045228648 wait complete. 2023-10-14T12:34:22.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:23.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.039+0000 7f99d9cf1700 1 Processor -- start 2023-10-14T12:34:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.039+0000 7f99d9cf1700 1 -- start start 2023-10-14T12:34:23.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d9cf1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99d406a820 0x7f99d415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d9cf1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d4161360 con 0x7f99d40cdd30 2023-10-14T12:34:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d9cf1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d406b750 con 0x7f99d406b370 2023-10-14T12:34:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d9cf1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d406dcc0 con 0x7f99d406a820 2023-10-14T12:34:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99d406a820 0x7f99d415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f99d406a820 0x7f99d415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47916/0 (socket says 172.21.15.72:47916) 2023-10-14T12:34:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d2ffd700 1 -- 172.21.15.72:0/5050884 learned_addr learned my addr 172.21.15.72:0/5050884 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f99d40cdd30 0x7f99d41617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54218/0 (socket says 172.21.15.72:54218) 2023-10-14T12:34:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d2ffd700 1 -- 172.21.15.72:0/5050884 >> v1:172.21.15.123:6789/0 conn(0x7f99d406b370 legacy=0x7f99d406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d2ffd700 1 -- 172.21.15.72:0/5050884 >> v1:172.21.15.72:6789/0 conn(0x7f99d40cdd30 legacy=0x7f99d41617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d2ffd700 1 -- 172.21.15.72:0/5050884 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d415e300 con 0x7f99d406a820 2023-10-14T12:34:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d27fc700 1 -- 172.21.15.72:0/5050884 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582137949 0 0) 0x7f99d4161360 con 0x7f99d40cdd30 2023-10-14T12:34:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.040+0000 7f99d2ffd700 1 --2- 172.21.15.72:0/5050884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d406a820 0x7f99d415dcb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99c40098f0 tx=0x7f99c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8776d1cef93411 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d27fc700 1 -- 172.21.15.72:0/5050884 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c400b8a0 con 0x7f99d406a820 2023-10-14T12:34:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d27fc700 1 -- 172.21.15.72:0/5050884 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c400ba00 con 0x7f99d406a820 2023-10-14T12:34:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d27fc700 1 -- 172.21.15.72:0/5050884 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c400bd90 con 0x7f99d406a820 2023-10-14T12:34:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d9cf1700 1 -- 172.21.15.72:0/5050884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d406a820 msgr2=0x7f99d415dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d9cf1700 1 --2- 172.21.15.72:0/5050884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d406a820 0x7f99d415dcb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99c40098f0 tx=0x7f99c4009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d9cf1700 1 -- 172.21.15.72:0/5050884 shutdown_connections 2023-10-14T12:34:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d9cf1700 1 --2- 172.21.15.72:0/5050884 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d406a820 0x7f99d415dcb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d9cf1700 1 -- 172.21.15.72:0/5050884 >> 172.21.15.72:0/5050884 conn(0x7f99d40ccbe0 msgr2=0x7f99d40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:23.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d9cf1700 1 -- 172.21.15.72:0/5050884 shutdown_connections 2023-10-14T12:34:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.041+0000 7f99d9cf1700 1 -- 172.21.15.72:0/5050884 wait complete. 2023-10-14T12:34:23.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.042+0000 7f99d9cf1700 1 Processor -- start 2023-10-14T12:34:23.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d9cf1700 1 -- start start 2023-10-14T12:34:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d9cf1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99d406a820 0x7f99d40c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d9cf1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99d406b370 0x7f99d415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d9cf1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d40cdd30 0x7f99d41547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d9cf1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4154d10 con 0x7f99d40cdd30 2023-10-14T12:34:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d9cf1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41e7440 con 0x7f99d406b370 2023-10-14T12:34:23.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d9cf1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41e6830 con 0x7f99d406a820 2023-10-14T12:34:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d40cdd30 0x7f99d41547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d40cdd30 0x7f99d41547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47924/0 (socket says 172.21.15.72:47924) 2023-10-14T12:34:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d3fff700 1 -- 172.21.15.72:0/2263798092 learned_addr learned my addr 172.21.15.72:0/2263798092 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d37fe700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99d406a820 0x7f99d40c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.043+0000 7f99d2ffd700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99d406b370 0x7f99d415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99d3fff700 1 -- 172.21.15.72:0/2263798092 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99d406a820 msgr2=0x7f99d40c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99d3fff700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99d406a820 0x7f99d40c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99d3fff700 1 -- 172.21.15.72:0/2263798092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99d406b370 msgr2=0x7f99d415b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99d3fff700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99d406b370 0x7f99d415b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99d3fff700 1 -- 172.21.15.72:0/2263798092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009550 con 0x7f99d40cdd30 2023-10-14T12:34:23.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99d2ffd700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99d406b370 0x7f99d415b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:23.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99d3fff700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d40cdd30 0x7f99d41547d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00cca0 tx=0x7f99cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:23.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99cbfff700 1 -- 172.21.15.72:0/2263798092 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00ac20 con 0x7f99d40cdd30 2023-10-14T12:34:23.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99cbfff700 1 -- 172.21.15.72:0/2263798092 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc00ad80 con 0x7f99d40cdd30 2023-10-14T12:34:23.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99cbfff700 1 -- 172.21.15.72:0/2263798092 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc007310 con 0x7f99d40cdd30 2023-10-14T12:34:23.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d41e6b10 con 0x7f99d40cdd30 2023-10-14T12:34:23.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.044+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d41e70d0 con 0x7f99d40cdd30 2023-10-14T12:34:23.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.045+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d4072d10 con 0x7f99d40cdd30 2023-10-14T12:34:23.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.045+0000 7f99cbfff700 1 -- 172.21.15.72:0/2263798092 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f99cc007470 con 0x7f99d40cdd30 2023-10-14T12:34:23.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.046+0000 7f99cbfff700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f99b406af00 0x7f99b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.046+0000 7f99cbfff700 1 -- 172.21.15.72:0/2263798092 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f99cc089500 con 0x7f99d40cdd30 2023-10-14T12:34:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.046+0000 7f99d37fe700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f99b406af00 0x7f99b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.046+0000 7f99d37fe700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f99b406af00 0x7f99b406d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f99bc007fd0 tx=0x7f99bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.050+0000 7f99cbfff700 1 -- 172.21.15.72:0/2263798092 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f99cc054280 con 0x7f99d40cdd30 2023-10-14T12:34:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.236+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f99d41e75b0 con 0x7f99d40cdd30 2023-10-14T12:34:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.237+0000 7f99cbfff700 1 -- 172.21.15.72:0/2263798092 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f99cc018020 con 0x7f99d40cdd30 2023-10-14T12:34:23.238 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:23.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f99b406af00 msgr2=0x7f99b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f99b406af00 0x7f99b406d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f99bc007fd0 tx=0x7f99bc009040 comp rx=0 tx=0).stop 2023-10-14T12:34:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d40cdd30 msgr2=0x7f99d41547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d40cdd30 0x7f99d41547d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00cca0 tx=0x7f99cc00a060 comp rx=0 tx=0).stop 2023-10-14T12:34:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 shutdown_connections 2023-10-14T12:34:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f99b406af00 0x7f99b406d3c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99d40cdd30 0x7f99d41547d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f99d406a820 0x7f99d40c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 --2- 172.21.15.72:0/2263798092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99d406b370 0x7f99d415b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 >> 172.21.15.72:0/2263798092 conn(0x7f99d40ccbe0 msgr2=0x7f99d41574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 shutdown_connections 2023-10-14T12:34:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.239+0000 7f99d9cf1700 1 -- 172.21.15.72:0/2263798092 wait complete. 2023-10-14T12:34:23.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:34:23.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.372+0000 7f6e021d9700 1 Processor -- start 2023-10-14T12:34:23.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.372+0000 7f6e021d9700 1 -- start start 2023-10-14T12:34:23.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.373+0000 7f6e021d9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6dfc0cf7d0 0x7f6dfc15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.373+0000 7f6e021d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dfc0cfeb0 con 0x7f6dfc06a820 2023-10-14T12:34:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.373+0000 7f6e021d9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dfc0cfc30 con 0x7f6dfc0ca7d0 2023-10-14T12:34:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.373+0000 7f6e021d9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dfc0ce410 con 0x7f6dfc0cf7d0 2023-10-14T12:34:23.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.373+0000 7f6dfb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6dfc06a820 0x7f6dfc06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54228/0 (socket says 172.21.15.72:54228) 2023-10-14T12:34:23.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.373+0000 7f6dfb7fe700 1 -- 172.21.15.72:0/1900551593 learned_addr learned my addr 172.21.15.72:0/1900551593 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:23.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548248243 0 0) 0x7f6dfc0cfeb0 con 0x7f6dfc06a820 2023-10-14T12:34:23.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6de40035b0 con 0x7f6dfc06a820 2023-10-14T12:34:23.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfaffd700 1 --2- 172.21.15.72:0/1900551593 >> v2:172.21.15.123:3300/0 conn(0x7f6dfc0cf7d0 0x7f6dfc15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2419207188 0 0) 0x7f6de40035b0 con 0x7f6dfc06a820 2023-10-14T12:34:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 >> v2:172.21.15.123:3300/0 conn(0x7f6dfc0cf7d0 msgr2=0x7f6dfc15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 --2- 172.21.15.72:0/1900551593 >> v2:172.21.15.123:3300/0 conn(0x7f6dfc0cf7d0 0x7f6dfc15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 >> v1:172.21.15.123:6789/0 conn(0x7f6dfc0ca7d0 legacy=0x7f6dfc071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc0af9d0 con 0x7f6dfc06a820 2023-10-14T12:34:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f6df0001670 con 0x7f6dfc06a820 2023-10-14T12:34:23.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 >> v1:172.21.15.72:6789/0 conn(0x7f6dfc06a820 legacy=0x7f6dfc06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6de4003a00 0x7f6de4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6de4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6de4005210 0x7f6de400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0ce410 con 0x7f6de4004850 2023-10-14T12:34:23.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de400c1b0 con 0x7f6de4003a00 2023-10-14T12:34:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de400c370 con 0x7f6de4005210 2023-10-14T12:34:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfaffd700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6de4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfb7fe700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6de4003a00 0x7f6de4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfbfff700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6de4005210 0x7f6de400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfaffd700 1 -- 172.21.15.72:0/1900551593 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6de4005210 msgr2=0x7f6de400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:23.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfaffd700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6de4005210 0x7f6de400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfaffd700 1 -- 172.21.15.72:0/1900551593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6de4003a00 msgr2=0x7f6de4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:23.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfaffd700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6de4003a00 0x7f6de4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfaffd700 1 -- 172.21.15.72:0/1900551593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de40035b0 con 0x7f6de4004850 2023-10-14T12:34:23.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfb7fe700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6de4003a00 0x7f6de4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:23.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfbfff700 1 -- 172.21.15.72:0/1900551593 reap_dead start 2023-10-14T12:34:23.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfaffd700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6de4004cd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009b60 tx=0x7f6de4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994df204b362ed3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:23.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec00e6c0 con 0x7f6de4004850 2023-10-14T12:34:23.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.374+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec00e820 con 0x7f6de4004850 2023-10-14T12:34:23.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.375+0000 7f6dfa7fc700 1 -- 172.21.15.72:0/1900551593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec00ebb0 con 0x7f6de4004850 2023-10-14T12:34:23.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.375+0000 7f6e021d9700 1 -- 172.21.15.72:0/1900551593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 msgr2=0x7f6de4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.375+0000 7f6e021d9700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6de4004cd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009b60 tx=0x7f6de4005880 comp rx=0 tx=0).stop 2023-10-14T12:34:23.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.375+0000 7f6e021d9700 1 -- 172.21.15.72:0/1900551593 shutdown_connections 2023-10-14T12:34:23.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.375+0000 7f6e021d9700 1 --2- 172.21.15.72:0/1900551593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6de4004cd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.375+0000 7f6e021d9700 1 -- 172.21.15.72:0/1900551593 >> 172.21.15.72:0/1900551593 conn(0x7f6dfc0d0180 msgr2=0x7f6dfc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:23.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.375+0000 7f6e021d9700 1 -- 172.21.15.72:0/1900551593 shutdown_connections 2023-10-14T12:34:23.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.375+0000 7f6e021d9700 1 -- 172.21.15.72:0/1900551593 wait complete. 2023-10-14T12:34:23.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.376+0000 7f6e021d9700 1 Processor -- start 2023-10-14T12:34:23.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6e021d9700 1 -- start start 2023-10-14T12:34:23.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6e021d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6dfc1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6e021d9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dfc0c8cc0 0x7f6dfc1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6e021d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dfc152ff0 0x7f6dfc158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6e021d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0c9210 con 0x7f6de4004850 2023-10-14T12:34:23.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6e021d9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0b2d50 con 0x7f6dfc152ff0 2023-10-14T12:34:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6e021d9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0b3030 con 0x7f6dfc0c8cc0 2023-10-14T12:34:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6dfb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6dfc1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6dfb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6dfc1529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47940/0 (socket says 172.21.15.72:47940) 2023-10-14T12:34:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.377+0000 7f6dfb7fe700 1 -- 172.21.15.72:0/417526673 learned_addr learned my addr 172.21.15.72:0/417526673 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:23.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6dfbfff700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dfc152ff0 0x7f6dfc158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6dfaffd700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dfc0c8cc0 0x7f6dfc1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6dfb7fe700 1 -- 172.21.15.72:0/417526673 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dfc0c8cc0 msgr2=0x7f6dfc1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6dfb7fe700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dfc0c8cc0 0x7f6dfc1584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6dfb7fe700 1 -- 172.21.15.72:0/417526673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dfc152ff0 msgr2=0x7f6dfc158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6dfb7fe700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dfc152ff0 0x7f6dfc158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6dfb7fe700 1 -- 172.21.15.72:0/417526673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc0b3310 con 0x7f6de4004850 2023-10-14T12:34:23.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6dfaffd700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dfc0c8cc0 0x7f6dfc1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:23.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6dfb7fe700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6dfc1529d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6df0001bb0 tx=0x7f6df000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:23.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6de3fff700 1 -- 172.21.15.72:0/417526673 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0012590 con 0x7f6de4004850 2023-10-14T12:34:23.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6de3fff700 1 -- 172.21.15.72:0/417526673 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df00126f0 con 0x7f6de4004850 2023-10-14T12:34:23.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc0b35f0 con 0x7f6de4004850 2023-10-14T12:34:23.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6de3fff700 1 -- 172.21.15.72:0/417526673 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0012aa0 con 0x7f6de4004850 2023-10-14T12:34:23.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.378+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc153710 con 0x7f6de4004850 2023-10-14T12:34:23.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.379+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc04ebb0 con 0x7f6de4004850 2023-10-14T12:34:23.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.379+0000 7f6de3fff700 1 -- 172.21.15.72:0/417526673 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6df0012c00 con 0x7f6de4004850 2023-10-14T12:34:23.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.380+0000 7f6de3fff700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6de806af00 0x7f6de806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.380+0000 7f6de3fff700 1 -- 172.21.15.72:0/417526673 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6df0089820 con 0x7f6de4004850 2023-10-14T12:34:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.380+0000 7f6dfaffd700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6de806af00 0x7f6de806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.380+0000 7f6dfaffd700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6de806af00 0x7f6de806d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc153ed0 tx=0x7f6dec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:23.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.384+0000 7f6de3fff700 1 -- 172.21.15.72:0/417526673 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6df0054470 con 0x7f6de4004850 2023-10-14T12:34:23.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.588+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6dfc0b2e90 con 0x7f6de4004850 2023-10-14T12:34:23.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.588+0000 7f6de3fff700 1 -- 172.21.15.72:0/417526673 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6dfc0b2e90 con 0x7f6de4004850 2023-10-14T12:34:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6de806af00 msgr2=0x7f6de806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6de806af00 0x7f6de806d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc153ed0 tx=0x7f6dec008030 comp rx=0 tx=0).stop 2023-10-14T12:34:23.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 msgr2=0x7f6dfc1529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6dfc1529d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6df0001bb0 tx=0x7f6df000eb10 comp rx=0 tx=0).stop 2023-10-14T12:34:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 shutdown_connections 2023-10-14T12:34:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6de806af00 0x7f6de806d3c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6dfc152ff0 0x7f6dfc158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6de4004850 0x7f6dfc1529d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 --2- 172.21.15.72:0/417526673 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6dfc0c8cc0 0x7f6dfc1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.590+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 >> 172.21.15.72:0/417526673 conn(0x7f6dfc0d0180 msgr2=0x7f6dfc06e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.591+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 shutdown_connections 2023-10-14T12:34:23.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.591+0000 7f6e021d9700 1 -- 172.21.15.72:0/417526673 wait complete. 2023-10-14T12:34:23.594 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-10-14T12:34:23.603 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T12:34:23.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:23.603 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-14T12:34:23.674 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:34:23.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:23.675 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T12:34:23.700 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:23.701 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:23.719 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:23.719 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:23.777 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:23.777 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:23.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:23.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.994+0000 7fd6d85a0700 1 Processor -- start 2023-10-14T12:34:23.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.994+0000 7fd6d85a0700 1 -- start start 2023-10-14T12:34:23.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.995+0000 7fd6d85a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d00cdbc0 0x7fd6d006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.995+0000 7fd6d85a0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6d006e290 0x7fd6d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:23.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.995+0000 7fd6d85a0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d0161350 con 0x7fd6d00ae1c0 2023-10-14T12:34:23.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.995+0000 7fd6d85a0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d01615f0 con 0x7fd6d006e290 2023-10-14T12:34:23.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.995+0000 7fd6d85a0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d01618d0 con 0x7fd6d00cdbc0 2023-10-14T12:34:23.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.995+0000 7fd6d6b3d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6d006e290 0x7fd6d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:23.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.995+0000 7fd6d6b3d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6d006e290 0x7fd6d006d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47952/0 (socket says 172.21.15.72:47952) 2023-10-14T12:34:23.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.995+0000 7fd6d6b3d700 1 -- 172.21.15.72:0/4223762727 learned_addr learned my addr 172.21.15.72:0/4223762727 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:23.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.995+0000 7fd6d633c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd6d00ae1c0 0x7fd6d00cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54248/0 (socket says 172.21.15.72:54248) 2023-10-14T12:34:23.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d6b3d700 1 -- 172.21.15.72:0/4223762727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d00cdbc0 msgr2=0x7fd6d006cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:24.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d5b3b700 1 --2- 172.21.15.72:0/4223762727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d00cdbc0 0x7fd6d006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d533a700 1 -- 172.21.15.72:0/4223762727 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362322800 0 0) 0x7fd6d0161350 con 0x7fd6d00ae1c0 2023-10-14T12:34:24.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d6b3d700 1 --2- 172.21.15.72:0/4223762727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d00cdbc0 0x7fd6d006cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d6b3d700 1 -- 172.21.15.72:0/4223762727 >> v1:172.21.15.72:6789/0 conn(0x7fd6d00ae1c0 legacy=0x7fd6d00cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d6b3d700 1 -- 172.21.15.72:0/4223762727 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0161bb0 con 0x7fd6d006e290 2023-10-14T12:34:24.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d5b3b700 1 --2- 172.21.15.72:0/4223762727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d00cdbc0 0x7fd6d006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:24.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d6b3d700 1 --2- 172.21.15.72:0/4223762727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d006e290 0x7fd6d006d1a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009e50 tx=0x7fd6c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5213eebf6cf05ca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:24.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d533a700 1 -- 172.21.15.72:0/4223762727 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800e070 con 0x7fd6d006e290 2023-10-14T12:34:24.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d533a700 1 -- 172.21.15.72:0/4223762727 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c800b9c0 con 0x7fd6d006e290 2023-10-14T12:34:24.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d533a700 1 -- 172.21.15.72:0/4223762727 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800bd70 con 0x7fd6d006e290 2023-10-14T12:34:24.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4223762727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d006e290 msgr2=0x7fd6d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.996+0000 7fd6d85a0700 1 --2- 172.21.15.72:0/4223762727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d006e290 0x7fd6d006d1a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009e50 tx=0x7fd6c800b330 comp rx=0 tx=0).stop 2023-10-14T12:34:24.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.997+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4223762727 shutdown_connections 2023-10-14T12:34:24.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.997+0000 7fd6d85a0700 1 --2- 172.21.15.72:0/4223762727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d006e290 0x7fd6d006d1a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.997+0000 7fd6d85a0700 1 --2- 172.21.15.72:0/4223762727 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d00cdbc0 0x7fd6d006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.997+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4223762727 >> 172.21.15.72:0/4223762727 conn(0x7fd6d00cfcd0 msgr2=0x7fd6d00d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:24.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.997+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4223762727 shutdown_connections 2023-10-14T12:34:24.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.997+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4223762727 wait complete. 2023-10-14T12:34:24.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.998+0000 7fd6d85a0700 1 Processor -- start 2023-10-14T12:34:24.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.998+0000 7fd6d85a0700 1 -- start start 2023-10-14T12:34:24.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.998+0000 7fd6d85a0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006e290 0x7fd6d01f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.998+0000 7fd6d85a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00ae1c0 0x7fd6d015b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.998+0000 7fd6d85a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d00cdbc0 0x7fd6d015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.998+0000 7fd6d85a0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d014ded0 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.998+0000 7fd6d85a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0147a80 con 0x7fd6d00ae1c0 2023-10-14T12:34:24.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.998+0000 7fd6d85a0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d01f7420 con 0x7fd6d006e290 2023-10-14T12:34:24.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d6b3d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d00cdbc0 0x7fd6d015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d6b3d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d00cdbc0 0x7fd6d015bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47958/0 (socket says 172.21.15.72:47958) 2023-10-14T12:34:24.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d6b3d700 1 -- 172.21.15.72:0/4125251489 learned_addr learned my addr 172.21.15.72:0/4125251489 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:24.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d6b3d700 1 -- 172.21.15.72:0/4125251489 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006e290 msgr2=0x7fd6d01f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d5b3b700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00ae1c0 0x7fd6d015b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d633c700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006e290 0x7fd6d01f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d6b3d700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006e290 0x7fd6d01f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d6b3d700 1 -- 172.21.15.72:0/4125251489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00ae1c0 msgr2=0x7fd6d015b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d6b3d700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00ae1c0 0x7fd6d015b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d6b3d700 1 -- 172.21.15.72:0/4125251489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8009b30 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d5b3b700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00ae1c0 0x7fd6d015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:24.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d6b3d700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d00cdbc0 0x7fd6d015bdc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0066b80 tx=0x7fd6c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:24.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6c6ffd700 1 -- 172.21.15.72:0/4125251489 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80092e0 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6c6ffd700 1 -- 172.21.15.72:0/4125251489 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c80099b0 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d01f3450 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6c6ffd700 1 -- 172.21.15.72:0/4125251489 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c801b650 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:23.999+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d01f3a10 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.000+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d0147bf0 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.000+0000 7fd6c6ffd700 1 -- 172.21.15.72:0/4125251489 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd6c801b7b0 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.001+0000 7fd6c6ffd700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd6b406af00 0x7fd6b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.001+0000 7fd6c6ffd700 1 -- 172.21.15.72:0/4125251489 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd6c808b2e0 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.001+0000 7fd6d633c700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd6b406af00 0x7fd6b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.001+0000 7fd6d633c700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd6b406af00 0x7fd6b406d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0000f60 tx=0x7fd6c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:24.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.005+0000 7fd6c6ffd700 1 -- 172.21.15.72:0/4125251489 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd6d0147bf0 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.196+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6d0147bf0 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.197+0000 7fd6c6ffd700 1 -- 172.21.15.72:0/4125251489 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18678 (secure 0 0 0) 0x7fd6d0147bf0 con 0x7fd6d00cdbc0 2023-10-14T12:34:24.198 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:24.198 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:20.981579+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.199+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd6b406af00 msgr2=0x7fd6b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.199+0000 7fd6d85a0700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd6b406af00 0x7fd6b406d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0000f60 tx=0x7fd6c0009040 comp rx=0 tx=0).stop 2023-10-14T12:34:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.199+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d00cdbc0 msgr2=0x7fd6d015bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.199+0000 7fd6d85a0700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d00cdbc0 0x7fd6d015bdc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0066b80 tx=0x7fd6c8004ad0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.199+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 shutdown_connections 2023-10-14T12:34:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.199+0000 7fd6d85a0700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd6b406af00 0x7fd6b406d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.199+0000 7fd6d85a0700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6d00cdbc0 0x7fd6d015bdc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.200+0000 7fd6d85a0700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd6d006e290 0x7fd6d01f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.200+0000 7fd6d85a0700 1 --2- 172.21.15.72:0/4125251489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6d00ae1c0 0x7fd6d015b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.200+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 >> 172.21.15.72:0/4125251489 conn(0x7fd6d00cfcd0 msgr2=0x7fd6d00cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:24.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.200+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 shutdown_connections 2023-10-14T12:34:24.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.200+0000 7fd6d85a0700 1 -- 172.21.15.72:0/4125251489 wait complete. 2023-10-14T12:34:24.212 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:24.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:24.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.336+0000 7f127b4e4700 1 Processor -- start 2023-10-14T12:34:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.336+0000 7f127b4e4700 1 -- start start 2023-10-14T12:34:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.337+0000 7f127b4e4700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f127406b370 0x7f127415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.337+0000 7f127b4e4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1274161360 con 0x7f127406a820 2023-10-14T12:34:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.337+0000 7f127b4e4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127406b750 con 0x7f12740cdd30 2023-10-14T12:34:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.337+0000 7f127b4e4700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127406dcc0 con 0x7f127406b370 2023-10-14T12:34:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.337+0000 7f1278a7f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f127406a820 0x7f127406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54262/0 (socket says 172.21.15.72:54262) 2023-10-14T12:34:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.337+0000 7f1278a7f700 1 -- 172.21.15.72:0/2799138356 learned_addr learned my addr 172.21.15.72:0/2799138356 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.337+0000 7f1279280700 1 --2- 172.21.15.72:0/2799138356 >> v2:172.21.15.123:3300/0 conn(0x7f127406b370 0x7f127415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.337+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069756548 0 0) 0x7f1274161360 con 0x7f127406a820 2023-10-14T12:34:24.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12600035b0 con 0x7f127406a820 2023-10-14T12:34:24.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865555502 0 0) 0x7f127406b750 con 0x7f12740cdd30 2023-10-14T12:34:24.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1274161360 con 0x7f12740cdd30 2023-10-14T12:34:24.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3736285164 0 0) 0x7f12600035b0 con 0x7f127406a820 2023-10-14T12:34:24.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 >> v2:172.21.15.123:3300/0 conn(0x7f127406b370 msgr2=0x7f127415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:24.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 --2- 172.21.15.72:0/2799138356 >> v2:172.21.15.123:3300/0 conn(0x7f127406b370 0x7f127415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 >> v1:172.21.15.123:6789/0 conn(0x7f12740cdd30 legacy=0x7f12741617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127415e300 con 0x7f127406a820 2023-10-14T12:34:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f1270001670 con 0x7f127406a820 2023-10-14T12:34:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 >> v1:172.21.15.72:6789/0 conn(0x7f127406a820 legacy=0x7f127406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1260003b90 0x7f1260003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260004850 0x7f1260004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260005210 0x7f126000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127406dcc0 con 0x7f1260005210 2023-10-14T12:34:24.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126000c090 con 0x7f1260004850 2023-10-14T12:34:24.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126000c250 con 0x7f1260003b90 2023-10-14T12:34:24.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1279a81700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260005210 0x7f126000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1278a7f700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260004850 0x7f1260004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1279280700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1260003b90 0x7f1260003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1279a81700 1 -- 172.21.15.72:0/2799138356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1260003b90 msgr2=0x7f1260003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1279a81700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1260003b90 0x7f1260003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1279a81700 1 -- 172.21.15.72:0/2799138356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260004850 msgr2=0x7f1260004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1279a81700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260004850 0x7f1260004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1279a81700 1 -- 172.21.15.72:0/2799138356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600035b0 con 0x7f1260005210 2023-10-14T12:34:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1279a81700 1 -- 172.21.15.72:0/2799138356 reap_dead start 2023-10-14T12:34:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.338+0000 7f1279a81700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260005210 0x7f126000ba10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c2f0 tx=0x7f1260005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d7762eefc49ee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c001f30 con 0x7f1260005210 2023-10-14T12:34:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c003a00 con 0x7f1260005210 2023-10-14T12:34:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f126bfff700 1 -- 172.21.15.72:0/2799138356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c003db0 con 0x7f1260005210 2023-10-14T12:34:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f127b4e4700 1 -- 172.21.15.72:0/2799138356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260005210 msgr2=0x7f126000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f127b4e4700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260005210 0x7f126000ba10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c2f0 tx=0x7f1260005880 comp rx=0 tx=0).stop 2023-10-14T12:34:24.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f127b4e4700 1 -- 172.21.15.72:0/2799138356 shutdown_connections 2023-10-14T12:34:24.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f127b4e4700 1 --2- 172.21.15.72:0/2799138356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1260005210 0x7f126000ba10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f127b4e4700 1 -- 172.21.15.72:0/2799138356 >> 172.21.15.72:0/2799138356 conn(0x7f12740ccbe0 msgr2=0x7f12740ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:24.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f127b4e4700 1 -- 172.21.15.72:0/2799138356 shutdown_connections 2023-10-14T12:34:24.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.339+0000 7f127b4e4700 1 -- 172.21.15.72:0/2799138356 wait complete. 2023-10-14T12:34:24.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.340+0000 7f127b4e4700 1 Processor -- start 2023-10-14T12:34:24.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.340+0000 7f127b4e4700 1 -- start start 2023-10-14T12:34:24.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f127b4e4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260005210 0x7f12741564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f127b4e4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1274072770 0x7f12740c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f127b4e4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12740b0ff0 0x7f12740b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f127b4e4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12740b19b0 con 0x7f12740b0ff0 2023-10-14T12:34:24.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f127b4e4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1274156a00 con 0x7f1260005210 2023-10-14T12:34:24.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f127b4e4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12740c4f10 con 0x7f1274072770 2023-10-14T12:34:24.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f1279a81700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12740b0ff0 0x7f12740b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f1279a81700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12740b0ff0 0x7f12740b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47976/0 (socket says 172.21.15.72:47976) 2023-10-14T12:34:24.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f1279a81700 1 -- 172.21.15.72:0/138766892 learned_addr learned my addr 172.21.15.72:0/138766892 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:24.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f1279280700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260005210 0x7f12741564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.341+0000 7f1278a7f700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1274072770 0x7f12740c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f1279a81700 1 -- 172.21.15.72:0/138766892 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1274072770 msgr2=0x7f12740c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f1279a81700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1274072770 0x7f12740c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f1279a81700 1 -- 172.21.15.72:0/138766892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260005210 msgr2=0x7f12741564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f1279a81700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260005210 0x7f12741564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f1279a81700 1 -- 172.21.15.72:0/138766892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740c51f0 con 0x7f12740b0ff0 2023-10-14T12:34:24.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f1279a81700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12740b0ff0 0x7f12740b1470 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f127406e9c0 tx=0x7f126c001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:24.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f1269ffb700 1 -- 172.21.15.72:0/138766892 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c005270 con 0x7f12740b0ff0 2023-10-14T12:34:24.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f1269ffb700 1 -- 172.21.15.72:0/138766892 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c0053d0 con 0x7f12740b0ff0 2023-10-14T12:34:24.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12740c54d0 con 0x7f12740b0ff0 2023-10-14T12:34:24.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f1269ffb700 1 -- 172.21.15.72:0/138766892 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c005780 con 0x7f12740b0ff0 2023-10-14T12:34:24.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.342+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12740c4b70 con 0x7f12740b0ff0 2023-10-14T12:34:24.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.343+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1274072d10 con 0x7f12740b0ff0 2023-10-14T12:34:24.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.343+0000 7f1269ffb700 1 -- 172.21.15.72:0/138766892 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f126c01e470 con 0x7f12740b0ff0 2023-10-14T12:34:24.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.344+0000 7f1269ffb700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125806af30 0x7f125806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.344+0000 7f1269ffb700 1 -- 172.21.15.72:0/138766892 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f126c08b0c0 con 0x7f12740b0ff0 2023-10-14T12:34:24.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.344+0000 7f1279280700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125806af30 0x7f125806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.344+0000 7f1279280700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125806af30 0x7f125806d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1264009b20 tx=0x7f1264008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:24.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.348+0000 7f1269ffb700 1 -- 172.21.15.72:0/138766892 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f126c055e40 con 0x7f12740b0ff0 2023-10-14T12:34:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.539+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f127404ebb0 con 0x7f12740b0ff0 2023-10-14T12:34:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.539+0000 7f1269ffb700 1 -- 172.21.15.72:0/138766892 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f126c059460 con 0x7f12740b0ff0 2023-10-14T12:34:24.540 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:24.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.541+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125806af30 msgr2=0x7f125806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125806af30 0x7f125806d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1264009b20 tx=0x7f1264008040 comp rx=0 tx=0).stop 2023-10-14T12:34:24.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12740b0ff0 msgr2=0x7f12740b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12740b0ff0 0x7f12740b1470 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f127406e9c0 tx=0x7f126c001650 comp rx=0 tx=0).stop 2023-10-14T12:34:24.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 shutdown_connections 2023-10-14T12:34:24.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125806af30 0x7f125806d3f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12740b0ff0 0x7f12740b1470 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1260005210 0x7f12741564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 --2- 172.21.15.72:0/138766892 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1274072770 0x7f12740c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 >> 172.21.15.72:0/138766892 conn(0x7f12740ccbe0 msgr2=0x7f127415f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:24.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 shutdown_connections 2023-10-14T12:34:24.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.542+0000 7f127b4e4700 1 -- 172.21.15.72:0/138766892 wait complete. 2023-10-14T12:34:24.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.677+0000 7f423aed1700 1 Processor -- start 2023-10-14T12:34:24.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.677+0000 7f423aed1700 1 -- start start 2023-10-14T12:34:24.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f423aed1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f423406b370 0x7f423415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f423aed1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4234161360 con 0x7f423406a820 2023-10-14T12:34:24.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f423aed1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423406b750 con 0x7f42340cdd30 2023-10-14T12:34:24.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f423aed1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423406dcc0 con 0x7f423406b370 2023-10-14T12:34:24.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f4233fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f423406a820 0x7f423406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54282/0 (socket says 172.21.15.72:54282) 2023-10-14T12:34:24.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f4233fff700 1 -- 172.21.15.72:0/3778726054 learned_addr learned my addr 172.21.15.72:0/3778726054 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:24.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f4238c6d700 1 --2- 172.21.15.72:0/3778726054 >> v2:172.21.15.123:3300/0 conn(0x7f423406b370 0x7f423415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321455390 0 0) 0x7f4234161360 con 0x7f423406a820 2023-10-14T12:34:24.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42240035b0 con 0x7f423406a820 2023-10-14T12:34:24.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4165431491 0 0) 0x7f42240035b0 con 0x7f423406a820 2023-10-14T12:34:24.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 >> v2:172.21.15.123:3300/0 conn(0x7f423406b370 msgr2=0x7f423415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:24.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 --2- 172.21.15.72:0/3778726054 >> v2:172.21.15.123:3300/0 conn(0x7f423406b370 0x7f423415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 >> v1:172.21.15.123:6789/0 conn(0x7f42340cdd30 legacy=0x7f42341617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423415e300 con 0x7f423406a820 2023-10-14T12:34:24.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f4220001670 con 0x7f423406a820 2023-10-14T12:34:24.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 >> v1:172.21.15.72:6789/0 conn(0x7f423406a820 legacy=0x7f423406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4224003a00 0x7f4224003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4224004400 0x7f42240048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f422400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423406dcc0 con 0x7f42240050d0 2023-10-14T12:34:24.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422400c030 con 0x7f4224004400 2023-10-14T12:34:24.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422400c1f0 con 0x7f4224003a00 2023-10-14T12:34:24.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.678+0000 7f423946e700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f422400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f4238c6d700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4224003a00 0x7f4224003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f4233fff700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4224004400 0x7f42240048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f423946e700 1 -- 172.21.15.72:0/3778726054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4224003a00 msgr2=0x7f4224003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:24.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f423946e700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4224003a00 0x7f4224003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f423946e700 1 -- 172.21.15.72:0/3778726054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4224004400 msgr2=0x7f42240048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:24.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f423946e700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4224004400 0x7f42240048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f423946e700 1 -- 172.21.15.72:0/3778726054 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240035b0 con 0x7f42240050d0 2023-10-14T12:34:24.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f4233fff700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4224004400 0x7f42240048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:24.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f423946e700 1 -- 172.21.15.72:0/3778726054 reap_dead start 2023-10-14T12:34:24.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f423946e700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f422400ba10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c290 tx=0x7f4224005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71f096630caa219 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:24.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c016070 con 0x7f42240050d0 2023-10-14T12:34:24.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c00cc30 con 0x7f42240050d0 2023-10-14T12:34:24.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.679+0000 7f42337fe700 1 -- 172.21.15.72:0/3778726054 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c001e70 con 0x7f42240050d0 2023-10-14T12:34:24.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.680+0000 7f423aed1700 1 -- 172.21.15.72:0/3778726054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 msgr2=0x7f422400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.680+0000 7f423aed1700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f422400ba10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c290 tx=0x7f4224005880 comp rx=0 tx=0).stop 2023-10-14T12:34:24.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.680+0000 7f423aed1700 1 -- 172.21.15.72:0/3778726054 shutdown_connections 2023-10-14T12:34:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.680+0000 7f423aed1700 1 --2- 172.21.15.72:0/3778726054 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f422400ba10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.680+0000 7f423aed1700 1 -- 172.21.15.72:0/3778726054 >> 172.21.15.72:0/3778726054 conn(0x7f42340ccbe0 msgr2=0x7f42340ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.680+0000 7f423aed1700 1 -- 172.21.15.72:0/3778726054 shutdown_connections 2023-10-14T12:34:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.680+0000 7f423aed1700 1 -- 172.21.15.72:0/3778726054 wait complete. 2023-10-14T12:34:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.681+0000 7f423aed1700 1 Processor -- start 2023-10-14T12:34:24.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.681+0000 7f423aed1700 1 -- start start 2023-10-14T12:34:24.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.682+0000 7f423aed1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f42340c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.682+0000 7f423aed1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42340c99f0 0x7f42341f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.682+0000 7f423aed1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42340c9e70 0x7f42341f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.682+0000 7f423aed1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42340af3f0 con 0x7f42240050d0 2023-10-14T12:34:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.682+0000 7f423aed1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42340c63b0 con 0x7f42340c99f0 2023-10-14T12:34:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.682+0000 7f423aed1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42340c6690 con 0x7f42340c9e70 2023-10-14T12:34:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.682+0000 7f4238c6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f42340c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.682+0000 7f4238c6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f42340c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47990/0 (socket says 172.21.15.72:47990) 2023-10-14T12:34:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.682+0000 7f4238c6d700 1 -- 172.21.15.72:0/435276842 learned_addr learned my addr 172.21.15.72:0/435276842 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f4233fff700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42340c99f0 0x7f42341f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f4238c6d700 1 -- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42340c9e70 msgr2=0x7f42341f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f423946e700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42340c9e70 0x7f42341f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f4238c6d700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42340c9e70 0x7f42341f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f4238c6d700 1 -- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42340c99f0 msgr2=0x7f42341f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f4238c6d700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42340c99f0 0x7f42341f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f4238c6d700 1 -- 172.21.15.72:0/435276842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340c6970 con 0x7f42240050d0 2023-10-14T12:34:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f4233fff700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42340c99f0 0x7f42341f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:24.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f423946e700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42340c9e70 0x7f42341f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f4238c6d700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f42340c5d60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f42280119a0 tx=0x7f4228011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f42317fa700 1 -- 172.21.15.72:0/435276842 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800f940 con 0x7f42240050d0 2023-10-14T12:34:24.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f42317fa700 1 -- 172.21.15.72:0/435276842 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422800faa0 con 0x7f42240050d0 2023-10-14T12:34:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f42317fa700 1 -- 172.21.15.72:0/435276842 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422800fe30 con 0x7f42240050d0 2023-10-14T12:34:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42341f30c0 con 0x7f42240050d0 2023-10-14T12:34:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.683+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42341f3d00 con 0x7f42240050d0 2023-10-14T12:34:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.684+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4234072d10 con 0x7f42240050d0 2023-10-14T12:34:24.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.685+0000 7f42317fa700 1 -- 172.21.15.72:0/435276842 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4228014440 con 0x7f42240050d0 2023-10-14T12:34:24.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.685+0000 7f42317fa700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f421806af00 0x7f421806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:24.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.685+0000 7f42317fa700 1 -- 172.21.15.72:0/435276842 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f422808a0a0 con 0x7f42240050d0 2023-10-14T12:34:24.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.685+0000 7f4233fff700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f421806af00 0x7f421806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:24.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.685+0000 7f4233fff700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f421806af00 0x7f421806d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f42200011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:24.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.689+0000 7f42317fa700 1 -- 172.21.15.72:0/435276842 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4228054d90 con 0x7f42240050d0 2023-10-14T12:34:24.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.881+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f423404ebb0 con 0x7f42240050d0 2023-10-14T12:34:24.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.882+0000 7f42317fa700 1 -- 172.21.15.72:0/435276842 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42280583b0 con 0x7f42240050d0 2023-10-14T12:34:24.883 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:24.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f421806af00 msgr2=0x7f421806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f421806af00 0x7f421806d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4220000c00 tx=0x7f42200011a0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 msgr2=0x7f42340c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:24.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f42340c5d60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f42280119a0 tx=0x7f4228011d60 comp rx=0 tx=0).stop 2023-10-14T12:34:24.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 shutdown_connections 2023-10-14T12:34:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f421806af00 0x7f421806d3c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f42340c9e70 0x7f42341f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f42240050d0 0x7f42340c5d60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 --2- 172.21.15.72:0/435276842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42340c99f0 0x7f42341f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:24.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 >> 172.21.15.72:0/435276842 conn(0x7f42340ccbe0 msgr2=0x7f42341574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 shutdown_connections 2023-10-14T12:34:24.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:24.884+0000 7f423aed1700 1 -- 172.21.15.72:0/435276842 wait complete. 2023-10-14T12:34:24.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.020+0000 7f54cefa4700 1 Processor -- start 2023-10-14T12:34:25.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.020+0000 7f54cefa4700 1 -- start start 2023-10-14T12:34:25.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54cefa4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54c815a250 0x7f54c80717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54cefa4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c806dcc0 0x7f54c80cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54cefa4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c80cba90 con 0x7f54c815dec0 2023-10-14T12:34:25.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54cefa4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c80cb510 con 0x7f54c815a250 2023-10-14T12:34:25.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54cefa4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c815ee40 con 0x7f54c806dcc0 2023-10-14T12:34:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54ccd40700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54c815a250 0x7f54c80717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54ccd40700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54c815a250 0x7f54c80717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:47998/0 (socket says 172.21.15.72:47998) 2023-10-14T12:34:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54ccd40700 1 -- 172.21.15.72:0/3316754683 learned_addr learned my addr 172.21.15.72:0/3316754683 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54c7fff700 1 --1- 172.21.15.72:0/3316754683 >> v1:172.21.15.72:6789/0 conn(0x7f54c815dec0 0x7f54c806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54300/0 (socket says 172.21.15.72:54300) 2023-10-14T12:34:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54cd541700 1 --2- 172.21.15.72:0/3316754683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c806dcc0 0x7f54c80cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54ccd40700 1 -- 172.21.15.72:0/3316754683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c806dcc0 msgr2=0x7f54c80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:25.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54ccd40700 1 --2- 172.21.15.72:0/3316754683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c806dcc0 0x7f54c80cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54ccd40700 1 -- 172.21.15.72:0/3316754683 >> v1:172.21.15.72:6789/0 conn(0x7f54c815dec0 legacy=0x7f54c806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54ccd40700 1 -- 172.21.15.72:0/3316754683 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c815e880 con 0x7f54c815a250 2023-10-14T12:34:25.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54c77fe700 1 -- 172.21.15.72:0/3316754683 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813008211 0 0) 0x7f54c80cba90 con 0x7f54c815dec0 2023-10-14T12:34:25.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54cd541700 1 --2- 172.21.15.72:0/3316754683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c806dcc0 0x7f54c80cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54ccd40700 1 --2- 172.21.15.72:0/3316754683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c815a250 0x7f54c80717b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00bb90 tx=0x7f54bc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e136a926925f51c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54c77fe700 1 -- 172.21.15.72:0/3316754683 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00dd50 con 0x7f54c815a250 2023-10-14T12:34:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54c77fe700 1 -- 172.21.15.72:0/3316754683 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc010470 con 0x7f54c815a250 2023-10-14T12:34:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.021+0000 7f54c77fe700 1 -- 172.21.15.72:0/3316754683 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc010800 con 0x7f54c815a250 2023-10-14T12:34:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.022+0000 7f54cefa4700 1 -- 172.21.15.72:0/3316754683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c815a250 msgr2=0x7f54c80717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.022+0000 7f54cefa4700 1 --2- 172.21.15.72:0/3316754683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c815a250 0x7f54c80717b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00bb90 tx=0x7f54bc00bea0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.022+0000 7f54cefa4700 1 -- 172.21.15.72:0/3316754683 shutdown_connections 2023-10-14T12:34:25.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.022+0000 7f54cefa4700 1 --2- 172.21.15.72:0/3316754683 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c806dcc0 0x7f54c80cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.022+0000 7f54cefa4700 1 --2- 172.21.15.72:0/3316754683 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c815a250 0x7f54c80717b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.022+0000 7f54cefa4700 1 -- 172.21.15.72:0/3316754683 >> 172.21.15.72:0/3316754683 conn(0x7f54c80ccbe0 msgr2=0x7f54c80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.022+0000 7f54cefa4700 1 -- 172.21.15.72:0/3316754683 shutdown_connections 2023-10-14T12:34:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.022+0000 7f54cefa4700 1 -- 172.21.15.72:0/3316754683 wait complete. 2023-10-14T12:34:25.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.023+0000 7f54cefa4700 1 Processor -- start 2023-10-14T12:34:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.023+0000 7f54cefa4700 1 -- start start 2023-10-14T12:34:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54cefa4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c806dcc0 0x7f54c80c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54cefa4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c815a250 0x7f54c80c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54cefa4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c815dec0 0x7f54c80b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54cefa4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80ca180 con 0x7f54c806dcc0 2023-10-14T12:34:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54cefa4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c8150 con 0x7f54c815a250 2023-10-14T12:34:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54cefa4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c9060 con 0x7f54c815dec0 2023-10-14T12:34:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54ccd40700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c806dcc0 0x7f54c80c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54ccd40700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c806dcc0 0x7f54c80c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48004/0 (socket says 172.21.15.72:48004) 2023-10-14T12:34:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54ccd40700 1 -- 172.21.15.72:0/669211280 learned_addr learned my addr 172.21.15.72:0/669211280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54cd541700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c815dec0 0x7f54c80b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54c7fff700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c815a250 0x7f54c80c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54ccd40700 1 -- 172.21.15.72:0/669211280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c815dec0 msgr2=0x7f54c80b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54ccd40700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c815dec0 0x7f54c80b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54ccd40700 1 -- 172.21.15.72:0/669211280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c815a250 msgr2=0x7f54c80c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54ccd40700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c815a250 0x7f54c80c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54ccd40700 1 -- 172.21.15.72:0/669211280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc00b7f0 con 0x7f54c806dcc0 2023-10-14T12:34:25.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.024+0000 7f54cd541700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c815dec0 0x7f54c80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:25.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.025+0000 7f54ccd40700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c806dcc0 0x7f54c80c9c40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f54c8067ec0 tx=0x7f54bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:25.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.025+0000 7f54c57fa700 1 -- 172.21.15.72:0/669211280 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc01f070 con 0x7f54c806dcc0 2023-10-14T12:34:25.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.025+0000 7f54c57fa700 1 -- 172.21.15.72:0/669211280 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc0039f0 con 0x7f54c806dcc0 2023-10-14T12:34:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.025+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c80c9340 con 0x7f54c806dcc0 2023-10-14T12:34:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.025+0000 7f54c57fa700 1 -- 172.21.15.72:0/669211280 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc003da0 con 0x7f54c806dcc0 2023-10-14T12:34:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.025+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c80c7de0 con 0x7f54c806dcc0 2023-10-14T12:34:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.026+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c80c9860 con 0x7f54c806dcc0 2023-10-14T12:34:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.026+0000 7f54c57fa700 1 -- 172.21.15.72:0/669211280 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f54bc019400 con 0x7f54c806dcc0 2023-10-14T12:34:25.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.026+0000 7f54c57fa700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ac06af00 0x7f54ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.027+0000 7f54c57fa700 1 -- 172.21.15.72:0/669211280 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f54bc08ce90 con 0x7f54c806dcc0 2023-10-14T12:34:25.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.027+0000 7f54c7fff700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ac06af00 0x7f54ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.027+0000 7f54c7fff700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ac06af00 0x7f54ac06d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f54c80b3d80 tx=0x7f54b4007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:25.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.031+0000 7f54c57fa700 1 -- 172.21.15.72:0/669211280 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f54c80c9860 con 0x7f54c806dcc0 2023-10-14T12:34:25.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.222+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54c80c7c40 con 0x7f54c806dcc0 2023-10-14T12:34:25.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.223+0000 7f54c57fa700 1 -- 172.21.15.72:0/669211280 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f54c80c7c40 con 0x7f54c806dcc0 2023-10-14T12:34:25.223 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ac06af00 msgr2=0x7f54ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ac06af00 0x7f54ac06d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f54c80b3d80 tx=0x7f54b4007be0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c806dcc0 msgr2=0x7f54c80c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c806dcc0 0x7f54c80c9c40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f54c8067ec0 tx=0x7f54bc004750 comp rx=0 tx=0).stop 2023-10-14T12:34:25.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 shutdown_connections 2023-10-14T12:34:25.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ac06af00 0x7f54ac06d3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54c815dec0 0x7f54c80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54c806dcc0 0x7f54c80c9c40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 --2- 172.21.15.72:0/669211280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c815a250 0x7f54c80c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 >> 172.21.15.72:0/669211280 conn(0x7f54c80ccbe0 msgr2=0x7f54c806f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:25.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 shutdown_connections 2023-10-14T12:34:25.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.225+0000 7f54cefa4700 1 -- 172.21.15.72:0/669211280 wait complete. 2023-10-14T12:34:25.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:25.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.359+0000 7f3fcbd81700 1 Processor -- start 2023-10-14T12:34:25.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.359+0000 7f3fcbd81700 1 -- start start 2023-10-14T12:34:25.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fcbd81700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fc406b370 0x7f3fc415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fcbd81700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc4161360 con 0x7f3fc40cdd30 2023-10-14T12:34:25.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fcbd81700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc406b750 con 0x7f3fc406a820 2023-10-14T12:34:25.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fcbd81700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc406dcc0 con 0x7f3fc406b370 2023-10-14T12:34:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fca31e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3fc40cdd30 0x7f3fc41617f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54316/0 (socket says 172.21.15.72:54316) 2023-10-14T12:34:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fca31e700 1 -- 172.21.15.72:0/1045338192 learned_addr learned my addr 172.21.15.72:0/1045338192 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fc9b1d700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fc406b370 0x7f3fc415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578676406 0 0) 0x7f3fc4161360 con 0x7f3fc40cdd30 2023-10-14T12:34:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb00035b0 con 0x7f3fc40cdd30 2023-10-14T12:34:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821966626 0 0) 0x7f3fb00035b0 con 0x7f3fc40cdd30 2023-10-14T12:34:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fc406b370 msgr2=0x7f3fc415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:25.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fc8b1b700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fc406b370 0x7f3fc415dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 >> v1:172.21.15.123:6789/0 conn(0x7f3fc406a820 legacy=0x7f3fc406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc415e300 con 0x7f3fc40cdd30 2023-10-14T12:34:25.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.360+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f3fbc0019f0 con 0x7f3fc40cdd30 2023-10-14T12:34:25.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 >> v1:172.21.15.72:6789/0 conn(0x7f3fc40cdd30 legacy=0x7f3fc41617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0003a30 0x7f3fb0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fb0004850 0x7f3fb0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fc406b370 0x7f3fb0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc406dcc0 con 0x7f3fb0003a30 2023-10-14T12:34:25.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb000bac0 con 0x7f3fb0004850 2023-10-14T12:34:25.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb000bc80 con 0x7f3fc406b370 2023-10-14T12:34:25.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc9b1d700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0003a30 0x7f3fb0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc931c700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fb0004850 0x7f3fb0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fca31e700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fc406b370 0x7f3fb0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc9b1d700 1 -- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fc406b370 msgr2=0x7f3fb0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:25.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc9b1d700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fc406b370 0x7f3fb0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc9b1d700 1 -- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fb0004850 msgr2=0x7f3fb0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:25.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc9b1d700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fb0004850 0x7f3fb0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc9b1d700 1 -- 172.21.15.72:0/1045338192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb00035b0 con 0x7f3fb0003a30 2023-10-14T12:34:25.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc9b1d700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0003a30 0x7f3fb0003e50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009b30 tx=0x7f3fb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f71c2eceda35a11 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:25.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000e6c0 con 0x7f3fb0003a30 2023-10-14T12:34:25.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc000e820 con 0x7f3fb0003a30 2023-10-14T12:34:25.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.361+0000 7f3fc8b1b700 1 -- 172.21.15.72:0/1045338192 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000eb90 con 0x7f3fb0003a30 2023-10-14T12:34:25.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.362+0000 7f3fcbd81700 1 -- 172.21.15.72:0/1045338192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0003a30 msgr2=0x7f3fb0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.362+0000 7f3fcbd81700 1 --2- 172.21.15.72:0/1045338192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fb0003a30 0x7f3fb0003e50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009b30 tx=0x7f3fb0005880 comp rx=0 tx=0).stop 2023-10-14T12:34:25.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.362+0000 7f3fca31e700 1 -- 172.21.15.72:0/1045338192 reap_dead start 2023-10-14T12:34:25.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.362+0000 7f3fcbd81700 1 -- 172.21.15.72:0/1045338192 shutdown_connections 2023-10-14T12:34:25.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.362+0000 7f3fcbd81700 1 -- 172.21.15.72:0/1045338192 >> 172.21.15.72:0/1045338192 conn(0x7f3fc40ccbe0 msgr2=0x7f3fc40ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:25.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.362+0000 7f3fcbd81700 1 -- 172.21.15.72:0/1045338192 shutdown_connections 2023-10-14T12:34:25.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.362+0000 7f3fcbd81700 1 -- 172.21.15.72:0/1045338192 wait complete. 2023-10-14T12:34:25.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.363+0000 7f3fcbd81700 1 Processor -- start 2023-10-14T12:34:25.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.363+0000 7f3fcbd81700 1 -- start start 2023-10-14T12:34:25.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fcbd81700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fb0003a30 0x7f3fc4157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fcbd81700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc40c88a0 0x7f3fc40c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fcbd81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fc40c4ce0 0x7f3fc40c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fcbd81700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c9260 con 0x7f3fc40c88a0 2023-10-14T12:34:25.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fcbd81700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c7fe0 con 0x7f3fc40c4ce0 2023-10-14T12:34:25.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fcbd81700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c56a0 con 0x7f3fb0003a30 2023-10-14T12:34:25.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc931c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc40c88a0 0x7f3fc40c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc931c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc40c88a0 0x7f3fc40c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48026/0 (socket says 172.21.15.72:48026) 2023-10-14T12:34:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc931c700 1 -- 172.21.15.72:0/2222331352 learned_addr learned my addr 172.21.15.72:0/2222331352 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc9b1d700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fb0003a30 0x7f3fc4157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fca31e700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fc40c4ce0 0x7f3fc40c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc931c700 1 -- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fb0003a30 msgr2=0x7f3fc4157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc931c700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fb0003a30 0x7f3fc4157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc931c700 1 -- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fc40c4ce0 msgr2=0x7f3fc40c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc931c700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fc40c4ce0 0x7f3fc40c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc931c700 1 -- 172.21.15.72:0/2222331352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40c73d0 con 0x7f3fc40c88a0 2023-10-14T12:34:25.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc9b1d700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fb0003a30 0x7f3fc4157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:25.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fca31e700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fc40c4ce0 0x7f3fc40c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:25.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fc931c700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc40c88a0 0x7f3fc40c8d20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400f850 tx=0x7f3fb400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.364+0000 7f3fba7fc700 1 -- 172.21.15.72:0/2222331352 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4005110 con 0x7f3fc40c88a0 2023-10-14T12:34:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.365+0000 7f3fba7fc700 1 -- 172.21.15.72:0/2222331352 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4005270 con 0x7f3fc40c88a0 2023-10-14T12:34:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.365+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc40c76b0 con 0x7f3fc40c88a0 2023-10-14T12:34:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.365+0000 7f3fba7fc700 1 -- 172.21.15.72:0/2222331352 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4006860 con 0x7f3fc40c88a0 2023-10-14T12:34:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.365+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc40c7c70 con 0x7f3fc40c88a0 2023-10-14T12:34:25.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.365+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc4072d10 con 0x7f3fc40c88a0 2023-10-14T12:34:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.366+0000 7f3fba7fc700 1 -- 172.21.15.72:0/2222331352 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3fb40069c0 con 0x7f3fc40c88a0 2023-10-14T12:34:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.366+0000 7f3fba7fc700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3fa806af00 0x7f3fa806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.366+0000 7f3fba7fc700 1 -- 172.21.15.72:0/2222331352 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3fb4089290 con 0x7f3fc40c88a0 2023-10-14T12:34:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.366+0000 7f3fc9b1d700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3fa806af00 0x7f3fa806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.367+0000 7f3fc9b1d700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3fa806af00 0x7f3fa806d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00090b0 tx=0x7f3fc0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:25.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.371+0000 7f3fba7fc700 1 -- 172.21.15.72:0/2222331352 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3fb4053ee0 con 0x7f3fc40c88a0 2023-10-14T12:34:25.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.560+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3fc404ebb0 con 0x7f3fc40c88a0 2023-10-14T12:34:25.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.561+0000 7f3fba7fc700 1 -- 172.21.15.72:0/2222331352 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3fb4057500 con 0x7f3fc40c88a0 2023-10-14T12:34:25.561 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:25.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3fa806af00 msgr2=0x7f3fa806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3fa806af00 0x7f3fa806d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00090b0 tx=0x7f3fc0008030 comp rx=0 tx=0).stop 2023-10-14T12:34:25.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc40c88a0 msgr2=0x7f3fc40c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc40c88a0 0x7f3fc40c8d20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400f850 tx=0x7f3fb400fc10 comp rx=0 tx=0).stop 2023-10-14T12:34:25.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 shutdown_connections 2023-10-14T12:34:25.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3fa806af00 0x7f3fa806d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fc40c4ce0 0x7f3fc40c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3fb0003a30 0x7f3fc4157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 --2- 172.21.15.72:0/2222331352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc40c88a0 0x7f3fc40c8d20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 >> 172.21.15.72:0/2222331352 conn(0x7f3fc40ccbe0 msgr2=0x7f3fc40b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:25.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 shutdown_connections 2023-10-14T12:34:25.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.563+0000 7f3fcbd81700 1 -- 172.21.15.72:0/2222331352 wait complete. 2023-10-14T12:34:25.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:34:25.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.698+0000 7faf78d2b700 1 Processor -- start 2023-10-14T12:34:25.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.698+0000 7faf78d2b700 1 -- start start 2023-10-14T12:34:25.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf78d2b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf7406e290 0x7faf7406d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf78d2b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf74161350 con 0x7faf740ae1c0 2023-10-14T12:34:25.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf78d2b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf741615f0 con 0x7faf740cdbc0 2023-10-14T12:34:25.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf78d2b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf741618d0 con 0x7faf7406e290 2023-10-14T12:34:25.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf72d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf7406e290 0x7faf7406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf7259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faf740ae1c0 0x7faf740cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54332/0 (socket says 172.21.15.72:54332) 2023-10-14T12:34:25.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf7259c700 1 -- 172.21.15.72:0/1625052998 learned_addr learned my addr 172.21.15.72:0/1625052998 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:25.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf72d9d700 1 --2- 172.21.15.72:0/1625052998 >> v2:172.21.15.72:3300/0 conn(0x7faf7406e290 0x7faf7406d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48036/0 (socket says 172.21.15.72:48036) 2023-10-14T12:34:25.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf72d9d700 1 -- 172.21.15.72:0/1625052998 >> v1:172.21.15.123:6789/0 conn(0x7faf740cdbc0 legacy=0x7faf7406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:25.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf72d9d700 1 -- 172.21.15.72:0/1625052998 >> v1:172.21.15.72:6789/0 conn(0x7faf740ae1c0 legacy=0x7faf740cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.699+0000 7faf72d9d700 1 -- 172.21.15.72:0/1625052998 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf74161bb0 con 0x7faf7406e290 2023-10-14T12:34:25.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf72d9d700 1 --2- 172.21.15.72:0/1625052998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 0x7faf7406d370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009d90 tx=0x7faf6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c5edd391ecb40 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:25.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf7159a700 1 -- 172.21.15.72:0/1625052998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00e070 con 0x7faf7406e290 2023-10-14T12:34:25.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf7159a700 1 -- 172.21.15.72:0/1625052998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c00bb90 con 0x7faf7406e290 2023-10-14T12:34:25.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf7159a700 1 -- 172.21.15.72:0/1625052998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c003a20 con 0x7faf7406e290 2023-10-14T12:34:25.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf78d2b700 1 -- 172.21.15.72:0/1625052998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 msgr2=0x7faf7406d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf78d2b700 1 --2- 172.21.15.72:0/1625052998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 0x7faf7406d370 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009d90 tx=0x7faf6c00b330 comp rx=0 tx=0).stop 2023-10-14T12:34:25.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf78d2b700 1 -- 172.21.15.72:0/1625052998 shutdown_connections 2023-10-14T12:34:25.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf78d2b700 1 --2- 172.21.15.72:0/1625052998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 0x7faf7406d370 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf78d2b700 1 -- 172.21.15.72:0/1625052998 >> 172.21.15.72:0/1625052998 conn(0x7faf740cfcd0 msgr2=0x7faf740d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:25.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf78d2b700 1 -- 172.21.15.72:0/1625052998 shutdown_connections 2023-10-14T12:34:25.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.700+0000 7faf78d2b700 1 -- 172.21.15.72:0/1625052998 wait complete. 2023-10-14T12:34:25.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.702+0000 7faf78d2b700 1 Processor -- start 2023-10-14T12:34:25.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.702+0000 7faf78d2b700 1 -- start start 2023-10-14T12:34:25.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.702+0000 7faf78d2b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 0x7faf740cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.702+0000 7faf78d2b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf740ae1c0 0x7faf74157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.702+0000 7faf78d2b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf740cdbc0 0x7faf74158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.702+0000 7faf78d2b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf741f4dd0 con 0x7faf7406e290 2023-10-14T12:34:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.702+0000 7faf78d2b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf741f50b0 con 0x7faf740cdbc0 2023-10-14T12:34:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.702+0000 7faf78d2b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf741f5390 con 0x7faf740ae1c0 2023-10-14T12:34:25.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf7259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 0x7faf740cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf7259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 0x7faf740cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48038/0 (socket says 172.21.15.72:48038) 2023-10-14T12:34:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf7259c700 1 -- 172.21.15.72:0/1249280292 learned_addr learned my addr 172.21.15.72:0/1249280292 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf72d9d700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf740cdbc0 0x7faf74158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf71d9b700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf740ae1c0 0x7faf74157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf7259c700 1 -- 172.21.15.72:0/1249280292 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf740ae1c0 msgr2=0x7faf74157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf7259c700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf740ae1c0 0x7faf74157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf7259c700 1 -- 172.21.15.72:0/1249280292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf740cdbc0 msgr2=0x7faf74158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf7259c700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf740cdbc0 0x7faf74158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf7259c700 1 -- 172.21.15.72:0/1249280292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c009a70 con 0x7faf7406e290 2023-10-14T12:34:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf72d9d700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf740cdbc0 0x7faf74158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf7259c700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 0x7faf740cb6d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c430 tx=0x7faf6800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf62ffd700 1 -- 172.21.15.72:0/1249280292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68005d70 con 0x7faf7406e290 2023-10-14T12:34:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf62ffd700 1 -- 172.21.15.72:0/1249280292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680070d0 con 0x7faf7406e290 2023-10-14T12:34:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf741f5670 con 0x7faf7406e290 2023-10-14T12:34:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf62ffd700 1 -- 172.21.15.72:0/1249280292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68007460 con 0x7faf7406e290 2023-10-14T12:34:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.703+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf741f3d40 con 0x7faf7406e290 2023-10-14T12:34:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.704+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf741f5860 con 0x7faf7406e290 2023-10-14T12:34:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.705+0000 7faf62ffd700 1 -- 172.21.15.72:0/1249280292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf680075c0 con 0x7faf7406e290 2023-10-14T12:34:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.705+0000 7faf62ffd700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5406af00 0x7faf5406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.705+0000 7faf62ffd700 1 -- 172.21.15.72:0/1249280292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf68088d50 con 0x7faf7406e290 2023-10-14T12:34:25.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.705+0000 7faf71d9b700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5406af00 0x7faf5406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.705+0000 7faf71d9b700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5406af00 0x7faf5406d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf740cbf20 tx=0x7faf64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:25.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.710+0000 7faf62ffd700 1 -- 172.21.15.72:0/1249280292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf6808c030 con 0x7faf7406e290 2023-10-14T12:34:25.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.916+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf741f4f10 con 0x7faf7406e290 2023-10-14T12:34:25.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.916+0000 7faf62ffd700 1 -- 172.21.15.72:0/1249280292 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7faf741f4f10 con 0x7faf7406e290 2023-10-14T12:34:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.918+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5406af00 msgr2=0x7faf5406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.918+0000 7faf78d2b700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5406af00 0x7faf5406d3c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf740cbf20 tx=0x7faf64009040 comp rx=0 tx=0).stop 2023-10-14T12:34:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.918+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 msgr2=0x7faf740cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.918+0000 7faf78d2b700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 0x7faf740cb6d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c430 tx=0x7faf6800c7f0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.918+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 shutdown_connections 2023-10-14T12:34:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.918+0000 7faf78d2b700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5406af00 0x7faf5406d3c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.918+0000 7faf78d2b700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf740cdbc0 0x7faf74158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.918+0000 7faf78d2b700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406e290 0x7faf740cb6d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.918+0000 7faf78d2b700 1 --2- 172.21.15.72:0/1249280292 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf740ae1c0 0x7faf74157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:25.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.919+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 >> 172.21.15.72:0/1249280292 conn(0x7faf740cfcd0 msgr2=0x7faf740d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.919+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 shutdown_connections 2023-10-14T12:34:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:25.919+0000 7faf78d2b700 1 -- 172.21.15.72:0/1249280292 wait complete. 2023-10-14T12:34:25.921 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-10-14T12:34:25.931 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-14T12:34:25.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:25.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-14T12:34:25.970 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:34:25.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:25.970 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T12:34:26.027 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:26.028 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:26.049 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:26.049 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:26.110 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:26.110 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:26.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.290+0000 7fa8f7797700 1 Processor -- start 2023-10-14T12:34:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.291+0000 7fa8f7797700 1 -- start start 2023-10-14T12:34:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.291+0000 7fa8f7797700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa8f006a820 0x7fa8f00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.291+0000 7fa8f7797700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8f015e7f0 0x7fa8f006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.291+0000 7fa8f7797700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8f00cfeb0 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f7797700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8f00ce410 con 0x7fa8f015e7f0 2023-10-14T12:34:26.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f7797700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f015ec70 con 0x7fa8f006a820 2023-10-14T12:34:26.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f4d32700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8f015e7f0 0x7fa8f006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f4d32700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8f015e7f0 0x7fa8f006ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48046/0 (socket says 172.21.15.72:48046) 2023-10-14T12:34:26.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f4d32700 1 -- 172.21.15.72:0/3270657952 learned_addr learned my addr 172.21.15.72:0/3270657952 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:26.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f5533700 1 --2- 172.21.15.72:0/3270657952 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa8f006a820 0x7fa8f00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f4d32700 1 -- 172.21.15.72:0/3270657952 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa8f006a820 msgr2=0x7fa8f00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:26.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f4d32700 1 --2- 172.21.15.72:0/3270657952 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa8f006a820 0x7fa8f00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f4d32700 1 -- 172.21.15.72:0/3270657952 >> v1:172.21.15.123:6789/0 conn(0x7fa8f00ca7d0 legacy=0x7fa8f0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f4d32700 1 -- 172.21.15.72:0/3270657952 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f00af9d0 con 0x7fa8f015e7f0 2023-10-14T12:34:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8f4d32700 1 --2- 172.21.15.72:0/3270657952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f015e7f0 0x7fa8f006ac00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0098f0 tx=0x7fa8ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dee60d2c2909d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8e7fff700 1 -- 172.21.15.72:0/3270657952 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec00b8a0 con 0x7fa8f015e7f0 2023-10-14T12:34:26.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8e7fff700 1 -- 172.21.15.72:0/3270657952 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec00ba00 con 0x7fa8f015e7f0 2023-10-14T12:34:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.292+0000 7fa8e7fff700 1 -- 172.21.15.72:0/3270657952 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec00bd90 con 0x7fa8f015e7f0 2023-10-14T12:34:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.293+0000 7fa8f7797700 1 -- 172.21.15.72:0/3270657952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f015e7f0 msgr2=0x7fa8f006ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.293+0000 7fa8f7797700 1 --2- 172.21.15.72:0/3270657952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f015e7f0 0x7fa8f006ac00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0098f0 tx=0x7fa8ec009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.293+0000 7fa8f7797700 1 -- 172.21.15.72:0/3270657952 shutdown_connections 2023-10-14T12:34:26.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.293+0000 7fa8f7797700 1 --2- 172.21.15.72:0/3270657952 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa8f006a820 0x7fa8f00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.293+0000 7fa8f7797700 1 --2- 172.21.15.72:0/3270657952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f015e7f0 0x7fa8f006ac00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.293+0000 7fa8f7797700 1 -- 172.21.15.72:0/3270657952 >> 172.21.15.72:0/3270657952 conn(0x7fa8f00d0180 msgr2=0x7fa8f00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:26.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.293+0000 7fa8f7797700 1 -- 172.21.15.72:0/3270657952 shutdown_connections 2023-10-14T12:34:26.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.293+0000 7fa8f7797700 1 -- 172.21.15.72:0/3270657952 wait complete. 2023-10-14T12:34:26.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.294+0000 7fa8f7797700 1 Processor -- start 2023-10-14T12:34:26.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.294+0000 7fa8f7797700 1 -- start start 2023-10-14T12:34:26.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f7797700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa8f006a820 0x7fa8f0155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f7797700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f00ca7d0 0x7fa8f0157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f7797700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8f015e7f0 0x7fa8f015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f7797700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f015d3e0 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f7797700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f01580c0 con 0x7fa8f015e7f0 2023-10-14T12:34:26.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f7797700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0155eb0 con 0x7fa8f006a820 2023-10-14T12:34:26.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f4d32700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f00ca7d0 0x7fa8f0157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f4d32700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f00ca7d0 0x7fa8f0157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48054/0 (socket says 172.21.15.72:48054) 2023-10-14T12:34:26.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f4d32700 1 -- 172.21.15.72:0/3314520015 learned_addr learned my addr 172.21.15.72:0/3314520015 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:26.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f4d32700 1 -- 172.21.15.72:0/3314520015 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa8f006a820 msgr2=0x7fa8f0155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f5d34700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8f015e7f0 0x7fa8f015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f4d32700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa8f006a820 0x7fa8f0155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f4d32700 1 -- 172.21.15.72:0/3314520015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8f015e7f0 msgr2=0x7fa8f015ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f4d32700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8f015e7f0 0x7fa8f015ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f4d32700 1 -- 172.21.15.72:0/3314520015 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec009550 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8f4d32700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f00ca7d0 0x7fa8f0157b80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec014040 tx=0x7fa8ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:26.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.295+0000 7fa8e5ffb700 1 -- 172.21.15.72:0/3314520015 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0036a0 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.296+0000 7fa8e5ffb700 1 -- 172.21.15.72:0/3314520015 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec01e070 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.296+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f0156190 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.296+0000 7fa8e5ffb700 1 -- 172.21.15.72:0/3314520015 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec003a40 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.296+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f0156750 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.297+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f004ebb0 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.297+0000 7fa8e5ffb700 1 -- 172.21.15.72:0/3314520015 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa8ec003ba0 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.298+0000 7fa8e5ffb700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa8d406af00 0x7fa8d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.298+0000 7fa8e5ffb700 1 -- 172.21.15.72:0/3314520015 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8ec020070 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.298+0000 7fa8f5533700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa8d406af00 0x7fa8d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.298+0000 7fa8f5533700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa8d406af00 0x7fa8d406d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00097f0 tx=0x7fa8e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:26.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.302+0000 7fa8e5ffb700 1 -- 172.21.15.72:0/3314520015 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8ec055bd0 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.491+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8f006b490 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.492+0000 7fa8e5ffb700 1 -- 172.21.15.72:0/3314520015 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18678 (secure 0 0 0) 0x7fa8ec0591f0 con 0x7fa8f00ca7d0 2023-10-14T12:34:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:26.493 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:20.981579+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:26.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.494+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa8d406af00 msgr2=0x7fa8d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.494+0000 7fa8f7797700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa8d406af00 0x7fa8d406d3c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00097f0 tx=0x7fa8e0008040 comp rx=0 tx=0).stop 2023-10-14T12:34:26.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f00ca7d0 msgr2=0x7fa8f0157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f00ca7d0 0x7fa8f0157b80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec014040 tx=0x7fa8ec004750 comp rx=0 tx=0).stop 2023-10-14T12:34:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 shutdown_connections 2023-10-14T12:34:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa8d406af00 0x7fa8d406d3c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8f015e7f0 0x7fa8f015ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa8f006a820 0x7fa8f0155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 --2- 172.21.15.72:0/3314520015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8f00ca7d0 0x7fa8f0157b80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 >> 172.21.15.72:0/3314520015 conn(0x7fa8f00d0180 msgr2=0x7fa8f00cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 shutdown_connections 2023-10-14T12:34:26.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.495+0000 7fa8f7797700 1 -- 172.21.15.72:0/3314520015 wait complete. 2023-10-14T12:34:26.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:26.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:26.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.631+0000 7f79b667c700 1 Processor -- start 2023-10-14T12:34:26.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.631+0000 7f79b667c700 1 -- start start 2023-10-14T12:34:26.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79b667c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79b00d1b90 0x7f79b00ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79b667c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b00cd590 con 0x7f79b00cb8d0 2023-10-14T12:34:26.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79b667c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b00cc150 con 0x7f79b00cee50 2023-10-14T12:34:26.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79b667c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b00b37e0 con 0x7f79b00d1b90 2023-10-14T12:34:26.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79af7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f79b00cb8d0 0x7f79b015c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54362/0 (socket says 172.21.15.72:54362) 2023-10-14T12:34:26.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79af7fe700 1 -- 172.21.15.72:0/2630173007 learned_addr learned my addr 172.21.15.72:0/2630173007 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:26.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79affff700 1 --2- 172.21.15.72:0/2630173007 >> v2:172.21.15.123:3300/0 conn(0x7f79b00d1b90 0x7f79b00ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023335104 0 0) 0x7f79b00cd590 con 0x7f79b00cb8d0 2023-10-14T12:34:26.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79980035b0 con 0x7f79b00cb8d0 2023-10-14T12:34:26.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513382481 0 0) 0x7f79980035b0 con 0x7f79b00cb8d0 2023-10-14T12:34:26.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 >> v2:172.21.15.123:3300/0 conn(0x7f79b00d1b90 msgr2=0x7f79b00ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:26.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 --2- 172.21.15.72:0/2630173007 >> v2:172.21.15.123:3300/0 conn(0x7f79b00d1b90 0x7f79b00ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 >> v1:172.21.15.123:6789/0 conn(0x7f79b00cee50 legacy=0x7f79b00d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00cd7f0 con 0x7f79b00cb8d0 2023-10-14T12:34:26.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f79a0001670 con 0x7f79b00cb8d0 2023-10-14T12:34:26.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 >> v1:172.21.15.72:6789/0 conn(0x7f79b00cb8d0 legacy=0x7f79b015c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7998003a00 0x7f7998003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7998004400 0x7f79980048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f799800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00b37e0 con 0x7f7998005170 2023-10-14T12:34:26.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799800c0b0 con 0x7f7998004400 2023-10-14T12:34:26.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799800c270 con 0x7f7998003a00 2023-10-14T12:34:26.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79b4c19700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f799800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.632+0000 7f79af7fe700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7998004400 0x7f79980048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79affff700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7998003a00 0x7f7998003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b4c19700 1 -- 172.21.15.72:0/2630173007 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7998003a00 msgr2=0x7f7998003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:26.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b4c19700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7998003a00 0x7f7998003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b4c19700 1 -- 172.21.15.72:0/2630173007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7998004400 msgr2=0x7f79980048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:26.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b4c19700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7998004400 0x7f79980048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b4c19700 1 -- 172.21.15.72:0/2630173007 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79980035b0 con 0x7f7998005170 2023-10-14T12:34:26.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b4c19700 1 -- 172.21.15.72:0/2630173007 reap_dead start 2023-10-14T12:34:26.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b4c19700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f799800ba10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c260 tx=0x7f7998005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4d158a404f8f39 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:26.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8001e70 con 0x7f7998005170 2023-10-14T12:34:26.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800ce00 con 0x7f7998005170 2023-10-14T12:34:26.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79aeffd700 1 -- 172.21.15.72:0/2630173007 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a8003c40 con 0x7f7998005170 2023-10-14T12:34:26.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b667c700 1 -- 172.21.15.72:0/2630173007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 msgr2=0x7f799800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b667c700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f799800ba10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79a800c260 tx=0x7f7998005880 comp rx=0 tx=0).stop 2023-10-14T12:34:26.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b667c700 1 -- 172.21.15.72:0/2630173007 shutdown_connections 2023-10-14T12:34:26.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.633+0000 7f79b667c700 1 --2- 172.21.15.72:0/2630173007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f799800ba10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.634+0000 7f79b667c700 1 -- 172.21.15.72:0/2630173007 >> 172.21.15.72:0/2630173007 conn(0x7f79b006a820 msgr2=0x7f79b006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:26.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.634+0000 7f79b667c700 1 -- 172.21.15.72:0/2630173007 shutdown_connections 2023-10-14T12:34:26.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.634+0000 7f79b667c700 1 -- 172.21.15.72:0/2630173007 wait complete. 2023-10-14T12:34:26.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.635+0000 7f79b667c700 1 Processor -- start 2023-10-14T12:34:26.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.635+0000 7f79b667c700 1 -- start start 2023-10-14T12:34:26.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79b667c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f79b00c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79b667c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b00c8350 0x7f79b0151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79b667c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b0151940 0x7f79b014a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79b667c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b014f650 con 0x7f7998005170 2023-10-14T12:34:26.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79b667c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b0151dc0 con 0x7f79b0151940 2023-10-14T12:34:26.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79b667c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b014ea80 con 0x7f79b00c8350 2023-10-14T12:34:26.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79affff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f79b00c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79affff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f79b00c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48072/0 (socket says 172.21.15.72:48072) 2023-10-14T12:34:26.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79affff700 1 -- 172.21.15.72:0/249319466 learned_addr learned my addr 172.21.15.72:0/249319466 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:26.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79b4c19700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b0151940 0x7f79b014a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79af7fe700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b00c8350 0x7f79b0151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79affff700 1 -- 172.21.15.72:0/249319466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b00c8350 msgr2=0x7f79b0151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79affff700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b00c8350 0x7f79b0151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79affff700 1 -- 172.21.15.72:0/249319466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b0151940 msgr2=0x7f79b014a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79affff700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b0151940 0x7f79b014a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79affff700 1 -- 172.21.15.72:0/249319466 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b014ed20 con 0x7f7998005170 2023-10-14T12:34:26.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79affff700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f79b00c7680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f79a40119d0 tx=0x7f79a4011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:26.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79acff9700 1 -- 172.21.15.72:0/249319466 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400f940 con 0x7f7998005170 2023-10-14T12:34:26.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79acff9700 1 -- 172.21.15.72:0/249319466 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a400faa0 con 0x7f7998005170 2023-10-14T12:34:26.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b014f000 con 0x7f7998005170 2023-10-14T12:34:26.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79acff9700 1 -- 172.21.15.72:0/249319466 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400fe30 con 0x7f7998005170 2023-10-14T12:34:26.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.636+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b00c7bc0 con 0x7f7998005170 2023-10-14T12:34:26.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.637+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b004ebb0 con 0x7f7998005170 2023-10-14T12:34:26.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.638+0000 7f79acff9700 1 -- 172.21.15.72:0/249319466 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79a4014440 con 0x7f7998005170 2023-10-14T12:34:26.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.638+0000 7f79acff9700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f799c06af00 0x7f799c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.638+0000 7f79acff9700 1 -- 172.21.15.72:0/249319466 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f79a408a0d0 con 0x7f7998005170 2023-10-14T12:34:26.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.638+0000 7f79af7fe700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f799c06af00 0x7f799c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.638+0000 7f79af7fe700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f799c06af00 0x7f799c06d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f79b01f3fd0 tx=0x7f79a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:26.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.642+0000 7f79acff9700 1 -- 172.21.15.72:0/249319466 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79a4054dc0 con 0x7f7998005170 2023-10-14T12:34:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.837+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79b015fe20 con 0x7f7998005170 2023-10-14T12:34:26.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.838+0000 7f79acff9700 1 -- 172.21.15.72:0/249319466 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79a40583e0 con 0x7f7998005170 2023-10-14T12:34:26.838 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:26.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f799c06af00 msgr2=0x7f799c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f799c06af00 0x7f799c06d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f79b01f3fd0 tx=0x7f79a0009040 comp rx=0 tx=0).stop 2023-10-14T12:34:26.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 msgr2=0x7f79b00c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f79b00c7680 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f79a40119d0 tx=0x7f79a4011d90 comp rx=0 tx=0).stop 2023-10-14T12:34:26.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 shutdown_connections 2023-10-14T12:34:26.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f799c06af00 0x7f799c06d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b0151940 0x7f79b014a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7998005170 0x7f79b00c7680 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 --2- 172.21.15.72:0/249319466 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f79b00c8350 0x7f79b0151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 >> 172.21.15.72:0/249319466 conn(0x7f79b006a820 msgr2=0x7f79b015e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:26.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 shutdown_connections 2023-10-14T12:34:26.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.840+0000 7f79b667c700 1 -- 172.21.15.72:0/249319466 wait complete. 2023-10-14T12:34:26.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:26.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.975+0000 7f1269875700 1 Processor -- start 2023-10-14T12:34:26.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.975+0000 7f1269875700 1 -- start start 2023-10-14T12:34:26.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.976+0000 7f1269875700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12640ce540 0x7f1264071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.976+0000 7f1269875700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f12640cd800 0x7f12640720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.976+0000 7f1269875700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126406a9c0 con 0x7f126415d660 2023-10-14T12:34:26.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.976+0000 7f1269875700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1264162210 con 0x7f12640ce540 2023-10-14T12:34:26.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.976+0000 7f1269875700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126406ac60 con 0x7f12640cd800 2023-10-14T12:34:26.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.976+0000 7f12627fc700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12640ce540 0x7f1264071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.976+0000 7f1262ffd700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f126415d660 0x7f12640cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:52578/0 (socket says 172.21.15.72:52578) 2023-10-14T12:34:26.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f1262ffd700 1 -- 172.21.15.72:0/1491536786 learned_addr learned my addr 172.21.15.72:0/1491536786 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:26.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f12637fe700 1 --2- 172.21.15.72:0/1491536786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f12640cd800 0x7f12640720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f12637fe700 1 -- 172.21.15.72:0/1491536786 >> v2:172.21.15.123:3300/0 conn(0x7f12640ce540 msgr2=0x7f1264071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:26.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f12637fe700 1 --2- 172.21.15.72:0/1491536786 >> v2:172.21.15.123:3300/0 conn(0x7f12640ce540 0x7f1264071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f12637fe700 1 -- 172.21.15.72:0/1491536786 >> v1:172.21.15.123:6789/0 conn(0x7f126415d660 legacy=0x7f12640cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f12637fe700 1 -- 172.21.15.72:0/1491536786 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126406af40 con 0x7f12640cd800 2023-10-14T12:34:26.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f12627fc700 1 --2- 172.21.15.72:0/1491536786 >> v2:172.21.15.123:3300/0 conn(0x7f12640ce540 0x7f1264071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:26.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f12637fe700 1 --2- 172.21.15.72:0/1491536786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f12640cd800 0x7f12640720a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f125c009d90 tx=0x7f125c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fea8c963fc01695 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:26.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f1261ffb700 1 -- 172.21.15.72:0/1491536786 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00e070 con 0x7f12640cd800 2023-10-14T12:34:26.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f1261ffb700 1 -- 172.21.15.72:0/1491536786 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c00bb20 con 0x7f12640cd800 2023-10-14T12:34:26.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.977+0000 7f1261ffb700 1 -- 172.21.15.72:0/1491536786 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c012430 con 0x7f12640cd800 2023-10-14T12:34:26.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.978+0000 7f1269875700 1 -- 172.21.15.72:0/1491536786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f12640cd800 msgr2=0x7f12640720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.978+0000 7f1269875700 1 --2- 172.21.15.72:0/1491536786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f12640cd800 0x7f12640720a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f125c009d90 tx=0x7f125c00b330 comp rx=0 tx=0).stop 2023-10-14T12:34:26.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.978+0000 7f1269875700 1 -- 172.21.15.72:0/1491536786 shutdown_connections 2023-10-14T12:34:26.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.978+0000 7f1269875700 1 --2- 172.21.15.72:0/1491536786 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f12640cd800 0x7f12640720a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.978+0000 7f1269875700 1 --2- 172.21.15.72:0/1491536786 >> v2:172.21.15.123:3300/0 conn(0x7f12640ce540 0x7f1264071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.978+0000 7f1269875700 1 -- 172.21.15.72:0/1491536786 >> 172.21.15.72:0/1491536786 conn(0x7f12640ccce0 msgr2=0x7f12640cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:26.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.978+0000 7f1269875700 1 -- 172.21.15.72:0/1491536786 shutdown_connections 2023-10-14T12:34:26.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.978+0000 7f1269875700 1 -- 172.21.15.72:0/1491536786 wait complete. 2023-10-14T12:34:26.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.979+0000 7f1269875700 1 Processor -- start 2023-10-14T12:34:26.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.979+0000 7f1269875700 1 -- start start 2023-10-14T12:34:26.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1269875700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12640cd800 0x7f12641537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1269875700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12640ce540 0x7f1264154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1269875700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f126415d660 0x7f1264156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1269875700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12641551d0 con 0x7f12640cd800 2023-10-14T12:34:26.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1269875700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12641554b0 con 0x7f12640ce540 2023-10-14T12:34:26.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1269875700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1264155790 con 0x7f126415d660 2023-10-14T12:34:26.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1262ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12640cd800 0x7f12641537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1262ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12640cd800 0x7f12641537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48086/0 (socket says 172.21.15.72:48086) 2023-10-14T12:34:26.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1262ffd700 1 -- 172.21.15.72:0/2566717788 learned_addr learned my addr 172.21.15.72:0/2566717788 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:26.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f12627fc700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12640ce540 0x7f1264154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f12637fe700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f126415d660 0x7f1264156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1262ffd700 1 -- 172.21.15.72:0/2566717788 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f126415d660 msgr2=0x7f1264156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1262ffd700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f126415d660 0x7f1264156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1262ffd700 1 -- 172.21.15.72:0/2566717788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12640ce540 msgr2=0x7f1264154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:26.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1262ffd700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12640ce540 0x7f1264154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:26.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.980+0000 7f1262ffd700 1 -- 172.21.15.72:0/2566717788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540094a0 con 0x7f12640cd800 2023-10-14T12:34:26.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.981+0000 7f1262ffd700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12640cd800 0x7f12641537a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f125800c490 tx=0x7f125800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:26.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.981+0000 7f124bfff700 1 -- 172.21.15.72:0/2566717788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125800cea0 con 0x7f12640cd800 2023-10-14T12:34:26.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.981+0000 7f124bfff700 1 -- 172.21.15.72:0/2566717788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1258005d70 con 0x7f12640cd800 2023-10-14T12:34:26.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.981+0000 7f124bfff700 1 -- 172.21.15.72:0/2566717788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12580072f0 con 0x7f12640cd800 2023-10-14T12:34:26.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.981+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c009a70 con 0x7f12640cd800 2023-10-14T12:34:26.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.981+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1264155d50 con 0x7f12640cd800 2023-10-14T12:34:26.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.982+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126404ebb0 con 0x7f12640cd800 2023-10-14T12:34:26.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.982+0000 7f124bfff700 1 -- 172.21.15.72:0/2566717788 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1258007450 con 0x7f12640cd800 2023-10-14T12:34:26.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.983+0000 7f124bfff700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125006af00 0x7f125006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:26.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.983+0000 7f124bfff700 1 -- 172.21.15.72:0/2566717788 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1258088c90 con 0x7f12640cd800 2023-10-14T12:34:26.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.983+0000 7f12627fc700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125006af00 0x7f125006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:26.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.983+0000 7f12627fc700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125006af00 0x7f125006d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f12641f6c70 tx=0x7f1254009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:26.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:26.987+0000 7f124bfff700 1 -- 172.21.15.72:0/2566717788 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1258053a10 con 0x7f12640cd800 2023-10-14T12:34:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.176+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12640d0040 con 0x7f12640cd800 2023-10-14T12:34:27.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.176+0000 7f124bfff700 1 -- 172.21.15.72:0/2566717788 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12580170a0 con 0x7f12640cd800 2023-10-14T12:34:27.177 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125006af00 msgr2=0x7f125006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125006af00 0x7f125006d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f12641f6c70 tx=0x7f1254009210 comp rx=0 tx=0).stop 2023-10-14T12:34:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12640cd800 msgr2=0x7f12641537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12640cd800 0x7f12641537a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f125800c490 tx=0x7f125800c7a0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 shutdown_connections 2023-10-14T12:34:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f125006af00 0x7f125006d3c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f126415d660 0x7f1264156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12640cd800 0x7f12641537a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 --2- 172.21.15.72:0/2566717788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12640ce540 0x7f1264154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 >> 172.21.15.72:0/2566717788 conn(0x7f12640ccce0 msgr2=0x7f126406ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:27.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 shutdown_connections 2023-10-14T12:34:27.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.178+0000 7f1269875700 1 -- 172.21.15.72:0/2566717788 wait complete. 2023-10-14T12:34:27.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:27.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.314+0000 7fe7e3262700 1 Processor -- start 2023-10-14T12:34:27.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.314+0000 7fe7e3262700 1 -- start start 2023-10-14T12:34:27.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7e3262700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7dc15b470 0x7fe7dc0b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7e3262700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7dc0d04e0 0x7fe7dc15f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7e3262700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 0x7fe7dc0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7e3262700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc0b36f0 con 0x7fe7dc0d04e0 2023-10-14T12:34:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7e3262700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc15fe40 con 0x7fe7dc15b470 2023-10-14T12:34:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7e3262700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0cb970 con 0x7fe7dc0b2d20 2023-10-14T12:34:27.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7dc0d04e0 0x7fe7dc15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7dbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7dc0d04e0 0x7fe7dc15f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48096/0 (socket says 172.21.15.72:48096) 2023-10-14T12:34:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7dbfff700 1 -- 172.21.15.72:0/1927129317 learned_addr learned my addr 172.21.15.72:0/1927129317 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7e0ffe700 1 --2- 172.21.15.72:0/1927129317 >> v2:172.21.15.123:3300/0 conn(0x7fe7dc15b470 0x7fe7dc0b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7e17ff700 1 --2- 172.21.15.72:0/1927129317 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 0x7fe7dc0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.315+0000 7fe7dbfff700 1 -- 172.21.15.72:0/1927129317 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 msgr2=0x7fe7dc0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7dbfff700 1 --2- 172.21.15.72:0/1927129317 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 0x7fe7dc0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7dbfff700 1 -- 172.21.15.72:0/1927129317 >> v2:172.21.15.123:3300/0 conn(0x7fe7dc15b470 msgr2=0x7fe7dc0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7dbfff700 1 --2- 172.21.15.72:0/1927129317 >> v2:172.21.15.123:3300/0 conn(0x7fe7dc15b470 0x7fe7dc0b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7dbfff700 1 -- 172.21.15.72:0/1927129317 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0cbc50 con 0x7fe7dc0d04e0 2023-10-14T12:34:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7e17ff700 1 --2- 172.21.15.72:0/1927129317 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 0x7fe7dc0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:27.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7dbfff700 1 --2- 172.21.15.72:0/1927129317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc0d04e0 0x7fe7dc15f900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0cdc60 tx=0x7fe7d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6e06dd0f5216d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7db7fe700 1 -- 172.21.15.72:0/1927129317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0011830 con 0x7fe7dc0d04e0 2023-10-14T12:34:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7db7fe700 1 -- 172.21.15.72:0/1927129317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d0011990 con 0x7fe7dc0d04e0 2023-10-14T12:34:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7db7fe700 1 -- 172.21.15.72:0/1927129317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0011d20 con 0x7fe7dc0d04e0 2023-10-14T12:34:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7e3262700 1 -- 172.21.15.72:0/1927129317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc0d04e0 msgr2=0x7fe7dc15f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7e3262700 1 --2- 172.21.15.72:0/1927129317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc0d04e0 0x7fe7dc15f900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc0cdc60 tx=0x7fe7d0009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7e3262700 1 -- 172.21.15.72:0/1927129317 shutdown_connections 2023-10-14T12:34:27.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.316+0000 7fe7e3262700 1 --2- 172.21.15.72:0/1927129317 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 0x7fe7dc0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.317+0000 7fe7e3262700 1 --2- 172.21.15.72:0/1927129317 >> v2:172.21.15.123:3300/0 conn(0x7fe7dc15b470 0x7fe7dc0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.317+0000 7fe7e3262700 1 --2- 172.21.15.72:0/1927129317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc0d04e0 0x7fe7dc15f900 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.317+0000 7fe7e3262700 1 -- 172.21.15.72:0/1927129317 >> 172.21.15.72:0/1927129317 conn(0x7fe7dc06a820 msgr2=0x7fe7dc06ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:27.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.317+0000 7fe7e3262700 1 -- 172.21.15.72:0/1927129317 shutdown_connections 2023-10-14T12:34:27.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.317+0000 7fe7e3262700 1 -- 172.21.15.72:0/1927129317 wait complete. 2023-10-14T12:34:27.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.318+0000 7fe7e3262700 1 Processor -- start 2023-10-14T12:34:27.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.318+0000 7fe7e3262700 1 -- start start 2023-10-14T12:34:27.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.319+0000 7fe7e3262700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 0x7fe7dc1528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.319+0000 7fe7e3262700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7dc0d04e0 0x7fe7dc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.319+0000 7fe7e3262700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc15b470 0x7fe7dc155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.319+0000 7fe7e3262700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc152f80 con 0x7fe7dc15b470 2023-10-14T12:34:27.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.319+0000 7fe7e3262700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc153260 con 0x7fe7dc0d04e0 2023-10-14T12:34:27.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.319+0000 7fe7e3262700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc153540 con 0x7fe7dc0b2d20 2023-10-14T12:34:27.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.319+0000 7fe7e17ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc15b470 0x7fe7dc155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.319+0000 7fe7e17ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc15b470 0x7fe7dc155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48104/0 (socket says 172.21.15.72:48104) 2023-10-14T12:34:27.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.319+0000 7fe7e17ff700 1 -- 172.21.15.72:0/416702170 learned_addr learned my addr 172.21.15.72:0/416702170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:27.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7e0ffe700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 0x7fe7dc1528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7dbfff700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7dc0d04e0 0x7fe7dc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7e17ff700 1 -- 172.21.15.72:0/416702170 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 msgr2=0x7fe7dc1528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7e17ff700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 0x7fe7dc1528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7e17ff700 1 -- 172.21.15.72:0/416702170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7dc0d04e0 msgr2=0x7fe7dc154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7e17ff700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7dc0d04e0 0x7fe7dc154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7e17ff700 1 -- 172.21.15.72:0/416702170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d0009550 con 0x7fe7dc15b470 2023-10-14T12:34:27.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7e17ff700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc15b470 0x7fe7dc155040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4007db0 tx=0x7fe7d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7d97fa700 1 -- 172.21.15.72:0/416702170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400ddd0 con 0x7fe7dc15b470 2023-10-14T12:34:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7d97fa700 1 -- 172.21.15.72:0/416702170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d400f040 con 0x7fe7dc15b470 2023-10-14T12:34:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7d97fa700 1 -- 172.21.15.72:0/416702170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4003c60 con 0x7fe7dc15b470 2023-10-14T12:34:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc153820 con 0x7fe7dc15b470 2023-10-14T12:34:27.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.320+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc154020 con 0x7fe7dc15b470 2023-10-14T12:34:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.321+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc153d40 con 0x7fe7dc15b470 2023-10-14T12:34:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.321+0000 7fe7d97fa700 1 -- 172.21.15.72:0/416702170 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe7d4004030 con 0x7fe7dc15b470 2023-10-14T12:34:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.322+0000 7fe7d97fa700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7c806af00 0x7fe7c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.322+0000 7fe7d97fa700 1 -- 172.21.15.72:0/416702170 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe7d4089a80 con 0x7fe7dc15b470 2023-10-14T12:34:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.322+0000 7fe7e0ffe700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7c806af00 0x7fe7c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.322+0000 7fe7e0ffe700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7c806af00 0x7fe7c806d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009ab0 tx=0x7fe7cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:27.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.326+0000 7fe7d97fa700 1 -- 172.21.15.72:0/416702170 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7dc153d40 con 0x7fe7dc15b470 2023-10-14T12:34:27.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.514+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7dc153d40 con 0x7fe7dc15b470 2023-10-14T12:34:27.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.515+0000 7fe7d97fa700 1 -- 172.21.15.72:0/416702170 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe7dc153d40 con 0x7fe7dc15b470 2023-10-14T12:34:27.516 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7c806af00 msgr2=0x7fe7c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7c806af00 0x7fe7c806d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009ab0 tx=0x7fe7cc008040 comp rx=0 tx=0).stop 2023-10-14T12:34:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc15b470 msgr2=0x7fe7dc155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc15b470 0x7fe7dc155040 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4007db0 tx=0x7fe7d400d3b0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 shutdown_connections 2023-10-14T12:34:27.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fe7c806af00 0x7fe7c806d3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7dc15b470 0x7fe7dc155040 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fe7dc0b2d20 0x7fe7dc1528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 --2- 172.21.15.72:0/416702170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7dc0d04e0 0x7fe7dc154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 >> 172.21.15.72:0/416702170 conn(0x7fe7dc06a820 msgr2=0x7fe7dc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:27.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 shutdown_connections 2023-10-14T12:34:27.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.517+0000 7fe7e3262700 1 -- 172.21.15.72:0/416702170 wait complete. 2023-10-14T12:34:27.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:27.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.654+0000 7f731e03a700 1 Processor -- start 2023-10-14T12:34:27.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.654+0000 7f731e03a700 1 -- start start 2023-10-14T12:34:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f731e03a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f731806a820 0x7f731806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f731e03a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f73180717b0 0x7f7318071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f731e03a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73180cad30 con 0x7f7318072170 2023-10-14T12:34:27.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f731e03a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180ca7b0 con 0x7f731806a820 2023-10-14T12:34:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f731e03a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180cb1c0 con 0x7f73180717b0 2023-10-14T12:34:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f73177fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f731806a820 0x7f731806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f7317fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7318072170 0x7f731815ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54412/0 (socket says 172.21.15.72:54412) 2023-10-14T12:34:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f7317fff700 1 -- 172.21.15.72:0/2649333484 learned_addr learned my addr 172.21.15.72:0/2649333484 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:27.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f73177fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f731806a820 0x7f731806ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48108/0 (socket says 172.21.15.72:48108) 2023-10-14T12:34:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f7316ffd700 1 --2- 172.21.15.72:0/2649333484 >> v2:172.21.15.123:3300/0 conn(0x7f73180717b0 0x7f7318071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f73177fe700 1 -- 172.21.15.72:0/2649333484 >> v2:172.21.15.123:3300/0 conn(0x7f73180717b0 msgr2=0x7f7318071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f73177fe700 1 --2- 172.21.15.72:0/2649333484 >> v2:172.21.15.123:3300/0 conn(0x7f73180717b0 0x7f7318071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f73177fe700 1 -- 172.21.15.72:0/2649333484 >> v1:172.21.15.72:6789/0 conn(0x7f7318072170 legacy=0x7f731815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f73177fe700 1 -- 172.21.15.72:0/2649333484 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73180725e0 con 0x7f731806a820 2023-10-14T12:34:27.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f73167fc700 1 -- 172.21.15.72:0/2649333484 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750339339 0 0) 0x7f73180cad30 con 0x7f7318072170 2023-10-14T12:34:27.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f73177fe700 1 --2- 172.21.15.72:0/2649333484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731806a820 0x7f731806ac00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7318070360 tx=0x7f7308009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea13fb0de345d3c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:27.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.655+0000 7f73167fc700 1 -- 172.21.15.72:0/2649333484 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308011830 con 0x7f731806a820 2023-10-14T12:34:27.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f73167fc700 1 -- 172.21.15.72:0/2649333484 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7308011990 con 0x7f731806a820 2023-10-14T12:34:27.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f73167fc700 1 -- 172.21.15.72:0/2649333484 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7308011d20 con 0x7f731806a820 2023-10-14T12:34:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f731e03a700 1 -- 172.21.15.72:0/2649333484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731806a820 msgr2=0x7f731806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f731e03a700 1 --2- 172.21.15.72:0/2649333484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731806a820 0x7f731806ac00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7318070360 tx=0x7f7308009b20 comp rx=0 tx=0).stop 2023-10-14T12:34:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f731e03a700 1 -- 172.21.15.72:0/2649333484 shutdown_connections 2023-10-14T12:34:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f731e03a700 1 --2- 172.21.15.72:0/2649333484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f731806a820 0x7f731806ac00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f731e03a700 1 --2- 172.21.15.72:0/2649333484 >> v2:172.21.15.123:3300/0 conn(0x7f73180717b0 0x7f7318071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f731e03a700 1 -- 172.21.15.72:0/2649333484 >> 172.21.15.72:0/2649333484 conn(0x7f73180ccbe0 msgr2=0x7f73180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f731e03a700 1 -- 172.21.15.72:0/2649333484 shutdown_connections 2023-10-14T12:34:27.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.656+0000 7f731e03a700 1 -- 172.21.15.72:0/2649333484 wait complete. 2023-10-14T12:34:27.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.658+0000 7f731e03a700 1 Processor -- start 2023-10-14T12:34:27.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.658+0000 7f731e03a700 1 -- start start 2023-10-14T12:34:27.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f731e03a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f731806a820 0x7f73180a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f731e03a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f73180717b0 0x7f7318157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f731e03a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7318072170 0x7f73180b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f731e03a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73180a8850 con 0x7f7318072170 2023-10-14T12:34:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f731e03a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73180a8b30 con 0x7f731806a820 2023-10-14T12:34:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f731e03a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73180a8e10 con 0x7f73180717b0 2023-10-14T12:34:27.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7317fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7318072170 0x7f73180b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7317fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7318072170 0x7f73180b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48118/0 (socket says 172.21.15.72:48118) 2023-10-14T12:34:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7317fff700 1 -- 172.21.15.72:0/1408611222 learned_addr learned my addr 172.21.15.72:0/1408611222 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f73177fe700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f731806a820 0x7f73180a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7316ffd700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f73180717b0 0x7f7318157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7317fff700 1 -- 172.21.15.72:0/1408611222 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f73180717b0 msgr2=0x7f7318157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7317fff700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f73180717b0 0x7f7318157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7317fff700 1 -- 172.21.15.72:0/1408611222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f731806a820 msgr2=0x7f73180a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7317fff700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f731806a820 0x7f73180a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7317fff700 1 -- 172.21.15.72:0/1408611222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73080094a0 con 0x7f7318072170 2023-10-14T12:34:27.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7316ffd700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f73180717b0 0x7f7318157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:27.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.659+0000 7f7317fff700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7318072170 0x7f73180b1360 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f731000cba0 tx=0x7f731000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:27.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.660+0000 7f730ffff700 1 -- 172.21.15.72:0/1408611222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731000ab80 con 0x7f7318072170 2023-10-14T12:34:27.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.660+0000 7f730ffff700 1 -- 172.21.15.72:0/1408611222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731000ad00 con 0x7f7318072170 2023-10-14T12:34:27.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.660+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73180a90f0 con 0x7f7318072170 2023-10-14T12:34:27.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.660+0000 7f730ffff700 1 -- 172.21.15.72:0/1408611222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310007310 con 0x7f7318072170 2023-10-14T12:34:27.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.660+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73180a9e30 con 0x7f7318072170 2023-10-14T12:34:27.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.661+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73180a9610 con 0x7f7318072170 2023-10-14T12:34:27.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.661+0000 7f730ffff700 1 -- 172.21.15.72:0/1408611222 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7310007470 con 0x7f7318072170 2023-10-14T12:34:27.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.661+0000 7f730ffff700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f72f806af00 0x7f72f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.662+0000 7f73177fe700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f72f806af00 0x7f72f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:27.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.662+0000 7f730ffff700 1 -- 172.21.15.72:0/1408611222 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f73100897c0 con 0x7f7318072170 2023-10-14T12:34:27.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.662+0000 7f73177fe700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f72f806af00 0x7f72f806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f73080090b0 tx=0x7f7308008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:27.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.666+0000 7f730ffff700 1 -- 172.21.15.72:0/1408611222 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73180a9610 con 0x7f7318072170 2023-10-14T12:34:27.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.859+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f73180a9610 con 0x7f7318072170 2023-10-14T12:34:27.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.859+0000 7f730ffff700 1 -- 172.21.15.72:0/1408611222 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7310018020 con 0x7f7318072170 2023-10-14T12:34:27.860 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:27.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f72f806af00 msgr2=0x7f72f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f72f806af00 0x7f72f806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f73080090b0 tx=0x7f7308008030 comp rx=0 tx=0).stop 2023-10-14T12:34:27.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7318072170 msgr2=0x7f73180b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:27.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7318072170 0x7f73180b1360 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f731000cba0 tx=0x7f731000cf60 comp rx=0 tx=0).stop 2023-10-14T12:34:27.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 shutdown_connections 2023-10-14T12:34:27.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f72f806af00 0x7f72f806d3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7318072170 0x7f73180b1360 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f731806a820 0x7f73180a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 --2- 172.21.15.72:0/1408611222 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f73180717b0 0x7f7318157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 >> 172.21.15.72:0/1408611222 conn(0x7f73180ccbe0 msgr2=0x7f73180c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 shutdown_connections 2023-10-14T12:34:27.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.862+0000 7f731e03a700 1 -- 172.21.15.72:0/1408611222 wait complete. 2023-10-14T12:34:27.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:34:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.996+0000 7f9f4148a700 1 Processor -- start 2023-10-14T12:34:27.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.996+0000 7f9f4148a700 1 -- start start 2023-10-14T12:34:27.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.996+0000 7f9f4148a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f3c143c50 0x7f9f3c0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.996+0000 7f9f4148a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 0x7f9f3c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:27.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.996+0000 7f9f4148a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c0ccb90 con 0x7f9f3c15ec60 2023-10-14T12:34:27.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.996+0000 7f9f4148a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3c0cce70 con 0x7f9f3c143c50 2023-10-14T12:34:27.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.996+0000 7f9f4148a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0cb0c0 con 0x7f9f3c0c5730 2023-10-14T12:34:28.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3b7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 0x7f9f3c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f3c143c50 0x7f9f3c0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3a7fc700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9f3c15ec60 0x7f9f3c0c5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:52620/0 (socket says 172.21.15.72:52620) 2023-10-14T12:34:28.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3a7fc700 1 -- 172.21.15.72:0/3920384773 learned_addr learned my addr 172.21.15.72:0/3920384773 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:28.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3b7fe700 1 -- 172.21.15.72:0/3920384773 >> v2:172.21.15.123:3300/0 conn(0x7f9f3c143c50 msgr2=0x7f9f3c0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:28.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3b7fe700 1 --2- 172.21.15.72:0/3920384773 >> v2:172.21.15.123:3300/0 conn(0x7f9f3c143c50 0x7f9f3c0ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3b7fe700 1 -- 172.21.15.72:0/3920384773 >> v1:172.21.15.123:6789/0 conn(0x7f9f3c15ec60 legacy=0x7f9f3c0c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3b7fe700 1 -- 172.21.15.72:0/3920384773 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0cb3a0 con 0x7f9f3c0c5730 2023-10-14T12:34:28.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f39ffb700 1 -- 172.21.15.72:0/3920384773 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612599492 0 0) 0x7f9f3c0ccb90 con 0x7f9f3c15ec60 2023-10-14T12:34:28.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3affd700 1 --2- 172.21.15.72:0/3920384773 >> v2:172.21.15.123:3300/0 conn(0x7f9f3c143c50 0x7f9f3c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:28.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.997+0000 7f9f3b7fe700 1 --2- 172.21.15.72:0/3920384773 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 0x7f9f3c0cd300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009d90 tx=0x7f9f3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41419e2b7111877 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f39ffb700 1 -- 172.21.15.72:0/3920384773 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3400e070 con 0x7f9f3c0c5730 2023-10-14T12:34:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f39ffb700 1 -- 172.21.15.72:0/3920384773 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3400bb20 con 0x7f9f3c0c5730 2023-10-14T12:34:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f39ffb700 1 -- 172.21.15.72:0/3920384773 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34012430 con 0x7f9f3c0c5730 2023-10-14T12:34:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f4148a700 1 -- 172.21.15.72:0/3920384773 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 msgr2=0x7f9f3c0cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f4148a700 1 --2- 172.21.15.72:0/3920384773 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 0x7f9f3c0cd300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009d90 tx=0x7f9f3400b330 comp rx=0 tx=0).stop 2023-10-14T12:34:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f4148a700 1 -- 172.21.15.72:0/3920384773 shutdown_connections 2023-10-14T12:34:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f4148a700 1 --2- 172.21.15.72:0/3920384773 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 0x7f9f3c0cd300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f4148a700 1 --2- 172.21.15.72:0/3920384773 >> v2:172.21.15.123:3300/0 conn(0x7f9f3c143c50 0x7f9f3c0ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f4148a700 1 -- 172.21.15.72:0/3920384773 >> 172.21.15.72:0/3920384773 conn(0x7f9f3c06c850 msgr2=0x7f9f3c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:28.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f4148a700 1 -- 172.21.15.72:0/3920384773 shutdown_connections 2023-10-14T12:34:28.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.998+0000 7f9f4148a700 1 -- 172.21.15.72:0/3920384773 wait complete. 2023-10-14T12:34:28.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.999+0000 7f9f4148a700 1 Processor -- start 2023-10-14T12:34:28.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:27.999+0000 7f9f4148a700 1 -- start start 2023-10-14T12:34:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f4148a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 0x7f9f3c134250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f4148a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3c143c50 0x7f9f3c0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f4148a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3c15ec60 0x7f9f3c0a8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f4148a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c1310d0 con 0x7f9f3c15ec60 2023-10-14T12:34:28.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f4148a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c1313b0 con 0x7f9f3c143c50 2023-10-14T12:34:28.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f4148a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c131690 con 0x7f9f3c0c5730 2023-10-14T12:34:28.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f3b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3c15ec60 0x7f9f3c0a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f3b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3c15ec60 0x7f9f3c0a8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48132/0 (socket says 172.21.15.72:48132) 2023-10-14T12:34:28.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f3b7fe700 1 -- 172.21.15.72:0/1085858845 learned_addr learned my addr 172.21.15.72:0/1085858845 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:28.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f3a7fc700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3c143c50 0x7f9f3c0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.000+0000 7f9f3affd700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 0x7f9f3c134250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f3b7fe700 1 -- 172.21.15.72:0/1085858845 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 msgr2=0x7f9f3c134250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f3b7fe700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 0x7f9f3c134250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f3b7fe700 1 -- 172.21.15.72:0/1085858845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3c143c50 msgr2=0x7f9f3c0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f3b7fe700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3c143c50 0x7f9f3c0b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f3b7fe700 1 -- 172.21.15.72:0/1085858845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f300094a0 con 0x7f9f3c15ec60 2023-10-14T12:34:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f3b7fe700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3c15ec60 0x7f9f3c0a8760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9f34014040 tx=0x7f9f34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f237fe700 1 -- 172.21.15.72:0/1085858845 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34012430 con 0x7f9f3c15ec60 2023-10-14T12:34:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f237fe700 1 -- 172.21.15.72:0/1085858845 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f34020070 con 0x7f9f3c15ec60 2023-10-14T12:34:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f34009a70 con 0x7f9f3c15ec60 2023-10-14T12:34:28.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f237fe700 1 -- 172.21.15.72:0/1085858845 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34004280 con 0x7f9f3c15ec60 2023-10-14T12:34:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.001+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c131c50 con 0x7f9f3c15ec60 2023-10-14T12:34:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.002+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c04f400 con 0x7f9f3c15ec60 2023-10-14T12:34:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.002+0000 7f9f237fe700 1 -- 172.21.15.72:0/1085858845 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9f340043e0 con 0x7f9f3c15ec60 2023-10-14T12:34:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.003+0000 7f9f237fe700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9f2806af00 0x7f9f2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.003+0000 7f9f237fe700 1 -- 172.21.15.72:0/1085858845 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9f34022070 con 0x7f9f3c15ec60 2023-10-14T12:34:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.003+0000 7f9f3affd700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9f2806af00 0x7f9f2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.003+0000 7f9f3affd700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9f2806af00 0x7f9f2806d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009d00 tx=0x7f9f30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:28.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.007+0000 7f9f237fe700 1 -- 172.21.15.72:0/1085858845 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9f34056810 con 0x7f9f3c15ec60 2023-10-14T12:34:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.212+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f3c04ebb0 con 0x7f9f3c15ec60 2023-10-14T12:34:28.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.213+0000 7f9f237fe700 1 -- 172.21.15.72:0/1085858845 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f34059e30 con 0x7f9f3c15ec60 2023-10-14T12:34:28.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.214+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9f2806af00 msgr2=0x7f9f2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.214+0000 7f9f4148a700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9f2806af00 0x7f9f2806d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009d00 tx=0x7f9f30008040 comp rx=0 tx=0).stop 2023-10-14T12:34:28.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.214+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3c15ec60 msgr2=0x7f9f3c0a8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.214+0000 7f9f4148a700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3c15ec60 0x7f9f3c0a8760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9f34014040 tx=0x7f9f34004ad0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.215+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 shutdown_connections 2023-10-14T12:34:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.215+0000 7f9f4148a700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f9f2806af00 0x7f9f2806d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.215+0000 7f9f4148a700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f3c15ec60 0x7f9f3c0a8760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.215+0000 7f9f4148a700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f9f3c0c5730 0x7f9f3c134250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.215+0000 7f9f4148a700 1 --2- 172.21.15.72:0/1085858845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3c143c50 0x7f9f3c0b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.215+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 >> 172.21.15.72:0/1085858845 conn(0x7f9f3c06c850 msgr2=0x7f9f3c15dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.215+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 shutdown_connections 2023-10-14T12:34:28.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.215+0000 7f9f4148a700 1 -- 172.21.15.72:0/1085858845 wait complete. 2023-10-14T12:34:28.218 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-10-14T12:34:28.227 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-14T12:34:28.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:28.228 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-14T12:34:28.271 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:34:28.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:28.272 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T12:34:28.333 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T12:34:28.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:34:28.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.453+0000 7f4075754700 1 Processor -- start 2023-10-14T12:34:28.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.453+0000 7f4075754700 1 -- start start 2023-10-14T12:34:28.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.454+0000 7f4075754700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f407015a650 0x7f407006dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.454+0000 7f4075754700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f407015b5d0 0x7f40700717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.454+0000 7f4075754700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 0x7f407015e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.454+0000 7f4075754700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40700721b0 con 0x7f407015a650 2023-10-14T12:34:28.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.454+0000 7f4075754700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407006f270 con 0x7f407015b5d0 2023-10-14T12:34:28.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.454+0000 7f4075754700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407015aa30 con 0x7f4070071d20 2023-10-14T12:34:28.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.454+0000 7f406effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f407015a650 0x7f407006dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.454+0000 7f406effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f407015a650 0x7f407006dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48136/0 (socket says 172.21.15.72:48136) 2023-10-14T12:34:28.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.454+0000 7f406effd700 1 -- 172.21.15.72:0/2234524609 learned_addr learned my addr 172.21.15.72:0/2234524609 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:28.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406f7fe700 1 --2- 172.21.15.72:0/2234524609 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 0x7f407015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406e7fc700 1 --2- 172.21.15.72:0/2234524609 >> v2:172.21.15.123:3300/0 conn(0x7f407015b5d0 0x7f40700717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406effd700 1 -- 172.21.15.72:0/2234524609 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 msgr2=0x7f407015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:28.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406effd700 1 --2- 172.21.15.72:0/2234524609 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 0x7f407015e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406effd700 1 -- 172.21.15.72:0/2234524609 >> v2:172.21.15.123:3300/0 conn(0x7f407015b5d0 msgr2=0x7f40700717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:28.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406effd700 1 --2- 172.21.15.72:0/2234524609 >> v2:172.21.15.123:3300/0 conn(0x7f407015b5d0 0x7f40700717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406effd700 1 -- 172.21.15.72:0/2234524609 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407006e660 con 0x7f407015a650 2023-10-14T12:34:28.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406effd700 1 --2- 172.21.15.72:0/2234524609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 0x7f407006dfc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4070074ab0 tx=0x7f4064009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb4af90c21565cb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:28.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406dffb700 1 -- 172.21.15.72:0/2234524609 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400b870 con 0x7f407015a650 2023-10-14T12:34:28.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406dffb700 1 -- 172.21.15.72:0/2234524609 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406400b9d0 con 0x7f407015a650 2023-10-14T12:34:28.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.455+0000 7f406dffb700 1 -- 172.21.15.72:0/2234524609 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400bd60 con 0x7f407015a650 2023-10-14T12:34:28.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.456+0000 7f4075754700 1 -- 172.21.15.72:0/2234524609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 msgr2=0x7f407006dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.456+0000 7f4075754700 1 --2- 172.21.15.72:0/2234524609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 0x7f407006dfc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4070074ab0 tx=0x7f4064009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.456+0000 7f4075754700 1 -- 172.21.15.72:0/2234524609 shutdown_connections 2023-10-14T12:34:28.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.456+0000 7f4075754700 1 --2- 172.21.15.72:0/2234524609 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 0x7f407015e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.456+0000 7f4075754700 1 --2- 172.21.15.72:0/2234524609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 0x7f407006dfc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.456+0000 7f4075754700 1 --2- 172.21.15.72:0/2234524609 >> v2:172.21.15.123:3300/0 conn(0x7f407015b5d0 0x7f40700717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.456+0000 7f4075754700 1 -- 172.21.15.72:0/2234524609 >> 172.21.15.72:0/2234524609 conn(0x7f40700d0180 msgr2=0x7f40700d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:28.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.456+0000 7f4075754700 1 -- 172.21.15.72:0/2234524609 shutdown_connections 2023-10-14T12:34:28.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.456+0000 7f4075754700 1 -- 172.21.15.72:0/2234524609 wait complete. 2023-10-14T12:34:28.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.457+0000 7f4075754700 1 Processor -- start 2023-10-14T12:34:28.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.457+0000 7f4075754700 1 -- start start 2023-10-14T12:34:28.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f4075754700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 0x7f40700ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f4075754700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 0x7f40700cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f4075754700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f407015b5d0 0x7f40700cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f4075754700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700c5800 con 0x7f407015a650 2023-10-14T12:34:28.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f4075754700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700c4b80 con 0x7f407015b5d0 2023-10-14T12:34:28.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f4075754700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40700c4e60 con 0x7f4070071d20 2023-10-14T12:34:28.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 0x7f40700cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 0x7f40700cb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48142/0 (socket says 172.21.15.72:48142) 2023-10-14T12:34:28.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406e7fc700 1 -- 172.21.15.72:0/3918120638 learned_addr learned my addr 172.21.15.72:0/3918120638 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406f7fe700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f407015b5d0 0x7f40700cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406effd700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 0x7f40700ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406e7fc700 1 -- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 msgr2=0x7f40700ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406e7fc700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 0x7f40700ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406e7fc700 1 -- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f407015b5d0 msgr2=0x7f40700cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406e7fc700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f407015b5d0 0x7f40700cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406e7fc700 1 -- 172.21.15.72:0/3918120638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064009550 con 0x7f407015a650 2023-10-14T12:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406effd700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 0x7f40700ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406f7fe700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f407015b5d0 0x7f40700cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:28.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f406e7fc700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 0x7f40700cb660 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f406000c7f0 tx=0x7f406000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f40577fe700 1 -- 172.21.15.72:0/3918120638 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060011800 con 0x7f407015a650 2023-10-14T12:34:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f40577fe700 1 -- 172.21.15.72:0/3918120638 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060011960 con 0x7f407015a650 2023-10-14T12:34:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40700c5140 con 0x7f407015a650 2023-10-14T12:34:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.458+0000 7f40577fe700 1 -- 172.21.15.72:0/3918120638 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060011cf0 con 0x7f407015a650 2023-10-14T12:34:28.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.459+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40700adc00 con 0x7f407015a650 2023-10-14T12:34:28.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.459+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407006f6e0 con 0x7f407015a650 2023-10-14T12:34:28.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.460+0000 7f40577fe700 1 -- 172.21.15.72:0/3918120638 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4060018360 con 0x7f407015a650 2023-10-14T12:34:28.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.460+0000 7f40577fe700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f405c06af00 0x7f405c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.460+0000 7f406effd700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f405c06af00 0x7f405c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.460+0000 7f40577fe700 1 -- 172.21.15.72:0/3918120638 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40600899c0 con 0x7f407015a650 2023-10-14T12:34:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.461+0000 7f406effd700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f405c06af00 0x7f405c06d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4064000c00 tx=0x7f4064008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:28.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.465+0000 7f40577fe700 1 -- 172.21.15.72:0/3918120638 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4060054610 con 0x7f407015a650 2023-10-14T12:34:28.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.698+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40700ade80 con 0x7f407015a650 2023-10-14T12:34:28.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.698+0000 7f40577fe700 1 -- 172.21.15.72:0/3918120638 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f4060057c30 con 0x7f407015a650 2023-10-14T12:34:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:28.701 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:47.920500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:34:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f405c06af00 msgr2=0x7f405c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f405c06af00 0x7f405c06d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4064000c00 tx=0x7f4064008030 comp rx=0 tx=0).stop 2023-10-14T12:34:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 msgr2=0x7f40700cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 0x7f40700cb660 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f406000c7f0 tx=0x7f406000cbb0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 shutdown_connections 2023-10-14T12:34:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f405c06af00 0x7f405c06d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f407015b5d0 0x7f40700cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4070071d20 0x7f40700ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 --2- 172.21.15.72:0/3918120638 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f407015a650 0x7f40700cb660 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 >> 172.21.15.72:0/3918120638 conn(0x7f40700d0180 msgr2=0x7f407015abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 shutdown_connections 2023-10-14T12:34:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.700+0000 7f4075754700 1 -- 172.21.15.72:0/3918120638 wait complete. 2023-10-14T12:34:28.704 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-10-14T12:34:28.714 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:28.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.832+0000 7fa1171e9700 1 Processor -- start 2023-10-14T12:34:28.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.832+0000 7fa1171e9700 1 -- start start 2023-10-14T12:34:28.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa1171e9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa1100712e0 0x7fa11015f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa1171e9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100cbc10 0x7fa1100cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa1171e9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100cd4b0 con 0x7fa110144ea0 2023-10-14T12:34:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa1171e9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11015b8f0 con 0x7fa1100712e0 2023-10-14T12:34:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa1171e9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100cc0c0 con 0x7fa1100cbc10 2023-10-14T12:34:28.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa10ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa110144ea0 0x7fa1100716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54448/0 (socket says 172.21.15.72:54448) 2023-10-14T12:34:28.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa10ffff700 1 -- 172.21.15.72:0/3839543205 learned_addr learned my addr 172.21.15.72:0/3839543205 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:28.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa114f85700 1 --2- 172.21.15.72:0/3839543205 >> v2:172.21.15.123:3300/0 conn(0x7fa1100712e0 0x7fa11015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa115786700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100cbc10 0x7fa1100cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698014234 0 0) 0x7fa1100cd4b0 con 0x7fa110144ea0 2023-10-14T12:34:28.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.833+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1000035b0 con 0x7fa110144ea0 2023-10-14T12:34:28.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1295833400 0 0) 0x7fa1000035b0 con 0x7fa110144ea0 2023-10-14T12:34:28.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100cbc10 msgr2=0x7fa1100cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:28.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100cbc10 0x7fa1100cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 >> v2:172.21.15.123:3300/0 conn(0x7fa1100712e0 msgr2=0x7fa11015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:28.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 --2- 172.21.15.72:0/3839543205 >> v2:172.21.15.123:3300/0 conn(0x7fa1100712e0 0x7fa11015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11015fdb0 con 0x7fa110144ea0 2023-10-14T12:34:28.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7fa0fc001670 con 0x7fa110144ea0 2023-10-14T12:34:28.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 >> v1:172.21.15.72:6789/0 conn(0x7fa110144ea0 legacy=0x7fa1100716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa100003a00 0x7fa100003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100004850 0x7fa100004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100cbc10 0x7fa100005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11015b8f0 con 0x7fa100003a00 2023-10-14T12:34:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100cc0c0 con 0x7fa100004850 2023-10-14T12:34:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10000ba10 con 0x7fa1100cbc10 2023-10-14T12:34:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa114f85700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa100003a00 0x7fa100003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10ffff700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100004850 0x7fa100004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa115786700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100cbc10 0x7fa100005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa114f85700 1 -- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100cbc10 msgr2=0x7fa100005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:28.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa114f85700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100cbc10 0x7fa100005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa114f85700 1 -- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100004850 msgr2=0x7fa100004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:28.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa114f85700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100004850 0x7fa100004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa114f85700 1 -- 172.21.15.72:0/3839543205 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1000035b0 con 0x7fa100003a00 2023-10-14T12:34:28.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa115786700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100cbc10 0x7fa100005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:28.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10ffff700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100004850 0x7fa100004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:28.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa114f85700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa100003a00 0x7fa100003e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa104009b60 tx=0x7fa100005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e997c521afc2e1ed server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:28.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.834+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10400e6c0 con 0x7fa100003a00 2023-10-14T12:34:28.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.835+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10400e820 con 0x7fa100003a00 2023-10-14T12:34:28.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.835+0000 7fa10f7fe700 1 -- 172.21.15.72:0/3839543205 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10400eb90 con 0x7fa100003a00 2023-10-14T12:34:28.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.835+0000 7fa1171e9700 1 -- 172.21.15.72:0/3839543205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa100003a00 msgr2=0x7fa100003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.835+0000 7fa1171e9700 1 --2- 172.21.15.72:0/3839543205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa100003a00 0x7fa100003e20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa104009b60 tx=0x7fa100005880 comp rx=0 tx=0).stop 2023-10-14T12:34:28.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.835+0000 7fa115786700 1 -- 172.21.15.72:0/3839543205 reap_dead start 2023-10-14T12:34:28.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.835+0000 7fa1171e9700 1 -- 172.21.15.72:0/3839543205 shutdown_connections 2023-10-14T12:34:28.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.835+0000 7fa1171e9700 1 -- 172.21.15.72:0/3839543205 >> 172.21.15.72:0/3839543205 conn(0x7fa1100cfcd0 msgr2=0x7fa1100d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:28.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.835+0000 7fa1171e9700 1 -- 172.21.15.72:0/3839543205 shutdown_connections 2023-10-14T12:34:28.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.835+0000 7fa1171e9700 1 -- 172.21.15.72:0/3839543205 wait complete. 2023-10-14T12:34:28.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.837+0000 7fa1171e9700 1 Processor -- start 2023-10-14T12:34:28.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.837+0000 7fa1171e9700 1 -- start start 2023-10-14T12:34:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa1171e9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100003a00 0x7fa110156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa1171e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1100c3e20 0x7fa1100c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa1171e9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100c69b0 0x7fa1100c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa1171e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100b4cc0 con 0x7fa1100c3e20 2023-10-14T12:34:28.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa1171e9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100c47e0 con 0x7fa100003a00 2023-10-14T12:34:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa1171e9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100c6200 con 0x7fa1100c69b0 2023-10-14T12:34:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa10ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1100c3e20 0x7fa1100c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa10ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1100c3e20 0x7fa1100c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48160/0 (socket says 172.21.15.72:48160) 2023-10-14T12:34:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa10ffff700 1 -- 172.21.15.72:0/2494722478 learned_addr learned my addr 172.21.15.72:0/2494722478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:28.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa114f85700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100003a00 0x7fa110156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa115786700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100c69b0 0x7fa1100c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa10ffff700 1 -- 172.21.15.72:0/2494722478 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100c69b0 msgr2=0x7fa1100c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa10ffff700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100c69b0 0x7fa1100c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa10ffff700 1 -- 172.21.15.72:0/2494722478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100003a00 msgr2=0x7fa110156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:28.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa10ffff700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100003a00 0x7fa110156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:28.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa10ffff700 1 -- 172.21.15.72:0/2494722478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100b4040 con 0x7fa1100c3e20 2023-10-14T12:34:28.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa115786700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100c69b0 0x7fa1100c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:28.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.838+0000 7fa10ffff700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1100c3e20 0x7fa1100c42a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00eb20 tx=0x7fa0fc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:28.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.839+0000 7fa10d7fa700 1 -- 172.21.15.72:0/2494722478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc005e00 con 0x7fa1100c3e20 2023-10-14T12:34:28.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.839+0000 7fa10d7fa700 1 -- 172.21.15.72:0/2494722478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc00c7e0 con 0x7fa1100c3e20 2023-10-14T12:34:28.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.839+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1100b4320 con 0x7fa1100c3e20 2023-10-14T12:34:28.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.839+0000 7fa10d7fa700 1 -- 172.21.15.72:0/2494722478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00cb90 con 0x7fa1100c3e20 2023-10-14T12:34:28.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.839+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1100b48e0 con 0x7fa1100c3e20 2023-10-14T12:34:28.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.839+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1100b4aa0 con 0x7fa1100c3e20 2023-10-14T12:34:28.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.840+0000 7fa10d7fa700 1 -- 172.21.15.72:0/2494722478 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa0fc00ccf0 con 0x7fa1100c3e20 2023-10-14T12:34:28.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.840+0000 7fa10d7fa700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa0f406af00 0x7fa0f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:28.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.840+0000 7fa10d7fa700 1 -- 172.21.15.72:0/2494722478 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa0fc089730 con 0x7fa1100c3e20 2023-10-14T12:34:28.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.840+0000 7fa114f85700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa0f406af00 0x7fa0f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:28.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.841+0000 7fa114f85700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa0f406af00 0x7fa0f406d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa1040090b0 tx=0x7fa104008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:28.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:28.845+0000 7fa10d7fa700 1 -- 172.21.15.72:0/2494722478 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0fc054420 con 0x7fa1100c3e20 2023-10-14T12:34:29.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.035+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1100b4e00 con 0x7fa1100c3e20 2023-10-14T12:34:29.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.037+0000 7fa10d7fa700 1 -- 172.21.15.72:0/2494722478 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18678 (secure 0 0 0) 0x7fa1100b4e00 con 0x7fa1100c3e20 2023-10-14T12:34:29.038 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:29.039 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:20.981579+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:29.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa0f406af00 msgr2=0x7fa0f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa0f406af00 0x7fa0f406d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa1040090b0 tx=0x7fa104008030 comp rx=0 tx=0).stop 2023-10-14T12:34:29.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1100c3e20 msgr2=0x7fa1100c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1100c3e20 0x7fa1100c42a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00eb20 tx=0x7fa0fc00ee30 comp rx=0 tx=0).stop 2023-10-14T12:34:29.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 shutdown_connections 2023-10-14T12:34:29.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa0f406af00 0x7fa0f406d3c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa1100c69b0 0x7fa1100c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa100003a00 0x7fa110156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 --2- 172.21.15.72:0/2494722478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1100c3e20 0x7fa1100c42a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 >> 172.21.15.72:0/2494722478 conn(0x7fa1100cfcd0 msgr2=0x7fa1100cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:29.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 shutdown_connections 2023-10-14T12:34:29.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.039+0000 7fa1171e9700 1 -- 172.21.15.72:0/2494722478 wait complete. 2023-10-14T12:34:29.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:33:29.264993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:33:30.168455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:33:33.851017+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:34:29.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:29.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.174+0000 7fc9f8752700 1 Processor -- start 2023-10-14T12:34:29.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.175+0000 7fc9f8752700 1 -- start start 2023-10-14T12:34:29.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.175+0000 7fc9f8752700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 0x7fc9f00cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.175+0000 7fc9f8752700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc9f015d960 0x7fc9f00cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.175+0000 7fc9f8752700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f006a820 con 0x7fc9f006e030 2023-10-14T12:34:29.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.175+0000 7fc9f8752700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f0066cd0 con 0x7fc9f015d960 2023-10-14T12:34:29.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.175+0000 7fc9f8752700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f006d490 con 0x7fc9f015d580 2023-10-14T12:34:29.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f5ced700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc9f015d960 0x7fc9f00cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f5ced700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc9f015d960 0x7fc9f00cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48166/0 (socket says 172.21.15.72:48166) 2023-10-14T12:34:29.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f5ced700 1 -- 172.21.15.72:0/2101856131 learned_addr learned my addr 172.21.15.72:0/2101856131 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:29.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f64ee700 1 --2- 172.21.15.72:0/2101856131 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 0x7fc9f00cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f5ced700 1 -- 172.21.15.72:0/2101856131 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 msgr2=0x7fc9f00cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:29.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f5ced700 1 --2- 172.21.15.72:0/2101856131 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 0x7fc9f00cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f5ced700 1 -- 172.21.15.72:0/2101856131 >> v1:172.21.15.123:6789/0 conn(0x7fc9f006e030 legacy=0x7fc9f0161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:29.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f5ced700 1 -- 172.21.15.72:0/2101856131 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f006d770 con 0x7fc9f015d960 2023-10-14T12:34:29.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f64ee700 1 --2- 172.21.15.72:0/2101856131 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 0x7fc9f00cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:29.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f5ced700 1 --2- 172.21.15.72:0/2101856131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 0x7fc9f00cda00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0098f0 tx=0x7fc9ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c850c0e33a1fb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:29.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f54ec700 1 -- 172.21.15.72:0/2101856131 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec004230 con 0x7fc9f015d960 2023-10-14T12:34:29.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f54ec700 1 -- 172.21.15.72:0/2101856131 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec004390 con 0x7fc9f015d960 2023-10-14T12:34:29.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.176+0000 7fc9f54ec700 1 -- 172.21.15.72:0/2101856131 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0036a0 con 0x7fc9f015d960 2023-10-14T12:34:29.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.177+0000 7fc9f8752700 1 -- 172.21.15.72:0/2101856131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 msgr2=0x7fc9f00cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.177+0000 7fc9f8752700 1 --2- 172.21.15.72:0/2101856131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 0x7fc9f00cda00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0098f0 tx=0x7fc9ec009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:29.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.177+0000 7fc9f8752700 1 -- 172.21.15.72:0/2101856131 shutdown_connections 2023-10-14T12:34:29.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.177+0000 7fc9f8752700 1 --2- 172.21.15.72:0/2101856131 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 0x7fc9f00cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.177+0000 7fc9f8752700 1 --2- 172.21.15.72:0/2101856131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 0x7fc9f00cda00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.177+0000 7fc9f8752700 1 -- 172.21.15.72:0/2101856131 >> 172.21.15.72:0/2101856131 conn(0x7fc9f00b13e0 msgr2=0x7fc9f00b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:29.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.177+0000 7fc9f8752700 1 -- 172.21.15.72:0/2101856131 shutdown_connections 2023-10-14T12:34:29.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.177+0000 7fc9f8752700 1 -- 172.21.15.72:0/2101856131 wait complete. 2023-10-14T12:34:29.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.178+0000 7fc9f8752700 1 Processor -- start 2023-10-14T12:34:29.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.178+0000 7fc9f8752700 1 -- start start 2023-10-14T12:34:29.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f8752700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9f006e030 0x7fc9f015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f8752700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 0x7fc9f00c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f8752700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 0x7fc9f00af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f8752700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f015ac50 con 0x7fc9f015d960 2023-10-14T12:34:29.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f8752700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c7cd0 con 0x7fc9f006e030 2023-10-14T12:34:29.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f8752700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c7fb0 con 0x7fc9f015d580 2023-10-14T12:34:29.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f6cef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 0x7fc9f00af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f6cef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 0x7fc9f00af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48176/0 (socket says 172.21.15.72:48176) 2023-10-14T12:34:29.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f6cef700 1 -- 172.21.15.72:0/1059539348 learned_addr learned my addr 172.21.15.72:0/1059539348 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:29.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f64ee700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9f006e030 0x7fc9f015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f5ced700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 0x7fc9f00c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f6cef700 1 -- 172.21.15.72:0/1059539348 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 msgr2=0x7fc9f00c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f6cef700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 0x7fc9f00c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f6cef700 1 -- 172.21.15.72:0/1059539348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9f006e030 msgr2=0x7fc9f015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f6cef700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9f006e030 0x7fc9f015a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f6cef700 1 -- 172.21.15.72:0/1059539348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec009550 con 0x7fc9f015d960 2023-10-14T12:34:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f6cef700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 0x7fc9f00af530 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800cc10 tx=0x7fc9e800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9e2ffd700 1 -- 172.21.15.72:0/1059539348 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e800ab10 con 0x7fc9f015d960 2023-10-14T12:34:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9e2ffd700 1 -- 172.21.15.72:0/1059539348 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e800ac70 con 0x7fc9f015d960 2023-10-14T12:34:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f00c8290 con 0x7fc9f015d960 2023-10-14T12:34:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9e2ffd700 1 -- 172.21.15.72:0/1059539348 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8012420 con 0x7fc9f015d960 2023-10-14T12:34:29.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.179+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f00c8850 con 0x7fc9f015d960 2023-10-14T12:34:29.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.180+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f00c8a40 con 0x7fc9f015d960 2023-10-14T12:34:29.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.181+0000 7fc9e2ffd700 1 -- 172.21.15.72:0/1059539348 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc9e8012580 con 0x7fc9f015d960 2023-10-14T12:34:29.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.181+0000 7fc9e2ffd700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc9d406aed0 0x7fc9d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.181+0000 7fc9e2ffd700 1 -- 172.21.15.72:0/1059539348 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc9e8089ce0 con 0x7fc9f015d960 2023-10-14T12:34:29.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.181+0000 7fc9f64ee700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc9d406aed0 0x7fc9d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.182+0000 7fc9f64ee700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc9d406aed0 0x7fc9d406d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4006fd0 tx=0x7fc9e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:29.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.186+0000 7fc9e2ffd700 1 -- 172.21.15.72:0/1059539348 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc9e80549d0 con 0x7fc9f015d960 2023-10-14T12:34:29.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.374+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9f004ebb0 con 0x7fc9f015d960 2023-10-14T12:34:29.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.374+0000 7fc9e2ffd700 1 -- 172.21.15.72:0/1059539348 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9e8057ff0 con 0x7fc9f015d960 2023-10-14T12:34:29.376 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:29.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.376+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc9d406aed0 msgr2=0x7fc9d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.376+0000 7fc9f8752700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc9d406aed0 0x7fc9d406d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4006fd0 tx=0x7fc9e4008040 comp rx=0 tx=0).stop 2023-10-14T12:34:29.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.376+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 msgr2=0x7fc9f00af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.376+0000 7fc9f8752700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 0x7fc9f00af530 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800cc10 tx=0x7fc9e800cf20 comp rx=0 tx=0).stop 2023-10-14T12:34:29.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.376+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 shutdown_connections 2023-10-14T12:34:29.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.376+0000 7fc9f8752700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc9d406aed0 0x7fc9d406d390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.377+0000 7fc9f8752700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9f015d960 0x7fc9f00af530 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.377+0000 7fc9f8752700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9f006e030 0x7fc9f015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.377+0000 7fc9f8752700 1 --2- 172.21.15.72:0/1059539348 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9f015d580 0x7fc9f00c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.377+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 >> 172.21.15.72:0/1059539348 conn(0x7fc9f00b13e0 msgr2=0x7fc9f00ca830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:29.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.377+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 shutdown_connections 2023-10-14T12:34:29.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.377+0000 7fc9f8752700 1 -- 172.21.15.72:0/1059539348 wait complete. 2023-10-14T12:34:29.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:34:29.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.512+0000 7fdcf07ed700 1 Processor -- start 2023-10-14T12:34:29.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.512+0000 7fdcf07ed700 1 -- start start 2023-10-14T12:34:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcf07ed700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce815efd0 0x7fdce81447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcf07ed700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce8066890 0x7fdce815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcf07ed700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdce806a820 0x7fdce806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcf07ed700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce815ff40 con 0x7fdce8066890 2023-10-14T12:34:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcf07ed700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce815b920 con 0x7fdce806a820 2023-10-14T12:34:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcf07ed700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce806bfe0 con 0x7fdce815efd0 2023-10-14T12:34:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcedd88700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce8066890 0x7fdce815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcedd88700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce8066890 0x7fdce815f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48180/0 (socket says 172.21.15.72:48180) 2023-10-14T12:34:29.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcedd88700 1 -- 172.21.15.72:0/4239558690 learned_addr learned my addr 172.21.15.72:0/4239558690 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdceed8a700 1 --2- 172.21.15.72:0/4239558690 >> v2:172.21.15.123:3300/0 conn(0x7fdce806a820 0x7fdce806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcee589700 1 --2- 172.21.15.72:0/4239558690 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce815efd0 0x7fdce81447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcedd88700 1 -- 172.21.15.72:0/4239558690 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce815efd0 msgr2=0x7fdce81447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcedd88700 1 --2- 172.21.15.72:0/4239558690 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce815efd0 0x7fdce81447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcedd88700 1 -- 172.21.15.72:0/4239558690 >> v2:172.21.15.123:3300/0 conn(0x7fdce806a820 msgr2=0x7fdce806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcedd88700 1 --2- 172.21.15.72:0/4239558690 >> v2:172.21.15.123:3300/0 conn(0x7fdce806a820 0x7fdce806acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcedd88700 1 -- 172.21.15.72:0/4239558690 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce815fca0 con 0x7fdce8066890 2023-10-14T12:34:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdcedd88700 1 --2- 172.21.15.72:0/4239558690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce8066890 0x7fdce815f3b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdce80ae950 tx=0x7fdcd8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a505283cd7174d72 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdced587700 1 -- 172.21.15.72:0/4239558690 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800b870 con 0x7fdce8066890 2023-10-14T12:34:29.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdced587700 1 -- 172.21.15.72:0/4239558690 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd800b9d0 con 0x7fdce8066890 2023-10-14T12:34:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.513+0000 7fdced587700 1 -- 172.21.15.72:0/4239558690 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800bd60 con 0x7fdce8066890 2023-10-14T12:34:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.514+0000 7fdcf07ed700 1 -- 172.21.15.72:0/4239558690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce8066890 msgr2=0x7fdce815f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.514+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/4239558690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce8066890 0x7fdce815f3b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdce80ae950 tx=0x7fdcd8009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.514+0000 7fdcf07ed700 1 -- 172.21.15.72:0/4239558690 shutdown_connections 2023-10-14T12:34:29.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.514+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/4239558690 >> v2:172.21.15.123:3300/0 conn(0x7fdce806a820 0x7fdce806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.514+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/4239558690 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce815efd0 0x7fdce81447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.514+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/4239558690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce8066890 0x7fdce815f3b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.514+0000 7fdcf07ed700 1 -- 172.21.15.72:0/4239558690 >> 172.21.15.72:0/4239558690 conn(0x7fdce80b13e0 msgr2=0x7fdce80b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:29.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.514+0000 7fdcf07ed700 1 -- 172.21.15.72:0/4239558690 shutdown_connections 2023-10-14T12:34:29.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.514+0000 7fdcf07ed700 1 -- 172.21.15.72:0/4239558690 wait complete. 2023-10-14T12:34:29.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.515+0000 7fdcf07ed700 1 Processor -- start 2023-10-14T12:34:29.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.515+0000 7fdcf07ed700 1 -- start start 2023-10-14T12:34:29.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdcf07ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8066890 0x7fdce80c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdcf07ed700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce806a820 0x7fdce80c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdcf07ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce815efd0 0x7fdce80c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdcf07ed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80c3eb0 con 0x7fdce815efd0 2023-10-14T12:34:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdcf07ed700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b2640 con 0x7fdce8066890 2023-10-14T12:34:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdcf07ed700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce80b2920 con 0x7fdce806a820 2023-10-14T12:34:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdceed8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce815efd0 0x7fdce80c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdceed8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce815efd0 0x7fdce80c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48190/0 (socket says 172.21.15.72:48190) 2023-10-14T12:34:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdceed8a700 1 -- 172.21.15.72:0/3935302094 learned_addr learned my addr 172.21.15.72:0/3935302094 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdcee589700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8066890 0x7fdce80c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdcedd88700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce806a820 0x7fdce80c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdceed8a700 1 -- 172.21.15.72:0/3935302094 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce806a820 msgr2=0x7fdce80c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdceed8a700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce806a820 0x7fdce80c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdceed8a700 1 -- 172.21.15.72:0/3935302094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8066890 msgr2=0x7fdce80c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdceed8a700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8066890 0x7fdce80c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdceed8a700 1 -- 172.21.15.72:0/3935302094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8009550 con 0x7fdce815efd0 2023-10-14T12:34:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdcee589700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8066890 0x7fdce80c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:29.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.516+0000 7fdceed8a700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce815efd0 0x7fdce80c7fb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdce0007e40 tx=0x7fdce000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.517+0000 7fdcdeffd700 1 -- 172.21.15.72:0/3935302094 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000eea0 con 0x7fdce815efd0 2023-10-14T12:34:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.517+0000 7fdcdeffd700 1 -- 172.21.15.72:0/3935302094 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce0014420 con 0x7fdce815efd0 2023-10-14T12:34:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.517+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce80b2c00 con 0x7fdce815efd0 2023-10-14T12:34:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.517+0000 7fdcdeffd700 1 -- 172.21.15.72:0/3935302094 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce00147b0 con 0x7fdce815efd0 2023-10-14T12:34:29.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.517+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce80c4190 con 0x7fdce815efd0 2023-10-14T12:34:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.518+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce80b2e40 con 0x7fdce815efd0 2023-10-14T12:34:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.518+0000 7fdcdeffd700 1 -- 172.21.15.72:0/3935302094 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdce0014910 con 0x7fdce815efd0 2023-10-14T12:34:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.518+0000 7fdcdeffd700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdccc06af00 0x7fdccc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.519+0000 7fdcdeffd700 1 -- 172.21.15.72:0/3935302094 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdce008a150 con 0x7fdce815efd0 2023-10-14T12:34:29.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.519+0000 7fdcee589700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdccc06af00 0x7fdccc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.519+0000 7fdcee589700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdccc06af00 0x7fdccc06d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdce4006fd0 tx=0x7fdce4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:29.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.523+0000 7fdcdeffd700 1 -- 172.21.15.72:0/3935302094 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdce80b2e40 con 0x7fdce815efd0 2023-10-14T12:34:29.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.713+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdce80b2e40 con 0x7fdce815efd0 2023-10-14T12:34:29.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.713+0000 7fdcdeffd700 1 -- 172.21.15.72:0/3935302094 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdce80b2e40 con 0x7fdce815efd0 2023-10-14T12:34:29.715 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdccc06af00 msgr2=0x7fdccc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdccc06af00 0x7fdccc06d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdce4006fd0 tx=0x7fdce4008040 comp rx=0 tx=0).stop 2023-10-14T12:34:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce815efd0 msgr2=0x7fdce80c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce815efd0 0x7fdce80c7fb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdce0007e40 tx=0x7fdce000e3c0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 shutdown_connections 2023-10-14T12:34:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdccc06af00 0x7fdccc06d3c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce815efd0 0x7fdce80c7fb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8066890 0x7fdce80c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 --2- 172.21.15.72:0/3935302094 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce806a820 0x7fdce80c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 >> 172.21.15.72:0/3935302094 conn(0x7fdce80b13e0 msgr2=0x7fdce815bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:29.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 shutdown_connections 2023-10-14T12:34:29.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.715+0000 7fdcf07ed700 1 -- 172.21.15.72:0/3935302094 wait complete. 2023-10-14T12:34:29.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:34:29.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.851+0000 7fc04784e700 1 Processor -- start 2023-10-14T12:34:29.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.851+0000 7fc04784e700 1 -- start start 2023-10-14T12:34:29.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc04784e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 0x7fc0400717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc04784e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc04015dec0 0x7fc04006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc04784e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400cba90 con 0x7fc04015e320 2023-10-14T12:34:29.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc04784e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0400cb510 con 0x7fc04015dec0 2023-10-14T12:34:29.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc04784e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04015ee40 con 0x7fc04015a250 2023-10-14T12:34:29.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc0455ea700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 0x7fc0400717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc044de9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc04015dec0 0x7fc04006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc045deb700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc04015e320 0x7fc0400cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:52696/0 (socket says 172.21.15.72:52696) 2023-10-14T12:34:29.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc045deb700 1 -- 172.21.15.72:0/2912838744 learned_addr learned my addr 172.21.15.72:0/2912838744 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:29.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc037fff700 1 -- 172.21.15.72:0/2912838744 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515217306 0 0) 0x7fc0400cba90 con 0x7fc04015e320 2023-10-14T12:34:29.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc037fff700 1 -- 172.21.15.72:0/2912838744 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c0035b0 con 0x7fc04015e320 2023-10-14T12:34:29.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc0455ea700 1 -- 172.21.15.72:0/2912838744 >> v2:172.21.15.123:3300/0 conn(0x7fc04015dec0 msgr2=0x7fc04006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:29.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc0455ea700 1 --2- 172.21.15.72:0/2912838744 >> v2:172.21.15.123:3300/0 conn(0x7fc04015dec0 0x7fc04006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc0455ea700 1 -- 172.21.15.72:0/2912838744 >> v1:172.21.15.123:6789/0 conn(0x7fc04015e320 legacy=0x7fc0400cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc0455ea700 1 -- 172.21.15.72:0/2912838744 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04015e880 con 0x7fc04015a250 2023-10-14T12:34:29.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.852+0000 7fc044de9700 1 --2- 172.21.15.72:0/2912838744 >> v2:172.21.15.123:3300/0 conn(0x7fc04015dec0 0x7fc04006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:29.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc0455ea700 1 --2- 172.21.15.72:0/2912838744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 0x7fc0400717b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009840 tx=0x7fc03c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=155d8e3b8cd3e744 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:29.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc037fff700 1 -- 172.21.15.72:0/2912838744 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011830 con 0x7fc04015a250 2023-10-14T12:34:29.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc037fff700 1 -- 172.21.15.72:0/2912838744 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c011990 con 0x7fc04015a250 2023-10-14T12:34:29.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc037fff700 1 -- 172.21.15.72:0/2912838744 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c011d20 con 0x7fc04015a250 2023-10-14T12:34:29.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc04784e700 1 -- 172.21.15.72:0/2912838744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 msgr2=0x7fc0400717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc04784e700 1 --2- 172.21.15.72:0/2912838744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 0x7fc0400717b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009840 tx=0x7fc03c009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:29.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc04784e700 1 -- 172.21.15.72:0/2912838744 shutdown_connections 2023-10-14T12:34:29.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc04784e700 1 --2- 172.21.15.72:0/2912838744 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 0x7fc0400717b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc04784e700 1 --2- 172.21.15.72:0/2912838744 >> v2:172.21.15.123:3300/0 conn(0x7fc04015dec0 0x7fc04006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.853+0000 7fc04784e700 1 -- 172.21.15.72:0/2912838744 >> 172.21.15.72:0/2912838744 conn(0x7fc0400ccbe0 msgr2=0x7fc0400ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:29.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.854+0000 7fc04784e700 1 -- 172.21.15.72:0/2912838744 shutdown_connections 2023-10-14T12:34:29.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.854+0000 7fc04784e700 1 -- 172.21.15.72:0/2912838744 wait complete. 2023-10-14T12:34:29.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.855+0000 7fc04784e700 1 Processor -- start 2023-10-14T12:34:29.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.855+0000 7fc04784e700 1 -- start start 2023-10-14T12:34:29.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.855+0000 7fc04784e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 0x7fc04014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.855+0000 7fc04784e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015dec0 0x7fc04014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.855+0000 7fc04784e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04015e320 0x7fc040158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.855+0000 7fc04784e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400b3f00 con 0x7fc04015e320 2023-10-14T12:34:29.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.855+0000 7fc04784e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04014cc20 con 0x7fc04015dec0 2023-10-14T12:34:29.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.855+0000 7fc04784e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400b3c20 con 0x7fc04015a250 2023-10-14T12:34:29.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc045deb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04015e320 0x7fc040158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc045deb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04015e320 0x7fc040158960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48204/0 (socket says 172.21.15.72:48204) 2023-10-14T12:34:29.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc045deb700 1 -- 172.21.15.72:0/4163202298 learned_addr learned my addr 172.21.15.72:0/4163202298 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc044de9700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015dec0 0x7fc04014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc0455ea700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 0x7fc04014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc045deb700 1 -- 172.21.15.72:0/4163202298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 msgr2=0x7fc04014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc045deb700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 0x7fc04014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc045deb700 1 -- 172.21.15.72:0/4163202298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015dec0 msgr2=0x7fc04014cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:29.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc045deb700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015dec0 0x7fc04014cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:29.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc045deb700 1 -- 172.21.15.72:0/4163202298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0300094a0 con 0x7fc04015e320 2023-10-14T12:34:29.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc045deb700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04015e320 0x7fc040158960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc03800ca70 tx=0x7fc03800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:29.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc035ffb700 1 -- 172.21.15.72:0/4163202298 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800a9e0 con 0x7fc04015e320 2023-10-14T12:34:29.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc035ffb700 1 -- 172.21.15.72:0/4163202298 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800ab40 con 0x7fc04015e320 2023-10-14T12:34:29.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03c0094a0 con 0x7fc04015e320 2023-10-14T12:34:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc035ffb700 1 -- 172.21.15.72:0/4163202298 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038012400 con 0x7fc04015e320 2023-10-14T12:34:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.856+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0400b5940 con 0x7fc04015e320 2023-10-14T12:34:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.857+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04004ebb0 con 0x7fc04015e320 2023-10-14T12:34:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.858+0000 7fc035ffb700 1 -- 172.21.15.72:0/4163202298 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc03801b3b0 con 0x7fc04015e320 2023-10-14T12:34:29.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.858+0000 7fc035ffb700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc02406af00 0x7fc02406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:29.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.858+0000 7fc035ffb700 1 -- 172.21.15.72:0/4163202298 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc038089460 con 0x7fc04015e320 2023-10-14T12:34:29.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.858+0000 7fc0455ea700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc02406af00 0x7fc02406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:29.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.858+0000 7fc0455ea700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc02406af00 0x7fc02406d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009fd0 tx=0x7fc03c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:29.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:29.863+0000 7fc035ffb700 1 -- 172.21.15.72:0/4163202298 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc038054170 con 0x7fc04015e320 2023-10-14T12:34:30.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.050+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0400ca590 con 0x7fc04015e320 2023-10-14T12:34:30.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.050+0000 7fc035ffb700 1 -- 172.21.15.72:0/4163202298 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc038017020 con 0x7fc04015e320 2023-10-14T12:34:30.052 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-10-14T12:34:30.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc02406af00 msgr2=0x7fc02406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc02406af00 0x7fc02406d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc03c009fd0 tx=0x7fc03c01c040 comp rx=0 tx=0).stop 2023-10-14T12:34:30.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04015e320 msgr2=0x7fc040158960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04015e320 0x7fc040158960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc03800ca70 tx=0x7fc03800cd80 comp rx=0 tx=0).stop 2023-10-14T12:34:30.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 shutdown_connections 2023-10-14T12:34:30.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc02406af00 0x7fc02406d3c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc04015e320 0x7fc040158960 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc04015a250 0x7fc04014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 --2- 172.21.15.72:0/4163202298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015dec0 0x7fc04014cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.052+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 >> 172.21.15.72:0/4163202298 conn(0x7fc0400ccbe0 msgr2=0x7fc0400cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:30.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.053+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 shutdown_connections 2023-10-14T12:34:30.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.053+0000 7fc04784e700 1 -- 172.21.15.72:0/4163202298 wait complete. 2023-10-14T12:34:30.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:34:30.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.187+0000 7f6714183700 1 Processor -- start 2023-10-14T12:34:30.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.187+0000 7f6714183700 1 -- start start 2023-10-14T12:34:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.188+0000 7f6714183700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15a250 0x7f670c0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.188+0000 7f6714183700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f670c15dec0 0x7f670c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.188+0000 7f6714183700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c0cba90 con 0x7f670c15e320 2023-10-14T12:34:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.188+0000 7f6714183700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670c0cb510 con 0x7f670c15dec0 2023-10-14T12:34:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.188+0000 7f6714183700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c15ee40 con 0x7f670c15a250 2023-10-14T12:34:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.188+0000 7f671171e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f670c15dec0 0x7f670c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.188+0000 7f6711f1f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15a250 0x7f670c0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.188+0000 7f6712720700 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f670c15e320 0x7f670c0cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.72:52710/0 (socket says 172.21.15.72:52710) 2023-10-14T12:34:30.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.188+0000 7f6712720700 1 -- 172.21.15.72:0/421639892 learned_addr learned my addr 172.21.15.72:0/421639892 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:30.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f6710f1d700 1 -- 172.21.15.72:0/421639892 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663207420 0 0) 0x7f670c0cba90 con 0x7f670c15e320 2023-10-14T12:34:30.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f6710f1d700 1 -- 172.21.15.72:0/421639892 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f80035b0 con 0x7f670c15e320 2023-10-14T12:34:30.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f671171e700 1 -- 172.21.15.72:0/421639892 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15a250 msgr2=0x7f670c0717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:30.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f671171e700 1 --2- 172.21.15.72:0/421639892 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15a250 0x7f670c0717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f671171e700 1 -- 172.21.15.72:0/421639892 >> v1:172.21.15.123:6789/0 conn(0x7f670c15e320 legacy=0x7f670c0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f671171e700 1 -- 172.21.15.72:0/421639892 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c15e880 con 0x7f670c15dec0 2023-10-14T12:34:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f6711f1f700 1 --2- 172.21.15.72:0/421639892 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15a250 0x7f670c0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f671171e700 1 --2- 172.21.15.72:0/421639892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670c15dec0 0x7f670c06d5b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6708009840 tx=0x7f6708009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1687ec3d112dd965 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f6710f1d700 1 -- 172.21.15.72:0/421639892 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708011830 con 0x7f670c15dec0 2023-10-14T12:34:30.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f6710f1d700 1 -- 172.21.15.72:0/421639892 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6708011990 con 0x7f670c15dec0 2023-10-14T12:34:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.189+0000 7f6710f1d700 1 -- 172.21.15.72:0/421639892 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708011d20 con 0x7f670c15dec0 2023-10-14T12:34:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.190+0000 7f6714183700 1 -- 172.21.15.72:0/421639892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670c15dec0 msgr2=0x7f670c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.190+0000 7f6714183700 1 --2- 172.21.15.72:0/421639892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670c15dec0 0x7f670c06d5b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6708009840 tx=0x7f6708009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:30.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.190+0000 7f6714183700 1 -- 172.21.15.72:0/421639892 shutdown_connections 2023-10-14T12:34:30.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.190+0000 7f6714183700 1 --2- 172.21.15.72:0/421639892 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15a250 0x7f670c0717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.190+0000 7f6714183700 1 --2- 172.21.15.72:0/421639892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670c15dec0 0x7f670c06d5b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.190+0000 7f6714183700 1 -- 172.21.15.72:0/421639892 >> 172.21.15.72:0/421639892 conn(0x7f670c0ccbe0 msgr2=0x7f670c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:30.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.190+0000 7f6714183700 1 -- 172.21.15.72:0/421639892 shutdown_connections 2023-10-14T12:34:30.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.190+0000 7f6714183700 1 -- 172.21.15.72:0/421639892 wait complete. 2023-10-14T12:34:30.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.191+0000 7f6714183700 1 Processor -- start 2023-10-14T12:34:30.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.191+0000 7f6714183700 1 -- start start 2023-10-14T12:34:30.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6714183700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f670c15a250 0x7f670c0c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6714183700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15dec0 0x7f670c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6714183700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670c15e320 0x7f670c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6714183700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c0c69f0 con 0x7f670c15a250 2023-10-14T12:34:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6714183700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c0c6c20 con 0x7f670c15e320 2023-10-14T12:34:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6714183700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c0c4760 con 0x7f670c15dec0 2023-10-14T12:34:30.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6711f1f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f670c15a250 0x7f670c0c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6711f1f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f670c15a250 0x7f670c0c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48214/0 (socket says 172.21.15.72:48214) 2023-10-14T12:34:30.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6711f1f700 1 -- 172.21.15.72:0/1432183487 learned_addr learned my addr 172.21.15.72:0/1432183487 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:30.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6712720700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670c15e320 0x7f670c0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f671171e700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15dec0 0x7f670c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6711f1f700 1 -- 172.21.15.72:0/1432183487 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15dec0 msgr2=0x7f670c15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.192+0000 7f6711f1f700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15dec0 0x7f670c15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.193+0000 7f6711f1f700 1 -- 172.21.15.72:0/1432183487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670c15e320 msgr2=0x7f670c0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.193+0000 7f6711f1f700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670c15e320 0x7f670c0c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.193+0000 7f6711f1f700 1 -- 172.21.15.72:0/1432183487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0094a0 con 0x7f670c15a250 2023-10-14T12:34:30.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.193+0000 7f6711f1f700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f670c15a250 0x7f670c0c4bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00ebe0 tx=0x7f66fc009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:30.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.193+0000 7f67027fc700 1 -- 172.21.15.72:0/1432183487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc00c7f0 con 0x7f670c15a250 2023-10-14T12:34:30.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.193+0000 7f67027fc700 1 -- 172.21.15.72:0/1432183487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc00c950 con 0x7f670c15a250 2023-10-14T12:34:30.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.193+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67080094a0 con 0x7f670c15a250 2023-10-14T12:34:30.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.193+0000 7f67027fc700 1 -- 172.21.15.72:0/1432183487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc00cce0 con 0x7f670c15a250 2023-10-14T12:34:30.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.193+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670c0c4110 con 0x7f670c15a250 2023-10-14T12:34:30.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.194+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670c04ebb0 con 0x7f670c15a250 2023-10-14T12:34:30.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.194+0000 7f67027fc700 1 -- 172.21.15.72:0/1432183487 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f66fc013470 con 0x7f670c15a250 2023-10-14T12:34:30.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.195+0000 7f67027fc700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f66f006af00 0x7f66f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.195+0000 7f67027fc700 1 -- 172.21.15.72:0/1432183487 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f66fc089a50 con 0x7f670c15a250 2023-10-14T12:34:30.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.195+0000 7f671171e700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f66f006af00 0x7f66f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.195+0000 7f671171e700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f66f006af00 0x7f66f006d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6708009fd0 tx=0x7f670801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:30.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.199+0000 7f67027fc700 1 -- 172.21.15.72:0/1432183487 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66fc054740 con 0x7f670c15a250 2023-10-14T12:34:30.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.386+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f670c0b60e0 con 0x7f670c15a250 2023-10-14T12:34:30.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.386+0000 7f67027fc700 1 -- 172.21.15.72:0/1432183487 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f66fc057d60 con 0x7f670c15a250 2023-10-14T12:34:30.388 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-10-14T12:34:30.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f66f006af00 msgr2=0x7f66f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f66f006af00 0x7f66f006d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6708009fd0 tx=0x7f670801c040 comp rx=0 tx=0).stop 2023-10-14T12:34:30.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f670c15a250 msgr2=0x7f670c0c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f670c15a250 0x7f670c0c4bf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00ebe0 tx=0x7f66fc009e20 comp rx=0 tx=0).stop 2023-10-14T12:34:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 shutdown_connections 2023-10-14T12:34:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f66f006af00 0x7f66f006d3c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670c15e320 0x7f670c0c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f670c15a250 0x7f670c0c4bf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 --2- 172.21.15.72:0/1432183487 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f670c15dec0 0x7f670c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 >> 172.21.15.72:0/1432183487 conn(0x7f670c0ccbe0 msgr2=0x7f670c0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:30.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 shutdown_connections 2023-10-14T12:34:30.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.389+0000 7f6714183700 1 -- 172.21.15.72:0/1432183487 wait complete. 2023-10-14T12:34:30.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:34:30.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.520+0000 7fb9abbf3700 1 Processor -- start 2023-10-14T12:34:30.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.521+0000 7fb9abbf3700 1 -- start start 2023-10-14T12:34:30.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.521+0000 7fb9abbf3700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9a406a820 0x7fb9a40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.521+0000 7fb9abbf3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb9a415e7f0 0x7fb9a406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.521+0000 7fb9abbf3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a40cfeb0 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.521+0000 7fb9abbf3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a40ce410 con 0x7fb9a415e7f0 2023-10-14T12:34:30.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.521+0000 7fb9abbf3700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a415ec50 con 0x7fb9a406a820 2023-10-14T12:34:30.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.521+0000 7fb9a918e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb9a415e7f0 0x7fb9a406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.521+0000 7fb9aa190700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb9a40ca7d0 0x7fb9a4071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54524/0 (socket says 172.21.15.72:54524) 2023-10-14T12:34:30.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.521+0000 7fb9aa190700 1 -- 172.21.15.72:0/841425969 learned_addr learned my addr 172.21.15.72:0/841425969 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9a998f700 1 --2- 172.21.15.72:0/841425969 >> v2:172.21.15.123:3300/0 conn(0x7fb9a406a820 0x7fb9a40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9a918e700 1 -- 172.21.15.72:0/841425969 >> v2:172.21.15.123:3300/0 conn(0x7fb9a406a820 msgr2=0x7fb9a40cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9a918e700 1 --2- 172.21.15.72:0/841425969 >> v2:172.21.15.123:3300/0 conn(0x7fb9a406a820 0x7fb9a40cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9a918e700 1 -- 172.21.15.72:0/841425969 >> v1:172.21.15.72:6789/0 conn(0x7fb9a40ca7d0 legacy=0x7fb9a4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9a918e700 1 -- 172.21.15.72:0/841425969 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40af9d0 con 0x7fb9a415e7f0 2023-10-14T12:34:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9a918e700 1 --2- 172.21.15.72:0/841425969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a415e7f0 0x7fb9a406ac00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4067df0 tx=0x7fb9a0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e9e2a1e295caa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9a898d700 1 -- 172.21.15.72:0/841425969 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0011830 con 0x7fb9a415e7f0 2023-10-14T12:34:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9a898d700 1 -- 172.21.15.72:0/841425969 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0011990 con 0x7fb9a415e7f0 2023-10-14T12:34:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9a898d700 1 -- 172.21.15.72:0/841425969 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0011d20 con 0x7fb9a415e7f0 2023-10-14T12:34:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9abbf3700 1 -- 172.21.15.72:0/841425969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a415e7f0 msgr2=0x7fb9a406ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.522+0000 7fb9abbf3700 1 --2- 172.21.15.72:0/841425969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a415e7f0 0x7fb9a406ac00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4067df0 tx=0x7fb9a0009b20 comp rx=0 tx=0).stop 2023-10-14T12:34:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.523+0000 7fb9abbf3700 1 -- 172.21.15.72:0/841425969 shutdown_connections 2023-10-14T12:34:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.523+0000 7fb9abbf3700 1 --2- 172.21.15.72:0/841425969 >> v2:172.21.15.123:3300/0 conn(0x7fb9a406a820 0x7fb9a40cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.523+0000 7fb9abbf3700 1 --2- 172.21.15.72:0/841425969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a415e7f0 0x7fb9a406ac00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.523+0000 7fb9abbf3700 1 -- 172.21.15.72:0/841425969 >> 172.21.15.72:0/841425969 conn(0x7fb9a40d0180 msgr2=0x7fb9a40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:30.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.523+0000 7fb9abbf3700 1 -- 172.21.15.72:0/841425969 shutdown_connections 2023-10-14T12:34:30.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.523+0000 7fb9abbf3700 1 -- 172.21.15.72:0/841425969 wait complete. 2023-10-14T12:34:30.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.524+0000 7fb9abbf3700 1 Processor -- start 2023-10-14T12:34:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.524+0000 7fb9abbf3700 1 -- start start 2023-10-14T12:34:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9abbf3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a406a820 0x7fb9a40b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9abbf3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a40ca7d0 0x7fb9a4151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9abbf3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9a415e7f0 0x7fb9a4161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9abbf3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41f7520 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9abbf3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a40b4950 con 0x7fb9a406a820 2023-10-14T12:34:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9abbf3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4152290 con 0x7fb9a415e7f0 2023-10-14T12:34:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a918e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a40ca7d0 0x7fb9a4151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a918e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a40ca7d0 0x7fb9a4151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48228/0 (socket says 172.21.15.72:48228) 2023-10-14T12:34:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a918e700 1 -- 172.21.15.72:0/2309475237 learned_addr learned my addr 172.21.15.72:0/2309475237 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:30.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a998f700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a406a820 0x7fb9a40b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9aa190700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9a415e7f0 0x7fb9a4161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a918e700 1 -- 172.21.15.72:0/2309475237 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9a415e7f0 msgr2=0x7fb9a4161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a918e700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9a415e7f0 0x7fb9a4161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a918e700 1 -- 172.21.15.72:0/2309475237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a406a820 msgr2=0x7fb9a40b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a918e700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a406a820 0x7fb9a40b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a918e700 1 -- 172.21.15.72:0/2309475237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a00094a0 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9a918e700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a40ca7d0 0x7fb9a4151d50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0000c00 tx=0x7fb9a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:30.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb99a7fc700 1 -- 172.21.15.72:0/2309475237 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00045d0 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb99a7fc700 1 -- 172.21.15.72:0/2309475237 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a001e070 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb99a7fc700 1 -- 172.21.15.72:0/2309475237 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00038e0 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a41f68a0 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.525+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a41f6e60 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.526+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a404ebb0 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.527+0000 7fb99a7fc700 1 -- 172.21.15.72:0/2309475237 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb9a0003a40 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.527+0000 7fb99a7fc700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb98806af00 0x7fb98806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.528+0000 7fb9a998f700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb98806af00 0x7fb98806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.528+0000 7fb99a7fc700 1 -- 172.21.15.72:0/2309475237 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb9a008ada0 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.528+0000 7fb9a998f700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb98806af00 0x7fb98806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb994006b20 tx=0x7fb994008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:30.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.531+0000 7fb99a7fc700 1 -- 172.21.15.72:0/2309475237 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9a0055b00 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.763+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9a40b6100 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.764+0000 7fb99a7fc700 1 -- 172.21.15.72:0/2309475237 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fb9a0059120 con 0x7fb9a40ca7d0 2023-10-14T12:34:30.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:30.766 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:47.920500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:34:30.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb98806af00 msgr2=0x7fb98806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb98806af00 0x7fb98806d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb994006b20 tx=0x7fb994008040 comp rx=0 tx=0).stop 2023-10-14T12:34:30.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a40ca7d0 msgr2=0x7fb9a4151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a40ca7d0 0x7fb9a4151d50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0000c00 tx=0x7fb9a0004750 comp rx=0 tx=0).stop 2023-10-14T12:34:30.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 shutdown_connections 2023-10-14T12:34:30.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb98806af00 0x7fb98806d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb9a415e7f0 0x7fb9a4161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a406a820 0x7fb9a40b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 --2- 172.21.15.72:0/2309475237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb9a40ca7d0 0x7fb9a4151d50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 >> 172.21.15.72:0/2309475237 conn(0x7fb9a40d0180 msgr2=0x7fb9a40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:30.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 shutdown_connections 2023-10-14T12:34:30.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.766+0000 7fb9abbf3700 1 -- 172.21.15.72:0/2309475237 wait complete. 2023-10-14T12:34:30.771 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-10-14T12:34:30.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:30.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.898+0000 7f2656888700 1 Processor -- start 2023-10-14T12:34:30.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f2656888700 1 -- start start 2023-10-14T12:34:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f2656888700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f265006a820 0x7f26500cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f2656888700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f265015e7f0 0x7f265006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f2656888700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 0x7f2650071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f2656888700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26500ce410 con 0x7f265015e7f0 2023-10-14T12:34:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f2656888700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26500cfeb0 con 0x7f265006a820 2023-10-14T12:34:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f2656888700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265015ec50 con 0x7f26500ca7d0 2023-10-14T12:34:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f264f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f265015e7f0 0x7f265006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f264f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f265015e7f0 0x7f265006ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48234/0 (socket says 172.21.15.72:48234) 2023-10-14T12:34:30.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.899+0000 7f264f7fe700 1 -- 172.21.15.72:0/1081472613 learned_addr learned my addr 172.21.15.72:0/1081472613 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264ffff700 1 --2- 172.21.15.72:0/1081472613 >> v2:172.21.15.123:3300/0 conn(0x7f265006a820 0x7f26500cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f2654e25700 1 --2- 172.21.15.72:0/1081472613 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 0x7f2650071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264f7fe700 1 -- 172.21.15.72:0/1081472613 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 msgr2=0x7f2650071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264f7fe700 1 --2- 172.21.15.72:0/1081472613 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 0x7f2650071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264f7fe700 1 -- 172.21.15.72:0/1081472613 >> v2:172.21.15.123:3300/0 conn(0x7f265006a820 msgr2=0x7f26500cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:30.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264f7fe700 1 --2- 172.21.15.72:0/1081472613 >> v2:172.21.15.123:3300/0 conn(0x7f265006a820 0x7f26500cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264f7fe700 1 -- 172.21.15.72:0/1081472613 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26500af9d0 con 0x7f265015e7f0 2023-10-14T12:34:30.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264ffff700 1 --2- 172.21.15.72:0/1081472613 >> v2:172.21.15.123:3300/0 conn(0x7f265006a820 0x7f26500cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:30.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f2654e25700 1 --2- 172.21.15.72:0/1081472613 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 0x7f2650071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:30.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264f7fe700 1 --2- 172.21.15.72:0/1081472613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265015e7f0 0x7f265006ac00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2650067df0 tx=0x7f2644009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a84e066293fbb2c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264effd700 1 -- 172.21.15.72:0/1081472613 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400b870 con 0x7f265015e7f0 2023-10-14T12:34:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264effd700 1 -- 172.21.15.72:0/1081472613 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400b9d0 con 0x7f265015e7f0 2023-10-14T12:34:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.900+0000 7f264effd700 1 -- 172.21.15.72:0/1081472613 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400bd60 con 0x7f265015e7f0 2023-10-14T12:34:30.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.901+0000 7f2656888700 1 -- 172.21.15.72:0/1081472613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265015e7f0 msgr2=0x7f265006ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.901+0000 7f2656888700 1 --2- 172.21.15.72:0/1081472613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265015e7f0 0x7f265006ac00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2650067df0 tx=0x7f2644009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.901+0000 7f2656888700 1 -- 172.21.15.72:0/1081472613 shutdown_connections 2023-10-14T12:34:30.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.901+0000 7f2656888700 1 --2- 172.21.15.72:0/1081472613 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 0x7f2650071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.901+0000 7f2656888700 1 --2- 172.21.15.72:0/1081472613 >> v2:172.21.15.123:3300/0 conn(0x7f265006a820 0x7f26500cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.901+0000 7f2656888700 1 --2- 172.21.15.72:0/1081472613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265015e7f0 0x7f265006ac00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.901+0000 7f2656888700 1 -- 172.21.15.72:0/1081472613 >> 172.21.15.72:0/1081472613 conn(0x7f26500d0180 msgr2=0x7f26500d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:30.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.901+0000 7f2656888700 1 -- 172.21.15.72:0/1081472613 shutdown_connections 2023-10-14T12:34:30.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.901+0000 7f2656888700 1 -- 172.21.15.72:0/1081472613 wait complete. 2023-10-14T12:34:30.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.902+0000 7f2656888700 1 Processor -- start 2023-10-14T12:34:30.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.902+0000 7f2656888700 1 -- start start 2023-10-14T12:34:30.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.903+0000 7f2656888700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265006a820 0x7f26501578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.903+0000 7f2656888700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 0x7f26500c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.903+0000 7f2656888700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f265015e7f0 0x7f265014c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.903+0000 7f2656888700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26500af250 con 0x7f265006a820 2023-10-14T12:34:30.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.903+0000 7f2656888700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265014c6d0 con 0x7f265015e7f0 2023-10-14T12:34:30.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.903+0000 7f2656888700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265015b2a0 con 0x7f26500ca7d0 2023-10-14T12:34:30.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.903+0000 7f264ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265006a820 0x7f26501578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.903+0000 7f264ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265006a820 0x7f26501578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48238/0 (socket says 172.21.15.72:48238) 2023-10-14T12:34:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.903+0000 7f264ffff700 1 -- 172.21.15.72:0/1984604571 learned_addr learned my addr 172.21.15.72:0/1984604571 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f264ffff700 1 -- 172.21.15.72:0/1984604571 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 msgr2=0x7f26500c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f264ffff700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 0x7f26500c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f264ffff700 1 -- 172.21.15.72:0/1984604571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f265015e7f0 msgr2=0x7f265014c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:30.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f2654e25700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f265015e7f0 0x7f265014c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f264ffff700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f265015e7f0 0x7f265014c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:30.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f264ffff700 1 -- 172.21.15.72:0/1984604571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644009550 con 0x7f265006a820 2023-10-14T12:34:30.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f264ffff700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265006a820 0x7f26501578c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f264000c780 tx=0x7f264000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:30.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f264cff9700 1 -- 172.21.15.72:0/1984604571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640011800 con 0x7f265006a820 2023-10-14T12:34:30.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f264cff9700 1 -- 172.21.15.72:0/1984604571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2640011960 con 0x7f265006a820 2023-10-14T12:34:30.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f265015b580 con 0x7f265006a820 2023-10-14T12:34:30.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f264cff9700 1 -- 172.21.15.72:0/1984604571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640011cd0 con 0x7f265006a820 2023-10-14T12:34:30.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.904+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265015bb40 con 0x7f265006a820 2023-10-14T12:34:30.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.905+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265004ebb0 con 0x7f265006a820 2023-10-14T12:34:30.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.905+0000 7f264cff9700 1 -- 172.21.15.72:0/1984604571 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2640021350 con 0x7f265006a820 2023-10-14T12:34:30.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.906+0000 7f264cff9700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f263c06af00 0x7f263c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:30.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.906+0000 7f264f7fe700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f263c06af00 0x7f263c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:30.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.906+0000 7f264cff9700 1 -- 172.21.15.72:0/1984604571 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f26400899b0 con 0x7f265006a820 2023-10-14T12:34:30.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.906+0000 7f264f7fe700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f263c06af00 0x7f263c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f26500c6c90 tx=0x7f2644010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:30.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:30.910+0000 7f264cff9700 1 -- 172.21.15.72:0/1984604571 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26400546b0 con 0x7f265006a820 2023-10-14T12:34:31.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.099+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f265006b490 con 0x7f265006a820 2023-10-14T12:34:31.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.100+0000 7f264cff9700 1 -- 172.21.15.72:0/1984604571 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18678 (secure 0 0 0) 0x7f2640057cd0 con 0x7f265006a820 2023-10-14T12:34:31.102 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:31.102 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:20.981579+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:31.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f263c06af00 msgr2=0x7f263c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f263c06af00 0x7f263c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f26500c6c90 tx=0x7f2644010000 comp rx=0 tx=0).stop 2023-10-14T12:34:31.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265006a820 msgr2=0x7f26501578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265006a820 0x7f26501578c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f264000c780 tx=0x7f264000cb40 comp rx=0 tx=0).stop 2023-10-14T12:34:31.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 shutdown_connections 2023-10-14T12:34:31.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f263c06af00 0x7f263c06d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f265015e7f0 0x7f265014c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f265006a820 0x7f26501578c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 --2- 172.21.15.72:0/1984604571 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f26500ca7d0 0x7f26500c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 >> 172.21.15.72:0/1984604571 conn(0x7f26500d0180 msgr2=0x7f26500cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:31.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 shutdown_connections 2023-10-14T12:34:31.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.102+0000 7f2656888700 1 -- 172.21.15.72:0/1984604571 wait complete. 2023-10-14T12:34:31.116 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T12:34:31.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:34:31.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.234+0000 7f2803c58700 1 Processor -- start 2023-10-14T12:34:31.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.235+0000 7f2803c58700 1 -- start start 2023-10-14T12:34:31.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.235+0000 7f2803c58700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27fc06b7e0 0x7f27fc06bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.235+0000 7f2803c58700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f27fc0b6620 0x7f27fc0b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f2803c58700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27fc0ce7e0 con 0x7f27fc15d890 2023-10-14T12:34:31.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f2803c58700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc06c1d0 con 0x7f27fc06b7e0 2023-10-14T12:34:31.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f2803c58700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc0ceab0 con 0x7f27fc0b6620 2023-10-14T12:34:31.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28011f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27fc06b7e0 0x7f27fc06bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28011f3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27fc06b7e0 0x7f27fc06bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48248/0 (socket says 172.21.15.72:48248) 2023-10-14T12:34:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28011f3700 1 -- 172.21.15.72:0/2608645131 learned_addr learned my addr 172.21.15.72:0/2608645131 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28021f5700 1 --2- 172.21.15.72:0/2608645131 >> v2:172.21.15.123:3300/0 conn(0x7f27fc0b6620 0x7f27fc0b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28011f3700 1 -- 172.21.15.72:0/2608645131 >> v2:172.21.15.123:3300/0 conn(0x7f27fc0b6620 msgr2=0x7f27fc0b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28011f3700 1 --2- 172.21.15.72:0/2608645131 >> v2:172.21.15.123:3300/0 conn(0x7f27fc0b6620 0x7f27fc0b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28011f3700 1 -- 172.21.15.72:0/2608645131 >> v1:172.21.15.123:6789/0 conn(0x7f27fc15d890 legacy=0x7f27fc0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28011f3700 1 -- 172.21.15.72:0/2608645131 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc0ced90 con 0x7f27fc06b7e0 2023-10-14T12:34:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28011f3700 1 --2- 172.21.15.72:0/2608645131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc06b7e0 0x7f27fc06bc90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0b2f40 tx=0x7f27ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f9f43d003da57 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28009f2700 1 -- 172.21.15.72:0/2608645131 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec00b870 con 0x7f27fc06b7e0 2023-10-14T12:34:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28009f2700 1 -- 172.21.15.72:0/2608645131 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec00b9d0 con 0x7f27fc06b7e0 2023-10-14T12:34:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.236+0000 7f28009f2700 1 -- 172.21.15.72:0/2608645131 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec00bd60 con 0x7f27fc06b7e0 2023-10-14T12:34:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.237+0000 7f2803c58700 1 -- 172.21.15.72:0/2608645131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc06b7e0 msgr2=0x7f27fc06bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.237+0000 7f2803c58700 1 --2- 172.21.15.72:0/2608645131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc06b7e0 0x7f27fc06bc90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0b2f40 tx=0x7f27ec009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.237+0000 7f2803c58700 1 -- 172.21.15.72:0/2608645131 shutdown_connections 2023-10-14T12:34:31.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.237+0000 7f2803c58700 1 --2- 172.21.15.72:0/2608645131 >> v2:172.21.15.123:3300/0 conn(0x7f27fc0b6620 0x7f27fc0b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.237+0000 7f2803c58700 1 --2- 172.21.15.72:0/2608645131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc06b7e0 0x7f27fc06bc90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.237+0000 7f2803c58700 1 -- 172.21.15.72:0/2608645131 >> 172.21.15.72:0/2608645131 conn(0x7f27fc072340 msgr2=0x7f27fc072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.237+0000 7f2803c58700 1 -- 172.21.15.72:0/2608645131 shutdown_connections 2023-10-14T12:34:31.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.237+0000 7f2803c58700 1 -- 172.21.15.72:0/2608645131 wait complete. 2023-10-14T12:34:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.238+0000 7f2803c58700 1 Processor -- start 2023-10-14T12:34:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.238+0000 7f2803c58700 1 -- start start 2023-10-14T12:34:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f2803c58700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc0b6620 0x7f27fc14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f2803c58700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc15d890 0x7f27fc0b7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f2803c58700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc0b7b60 0x7f27fc0b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f2803c58700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0b7ff0 con 0x7f27fc0b7b60 2023-10-14T12:34:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f2803c58700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc14ceb0 con 0x7f27fc15d890 2023-10-14T12:34:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f2803c58700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0cb090 con 0x7f27fc0b6620 2023-10-14T12:34:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28021f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc0b7b60 0x7f27fc0b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28021f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc0b7b60 0x7f27fc0b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48252/0 (socket says 172.21.15.72:48252) 2023-10-14T12:34:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28021f5700 1 -- 172.21.15.72:0/789586432 learned_addr learned my addr 172.21.15.72:0/789586432 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28011f3700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc15d890 0x7f27fc0b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28019f4700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc0b6620 0x7f27fc14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28021f5700 1 -- 172.21.15.72:0/789586432 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc0b6620 msgr2=0x7f27fc14c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28021f5700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc0b6620 0x7f27fc14c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28021f5700 1 -- 172.21.15.72:0/789586432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc15d890 msgr2=0x7f27fc0b7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28021f5700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc15d890 0x7f27fc0b7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28021f5700 1 -- 172.21.15.72:0/789586432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec009550 con 0x7f27fc0b7b60 2023-10-14T12:34:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28011f3700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc15d890 0x7f27fc0b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.239+0000 7f28021f5700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc0b7b60 0x7f27fc0b3310 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f27f4007e40 tx=0x7f27f400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.240+0000 7f27f27fc700 1 -- 172.21.15.72:0/789586432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400ee40 con 0x7f27fc0b7b60 2023-10-14T12:34:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.240+0000 7f27f27fc700 1 -- 172.21.15.72:0/789586432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f4014420 con 0x7f27fc0b7b60 2023-10-14T12:34:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.240+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27fc0ca7a0 con 0x7f27fc0b7b60 2023-10-14T12:34:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.240+0000 7f27f27fc700 1 -- 172.21.15.72:0/789586432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40147d0 con 0x7f27fc0b7b60 2023-10-14T12:34:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.240+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc0caa40 con 0x7f27fc0b7b60 2023-10-14T12:34:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.240+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27fc0cb200 con 0x7f27fc0b7b60 2023-10-14T12:34:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.241+0000 7f27f27fc700 1 -- 172.21.15.72:0/789586432 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f27f4014930 con 0x7f27fc0b7b60 2023-10-14T12:34:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.241+0000 7f27f27fc700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f27e006af00 0x7f27e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.241+0000 7f27f27fc700 1 -- 172.21.15.72:0/789586432 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f27f408a160 con 0x7f27fc0b7b60 2023-10-14T12:34:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.241+0000 7f28019f4700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f27e006af00 0x7f27e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.242+0000 7f28019f4700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f27e006af00 0x7f27e006d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f27f8000f60 tx=0x7f27f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:31.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.246+0000 7f27f27fc700 1 -- 172.21.15.72:0/789586432 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27f4054e50 con 0x7f27fc0b7b60 2023-10-14T12:34:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.480+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27fc04ebb0 con 0x7f27fc0b7b60 2023-10-14T12:34:31.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.481+0000 7f27f27fc700 1 -- 172.21.15.72:0/789586432 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f27f4058470 con 0x7f27fc0b7b60 2023-10-14T12:34:31.482 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:31.483 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:47.920500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:34:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f27e006af00 msgr2=0x7f27e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f27e006af00 0x7f27e006d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f27f8000f60 tx=0x7f27f8009040 comp rx=0 tx=0).stop 2023-10-14T12:34:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc0b7b60 msgr2=0x7f27fc0b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc0b7b60 0x7f27fc0b3310 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f27f4007e40 tx=0x7f27f400e3c0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 shutdown_connections 2023-10-14T12:34:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f27e006af00 0x7f27e006d3c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27fc0b7b60 0x7f27fc0b3310 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f27fc0b6620 0x7f27fc14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 --2- 172.21.15.72:0/789586432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27fc15d890 0x7f27fc0b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 >> 172.21.15.72:0/789586432 conn(0x7f27fc072340 msgr2=0x7f27fc0b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 shutdown_connections 2023-10-14T12:34:31.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.483+0000 7f2803c58700 1 -- 172.21.15.72:0/789586432 wait complete. 2023-10-14T12:34:31.487 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-10-14T12:34:31.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:34:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.614+0000 7f94e607c700 1 Processor -- start 2023-10-14T12:34:31.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.615+0000 7f94e607c700 1 -- start start 2023-10-14T12:34:31.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.615+0000 7f94e607c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f94e00cf7d0 0x7f94e015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.615+0000 7f94e607c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00cfeb0 con 0x7f94e00ca7d0 2023-10-14T12:34:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.615+0000 7f94e607c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00cfc30 con 0x7f94e006a820 2023-10-14T12:34:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.615+0000 7f94e607c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e00ce410 con 0x7f94e00cf7d0 2023-10-14T12:34:31.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.615+0000 7f94dffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f94e00ca7d0 0x7f94e0071ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54564/0 (socket says 172.21.15.72:54564) 2023-10-14T12:34:31.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.615+0000 7f94dffff700 1 -- 172.21.15.72:0/1993757250 learned_addr learned my addr 172.21.15.72:0/1993757250 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:31.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94deffd700 1 --2- 172.21.15.72:0/1993757250 >> v2:172.21.15.123:3300/0 conn(0x7f94e00cf7d0 0x7f94e015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143721494 0 0) 0x7f94e00cfeb0 con 0x7f94e00ca7d0 2023-10-14T12:34:31.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94cc0035b0 con 0x7f94e00ca7d0 2023-10-14T12:34:31.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666867187 0 0) 0x7f94e00cfc30 con 0x7f94e006a820 2023-10-14T12:34:31.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e00cfeb0 con 0x7f94e006a820 2023-10-14T12:34:31.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738337287 0 0) 0x7f94cc0035b0 con 0x7f94e00ca7d0 2023-10-14T12:34:31.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 >> v2:172.21.15.123:3300/0 conn(0x7f94e00cf7d0 msgr2=0x7f94e015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:31.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 --2- 172.21.15.72:0/1993757250 >> v2:172.21.15.123:3300/0 conn(0x7f94e00cf7d0 0x7f94e015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 >> v1:172.21.15.123:6789/0 conn(0x7f94e006a820 legacy=0x7f94e006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00af9d0 con 0x7f94e00ca7d0 2023-10-14T12:34:31.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f94d0001a40 con 0x7f94e00ca7d0 2023-10-14T12:34:31.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 >> v1:172.21.15.72:6789/0 conn(0x7f94e00ca7d0 legacy=0x7f94e0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94cc003b90 0x7f94cc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f94cc004850 0x7f94cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94cc005210 0x7f94cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00ce410 con 0x7f94cc005210 2023-10-14T12:34:31.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc00c140 con 0x7f94cc003b90 2023-10-14T12:34:31.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc00c300 con 0x7f94cc004850 2023-10-14T12:34:31.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94deffd700 1 --2- 172.21.15.72:0/1993757250 >> v2:172.21.15.123:3300/0 conn(0x7f94e00cf7d0 0x7f94e015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:31.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94dffff700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94cc005210 0x7f94cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94df7fe700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94cc003b90 0x7f94cc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94deffd700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f94cc004850 0x7f94cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94dffff700 1 -- 172.21.15.72:0/1993757250 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f94cc004850 msgr2=0x7f94cc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:31.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94dffff700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f94cc004850 0x7f94cc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94dffff700 1 -- 172.21.15.72:0/1993757250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94cc003b90 msgr2=0x7f94cc003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:31.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94dffff700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94cc003b90 0x7f94cc003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.616+0000 7f94dffff700 1 -- 172.21.15.72:0/1993757250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc0035b0 con 0x7f94cc005210 2023-10-14T12:34:31.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94dffff700 1 -- 172.21.15.72:0/1993757250 reap_dead start 2023-10-14T12:34:31.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94dffff700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94cc005210 0x7f94cc00ba10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f94d000a760 tx=0x7f94cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1210c5e5ceed2d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:31.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00072d0 con 0x7f94cc005210 2023-10-14T12:34:31.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0007430 con 0x7f94cc005210 2023-10-14T12:34:31.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94de7fc700 1 -- 172.21.15.72:0/1993757250 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00077e0 con 0x7f94cc005210 2023-10-14T12:34:31.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94e607c700 1 -- 172.21.15.72:0/1993757250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94cc005210 msgr2=0x7f94cc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94e607c700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94cc005210 0x7f94cc00ba10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f94d000a760 tx=0x7f94cc005880 comp rx=0 tx=0).stop 2023-10-14T12:34:31.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94e607c700 1 -- 172.21.15.72:0/1993757250 shutdown_connections 2023-10-14T12:34:31.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94e607c700 1 --2- 172.21.15.72:0/1993757250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94cc005210 0x7f94cc00ba10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94e607c700 1 -- 172.21.15.72:0/1993757250 >> 172.21.15.72:0/1993757250 conn(0x7f94e00d0180 msgr2=0x7f94e00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:31.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94e607c700 1 -- 172.21.15.72:0/1993757250 shutdown_connections 2023-10-14T12:34:31.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.617+0000 7f94e607c700 1 -- 172.21.15.72:0/1993757250 wait complete. 2023-10-14T12:34:31.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.619+0000 7f94e607c700 1 Processor -- start 2023-10-14T12:34:31.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.619+0000 7f94e607c700 1 -- start start 2023-10-14T12:34:31.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.619+0000 7f94e607c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f94cc005210 0x7f94e0154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.619+0000 7f94e607c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e0157df0 0x7f94e01545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.619+0000 7f94e607c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e00c6740 0x7f94e00b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.619+0000 7f94e607c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00aebc0 con 0x7f94e0157df0 2023-10-14T12:34:31.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.619+0000 7f94e607c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00aeea0 con 0x7f94e00c6740 2023-10-14T12:34:31.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.619+0000 7f94e607c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c5f40 con 0x7f94cc005210 2023-10-14T12:34:31.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94deffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e0157df0 0x7f94e01545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94deffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e0157df0 0x7f94e01545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48276/0 (socket says 172.21.15.72:48276) 2023-10-14T12:34:31.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94deffd700 1 -- 172.21.15.72:0/2095291549 learned_addr learned my addr 172.21.15.72:0/2095291549 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:31.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94df7fe700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f94cc005210 0x7f94e0154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94dffff700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e00c6740 0x7f94e00b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94deffd700 1 -- 172.21.15.72:0/2095291549 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f94cc005210 msgr2=0x7f94e0154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94deffd700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f94cc005210 0x7f94e0154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94deffd700 1 -- 172.21.15.72:0/2095291549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e00c6740 msgr2=0x7f94e00b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94deffd700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e00c6740 0x7f94e00b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94deffd700 1 -- 172.21.15.72:0/2095291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00c6220 con 0x7f94e0157df0 2023-10-14T12:34:31.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94dffff700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e00c6740 0x7f94e00b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:31.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94deffd700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e0157df0 0x7f94e01545f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f94c8010a30 tx=0x7f94c8010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:31.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94d7fff700 1 -- 172.21.15.72:0/2095291549 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c800e930 con 0x7f94e0157df0 2023-10-14T12:34:31.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94d7fff700 1 -- 172.21.15.72:0/2095291549 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c800ea90 con 0x7f94e0157df0 2023-10-14T12:34:31.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e0154b30 con 0x7f94e0157df0 2023-10-14T12:34:31.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94d7fff700 1 -- 172.21.15.72:0/2095291549 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c800ee40 con 0x7f94e0157df0 2023-10-14T12:34:31.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.620+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e00c5b60 con 0x7f94e0157df0 2023-10-14T12:34:31.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.621+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00c6590 con 0x7f94e0157df0 2023-10-14T12:34:31.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.621+0000 7f94d7fff700 1 -- 172.21.15.72:0/2095291549 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f94c8016460 con 0x7f94e0157df0 2023-10-14T12:34:31.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.622+0000 7f94d7fff700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f94c006af00 0x7f94c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:31.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.622+0000 7f94df7fe700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f94c006af00 0x7f94c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:31.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.622+0000 7f94d7fff700 1 -- 172.21.15.72:0/2095291549 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f94c808a000 con 0x7f94e0157df0 2023-10-14T12:34:31.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.622+0000 7f94df7fe700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f94c006af00 0x7f94c006d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f94e00d0a60 tx=0x7f94d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:31.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.626+0000 7f94d7fff700 1 -- 172.21.15.72:0/2095291549 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f94c8054cf0 con 0x7f94e0157df0 2023-10-14T12:34:31.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.864+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94e00aefe0 con 0x7f94e0157df0 2023-10-14T12:34:31.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.864+0000 7f94d7fff700 1 -- 172.21.15.72:0/2095291549 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f94e00aefe0 con 0x7f94e0157df0 2023-10-14T12:34:31.866 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:31.866 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1317924144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1317924144},{"type":"v1","addr":"172.21.15.72:6837","nonce":1317924144}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/775301415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":775301415},{"type":"v1","addr":"172.21.15.72:6836","nonce":775301415}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4159899029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4159899029},{"type":"v1","addr":"172.21.15.123:6834","nonce":4159899029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:33:31.210218+0000","modified":"2023-10-14T12:33:47.920500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3216890106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3216890106},{"type":"v1","addr":"172.21.15.123:6835","nonce":3216890106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:34:31.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f94c006af00 msgr2=0x7f94c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f94c006af00 0x7f94c006d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f94e00d0a60 tx=0x7f94d8009040 comp rx=0 tx=0).stop 2023-10-14T12:34:31.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e0157df0 msgr2=0x7f94e01545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:31.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e0157df0 0x7f94e01545f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f94c8010a30 tx=0x7f94c8010df0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 shutdown_connections 2023-10-14T12:34:31.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f94c006af00 0x7f94c006d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94e00c6740 0x7f94e00b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f94cc005210 0x7f94e0154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 --2- 172.21.15.72:0/2095291549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94e0157df0 0x7f94e01545f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:31.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 >> 172.21.15.72:0/2095291549 conn(0x7f94e00d0180 msgr2=0x7f94e0071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:31.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 shutdown_connections 2023-10-14T12:34:31.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:31.867+0000 7f94e607c700 1 -- 172.21.15.72:0/2095291549 wait complete. 2023-10-14T12:34:31.871 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 9 2023-10-14T12:34:31.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.000+0000 7f52cf97a700 1 Processor -- start 2023-10-14T12:34:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.000+0000 7f52cf97a700 1 -- start start 2023-10-14T12:34:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cf97a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c8152470 0x7f52c80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cf97a700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f52c80cb8d0 0x7f52c80b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cf97a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c8070d70 con 0x7f52c80b3240 2023-10-14T12:34:32.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cf97a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c80b36d0 con 0x7f52c8152470 2023-10-14T12:34:32.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cf97a700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c8071200 con 0x7f52c80cb8d0 2023-10-14T12:34:32.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cd716700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c8152470 0x7f52c80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cdf17700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f52c80b3240 0x7f52c80b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54584/0 (socket says 172.21.15.72:54584) 2023-10-14T12:34:32.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cd716700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c8152470 0x7f52c80cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48280/0 (socket says 172.21.15.72:48280) 2023-10-14T12:34:32.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cdf17700 1 -- 172.21.15.72:0/2884701541 learned_addr learned my addr 172.21.15.72:0/2884701541 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:32.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52ccf15700 1 --2- 172.21.15.72:0/2884701541 >> v2:172.21.15.123:3300/0 conn(0x7f52c80cb8d0 0x7f52c80b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52bffff700 1 -- 172.21.15.72:0/2884701541 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323494916 0 0) 0x7f52c8070d70 con 0x7f52c80b3240 2023-10-14T12:34:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52bffff700 1 -- 172.21.15.72:0/2884701541 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b40035b0 con 0x7f52c80b3240 2023-10-14T12:34:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cd716700 1 -- 172.21.15.72:0/2884701541 >> v2:172.21.15.123:3300/0 conn(0x7f52c80cb8d0 msgr2=0x7f52c80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cd716700 1 --2- 172.21.15.72:0/2884701541 >> v2:172.21.15.123:3300/0 conn(0x7f52c80cb8d0 0x7f52c80b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cd716700 1 -- 172.21.15.72:0/2884701541 >> v1:172.21.15.72:6789/0 conn(0x7f52c80b3240 legacy=0x7f52c80b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cd716700 1 -- 172.21.15.72:0/2884701541 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80cbd80 con 0x7f52c8152470 2023-10-14T12:34:32.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52ccf15700 1 --2- 172.21.15.72:0/2884701541 >> v2:172.21.15.123:3300/0 conn(0x7f52c80cb8d0 0x7f52c80b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:32.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.001+0000 7f52cd716700 1 --2- 172.21.15.72:0/2884701541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 0x7f52c80cd570 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f52c80cd2e0 tx=0x7f52c4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a336fd0e551dec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:32.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52bffff700 1 -- 172.21.15.72:0/2884701541 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4011830 con 0x7f52c8152470 2023-10-14T12:34:32.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52bffff700 1 -- 172.21.15.72:0/2884701541 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c4011990 con 0x7f52c8152470 2023-10-14T12:34:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52bffff700 1 -- 172.21.15.72:0/2884701541 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4011d20 con 0x7f52c8152470 2023-10-14T12:34:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52cf97a700 1 -- 172.21.15.72:0/2884701541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 msgr2=0x7f52c80cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52cf97a700 1 --2- 172.21.15.72:0/2884701541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 0x7f52c80cd570 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f52c80cd2e0 tx=0x7f52c4009b20 comp rx=0 tx=0).stop 2023-10-14T12:34:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52cf97a700 1 -- 172.21.15.72:0/2884701541 shutdown_connections 2023-10-14T12:34:32.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52cf97a700 1 --2- 172.21.15.72:0/2884701541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 0x7f52c80cd570 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52cf97a700 1 --2- 172.21.15.72:0/2884701541 >> v2:172.21.15.123:3300/0 conn(0x7f52c80cb8d0 0x7f52c80b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52cf97a700 1 -- 172.21.15.72:0/2884701541 >> 172.21.15.72:0/2884701541 conn(0x7f52c80cdd00 msgr2=0x7f52c80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:32.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52cf97a700 1 -- 172.21.15.72:0/2884701541 shutdown_connections 2023-10-14T12:34:32.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.002+0000 7f52cf97a700 1 -- 172.21.15.72:0/2884701541 wait complete. 2023-10-14T12:34:32.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.003+0000 7f52cf97a700 1 Processor -- start 2023-10-14T12:34:32.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.003+0000 7f52cf97a700 1 -- start start 2023-10-14T12:34:32.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cf97a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52c80b3240 0x7f52c80c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cf97a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52c80cb8d0 0x7f52c8141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cf97a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 0x7f52c8142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cf97a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c81f4120 con 0x7f52c8152470 2023-10-14T12:34:32.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cf97a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c80c64f0 con 0x7f52c80cb8d0 2023-10-14T12:34:32.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cf97a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8142bf0 con 0x7f52c80b3240 2023-10-14T12:34:32.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cdf17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 0x7f52c8142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cdf17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 0x7f52c8142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48290/0 (socket says 172.21.15.72:48290) 2023-10-14T12:34:32.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cdf17700 1 -- 172.21.15.72:0/1648753406 learned_addr learned my addr 172.21.15.72:0/1648753406 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:32.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52ccf15700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52c80cb8d0 0x7f52c8141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cd716700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52c80b3240 0x7f52c80c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cdf17700 1 -- 172.21.15.72:0/1648753406 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52c80b3240 msgr2=0x7f52c80c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cdf17700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52c80b3240 0x7f52c80c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cdf17700 1 -- 172.21.15.72:0/1648753406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52c80cb8d0 msgr2=0x7f52c8141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cdf17700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52c80cb8d0 0x7f52c8141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.004+0000 7f52cdf17700 1 -- 172.21.15.72:0/1648753406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40094a0 con 0x7f52c8152470 2023-10-14T12:34:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.005+0000 7f52cdf17700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 0x7f52c8142520 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52c000cad0 tx=0x7f52c000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:32.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.005+0000 7f52bdffb700 1 -- 172.21.15.72:0/1648753406 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c000aa60 con 0x7f52c8152470 2023-10-14T12:34:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.005+0000 7f52bdffb700 1 -- 172.21.15.72:0/1648753406 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c000abc0 con 0x7f52c8152470 2023-10-14T12:34:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.005+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c8142ed0 con 0x7f52c8152470 2023-10-14T12:34:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.005+0000 7f52bdffb700 1 -- 172.21.15.72:0/1648753406 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0012400 con 0x7f52c8152470 2023-10-14T12:34:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.005+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c80c6180 con 0x7f52c8152470 2023-10-14T12:34:32.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.006+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c804ebb0 con 0x7f52c8152470 2023-10-14T12:34:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.006+0000 7f52bdffb700 1 -- 172.21.15.72:0/1648753406 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f52c001b3b0 con 0x7f52c8152470 2023-10-14T12:34:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.006+0000 7f52bdffb700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52ac06af00 0x7f52ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.007+0000 7f52bdffb700 1 -- 172.21.15.72:0/1648753406 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f52c0089690 con 0x7f52c8152470 2023-10-14T12:34:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.007+0000 7f52cd716700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52ac06af00 0x7f52ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.007+0000 7f52cd716700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52ac06af00 0x7f52ac06d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52c40090b0 tx=0x7f52c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:32.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.011+0000 7f52bdffb700 1 -- 172.21.15.72:0/1648753406 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52c0054380 con 0x7f52c8152470 2023-10-14T12:34:32.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.201+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52c80c6630 con 0x7f52c8152470 2023-10-14T12:34:32.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.202+0000 7f52bdffb700 1 -- 172.21.15.72:0/1648753406 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18678 (secure 0 0 0) 0x7f52c00579a0 con 0x7f52c8152470 2023-10-14T12:34:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:32.204 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:20.981579+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:33:29.264993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:33:30.168455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:33:33.851017+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:32.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.204+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52ac06af00 msgr2=0x7f52ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.204+0000 7f52cf97a700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52ac06af00 0x7f52ac06d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52c40090b0 tx=0x7f52c4008030 comp rx=0 tx=0).stop 2023-10-14T12:34:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.204+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 msgr2=0x7f52c8142520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.204+0000 7f52cf97a700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 0x7f52c8142520 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52c000cad0 tx=0x7f52c000cde0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.205+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 shutdown_connections 2023-10-14T12:34:32.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.205+0000 7f52cf97a700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f52ac06af00 0x7f52ac06d3c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.205+0000 7f52cf97a700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8152470 0x7f52c8142520 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.205+0000 7f52cf97a700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f52c80b3240 0x7f52c80c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.205+0000 7f52cf97a700 1 --2- 172.21.15.72:0/1648753406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52c80cb8d0 0x7f52c8141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.205+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 >> 172.21.15.72:0/1648753406 conn(0x7f52c80cdd00 msgr2=0x7f52c80d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.205+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 shutdown_connections 2023-10-14T12:34:32.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.205+0000 7f52cf97a700 1 -- 172.21.15.72:0/1648753406 wait complete. 2023-10-14T12:34:32.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T12:34:32.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.338+0000 7f1d4feb1700 1 Processor -- start 2023-10-14T12:34:32.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.338+0000 7f1d4feb1700 1 -- start start 2023-10-14T12:34:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4feb1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1d4806a820 0x7f1d480cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4feb1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d480ca7d0 0x7f1d48071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4feb1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d480cfeb0 con 0x7f1d4815e7f0 2023-10-14T12:34:32.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4feb1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d480ce410 con 0x7f1d480ca7d0 2023-10-14T12:34:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4feb1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4815ec50 con 0x7f1d4806a820 2023-10-14T12:34:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4e44e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d480ca7d0 0x7f1d48071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4e44e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d480ca7d0 0x7f1d48071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48296/0 (socket says 172.21.15.72:48296) 2023-10-14T12:34:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4e44e700 1 -- 172.21.15.72:0/3132049817 learned_addr learned my addr 172.21.15.72:0/3132049817 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:32.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4dc4d700 1 --2- 172.21.15.72:0/3132049817 >> v2:172.21.15.123:3300/0 conn(0x7f1d4806a820 0x7f1d480cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4e44e700 1 -- 172.21.15.72:0/3132049817 >> v2:172.21.15.123:3300/0 conn(0x7f1d4806a820 msgr2=0x7f1d480cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4e44e700 1 --2- 172.21.15.72:0/3132049817 >> v2:172.21.15.123:3300/0 conn(0x7f1d4806a820 0x7f1d480cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4e44e700 1 -- 172.21.15.72:0/3132049817 >> v1:172.21.15.123:6789/0 conn(0x7f1d4815e7f0 legacy=0x7f1d4806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4e44e700 1 -- 172.21.15.72:0/3132049817 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d480af9d0 con 0x7f1d480ca7d0 2023-10-14T12:34:32.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4e44e700 1 --2- 172.21.15.72:0/3132049817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d480ca7d0 0x7f1d48071ea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1d48067df0 tx=0x7f1d4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2e45e9b1296277 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4cc4b700 1 -- 172.21.15.72:0/3132049817 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000e070 con 0x7f1d480ca7d0 2023-10-14T12:34:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4cc4b700 1 -- 172.21.15.72:0/3132049817 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4000b9c0 con 0x7f1d480ca7d0 2023-10-14T12:34:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.339+0000 7f1d4cc4b700 1 -- 172.21.15.72:0/3132049817 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000bd70 con 0x7f1d480ca7d0 2023-10-14T12:34:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.340+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3132049817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d480ca7d0 msgr2=0x7f1d48071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.340+0000 7f1d4feb1700 1 --2- 172.21.15.72:0/3132049817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d480ca7d0 0x7f1d48071ea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1d48067df0 tx=0x7f1d4000b330 comp rx=0 tx=0).stop 2023-10-14T12:34:32.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.340+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3132049817 shutdown_connections 2023-10-14T12:34:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.340+0000 7f1d4feb1700 1 --2- 172.21.15.72:0/3132049817 >> v2:172.21.15.123:3300/0 conn(0x7f1d4806a820 0x7f1d480cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.340+0000 7f1d4feb1700 1 --2- 172.21.15.72:0/3132049817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d480ca7d0 0x7f1d48071ea0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.340+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3132049817 >> 172.21.15.72:0/3132049817 conn(0x7f1d480d0180 msgr2=0x7f1d480d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.340+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3132049817 shutdown_connections 2023-10-14T12:34:32.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.340+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3132049817 wait complete. 2023-10-14T12:34:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.341+0000 7f1d4feb1700 1 Processor -- start 2023-10-14T12:34:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.341+0000 7f1d4feb1700 1 -- start start 2023-10-14T12:34:32.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4feb1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4806a820 0x7f1d4806e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4feb1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d480ca7d0 0x7f1d480ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4feb1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d4815e7f0 0x7f1d481f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4feb1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d481521f0 con 0x7f1d4806a820 2023-10-14T12:34:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4feb1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4806d570 con 0x7f1d480ca7d0 2023-10-14T12:34:32.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4feb1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4806d850 con 0x7f1d4815e7f0 2023-10-14T12:34:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4dc4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4806a820 0x7f1d4806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4dc4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4806a820 0x7f1d4806e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48298/0 (socket says 172.21.15.72:48298) 2023-10-14T12:34:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4dc4d700 1 -- 172.21.15.72:0/3694909702 learned_addr learned my addr 172.21.15.72:0/3694909702 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4d44c700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d480ca7d0 0x7f1d480ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4dc4d700 1 -- 172.21.15.72:0/3694909702 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d4815e7f0 msgr2=0x7f1d481f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4dc4d700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d4815e7f0 0x7f1d481f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4dc4d700 1 -- 172.21.15.72:0/3694909702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d480ca7d0 msgr2=0x7f1d480ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4dc4d700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d480ca7d0 0x7f1d480ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4dc4d700 1 -- 172.21.15.72:0/3694909702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40009b30 con 0x7f1d4806a820 2023-10-14T12:34:32.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.342+0000 7f1d4d44c700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d480ca7d0 0x7f1d480ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.343+0000 7f1d4dc4d700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4806a820 0x7f1d4806e610 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400e810 tx=0x7f1d4400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.343+0000 7f1d3e7fc700 1 -- 172.21.15.72:0/3694909702 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44013610 con 0x7f1d4806a820 2023-10-14T12:34:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.343+0000 7f1d3e7fc700 1 -- 172.21.15.72:0/3694909702 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44013770 con 0x7f1d4806a820 2023-10-14T12:34:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.343+0000 7f1d3e7fc700 1 -- 172.21.15.72:0/3694909702 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44013b20 con 0x7f1d4806a820 2023-10-14T12:34:32.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.343+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4806db30 con 0x7f1d4806a820 2023-10-14T12:34:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.343+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4806e0f0 con 0x7f1d4806a820 2023-10-14T12:34:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.344+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4804ebb0 con 0x7f1d4806a820 2023-10-14T12:34:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.344+0000 7f1d3e7fc700 1 -- 172.21.15.72:0/3694909702 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d44013c80 con 0x7f1d4806a820 2023-10-14T12:34:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.344+0000 7f1d3e7fc700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d2c06af00 0x7f1d2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.344+0000 7f1d3e7fc700 1 -- 172.21.15.72:0/3694909702 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d44089700 con 0x7f1d4806a820 2023-10-14T12:34:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.344+0000 7f1d4d44c700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d2c06af00 0x7f1d2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.345+0000 7f1d4d44c700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d2c06af00 0x7f1d2c06d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d48158460 tx=0x7f1d38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:32.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.349+0000 7f1d3e7fc700 1 -- 172.21.15.72:0/3694909702 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d440543f0 con 0x7f1d4806a820 2023-10-14T12:34:32.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.578+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1d480b6100 con 0x7f1d4806a820 2023-10-14T12:34:32.580 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-10-14T12:34:32.579+0000 7f99edc60700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T12:34:32.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.580+0000 7f1d3e7fc700 1 -- 172.21.15.72:0/3694909702 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1d44057a10 con 0x7f1d4806a820 2023-10-14T12:34:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d2c06af00 msgr2=0x7f1d2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d2c06af00 0x7f1d2c06d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d48158460 tx=0x7f1d38009040 comp rx=0 tx=0).stop 2023-10-14T12:34:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4806a820 msgr2=0x7f1d4806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4806a820 0x7f1d4806e610 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400e810 tx=0x7f1d4400ebd0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 shutdown_connections 2023-10-14T12:34:32.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d2c06af00 0x7f1d2c06d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1d4815e7f0 0x7f1d481f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d4806a820 0x7f1d4806e610 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 --2- 172.21.15.72:0/3694909702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d480ca7d0 0x7f1d480ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 >> 172.21.15.72:0/3694909702 conn(0x7f1d480d0180 msgr2=0x7f1d480cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:32.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 shutdown_connections 2023-10-14T12:34:32.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.583+0000 7f1d4feb1700 1 -- 172.21.15.72:0/3694909702 wait complete. 2023-10-14T12:34:32.588 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T12:34:32.589 INFO:tasks.ceph.mds.d.smithi123.stderr: -5701> 2023-10-14T12:33:35.782+0000 7f2261737700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T12:34:32.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T12:34:32.620 INFO:tasks.ceph.mds.d.smithi123.stdout:starting mds.d at 2023-10-14T12:34:32.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.719+0000 7febbe115700 1 Processor -- start 2023-10-14T12:34:32.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.720+0000 7febbe115700 1 -- start start 2023-10-14T12:34:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.720+0000 7febbe115700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb815a250 0x7febb80717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.720+0000 7febbe115700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7febb815dec0 0x7febb806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.720+0000 7febbe115700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb80cba90 con 0x7febb815e320 2023-10-14T12:34:32.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.720+0000 7febbe115700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb80cb510 con 0x7febb815dec0 2023-10-14T12:34:32.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.720+0000 7febbe115700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb815ee40 con 0x7febb815a250 2023-10-14T12:34:32.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.720+0000 7febb7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7febb815e320 0x7febb80cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54606/0 (socket says 172.21.15.72:54606) 2023-10-14T12:34:32.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.720+0000 7febb7fff700 1 -- 172.21.15.72:0/3260191730 learned_addr learned my addr 172.21.15.72:0/3260191730 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:32.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb6ffd700 1 --2- 172.21.15.72:0/3260191730 >> v2:172.21.15.123:3300/0 conn(0x7febb815dec0 0x7febb806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb77fe700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb815a250 0x7febb80717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276747660 0 0) 0x7febb80cba90 con 0x7febb815e320 2023-10-14T12:34:32.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feba40035b0 con 0x7febb815e320 2023-10-14T12:34:32.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2304669140 0 0) 0x7feba40035b0 con 0x7febb815e320 2023-10-14T12:34:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb815a250 msgr2=0x7febb80717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb815a250 0x7febb80717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 >> v2:172.21.15.123:3300/0 conn(0x7febb815dec0 msgr2=0x7febb806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 --2- 172.21.15.72:0/3260191730 >> v2:172.21.15.123:3300/0 conn(0x7febb815dec0 0x7febb806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb815e880 con 0x7febb815e320 2023-10-14T12:34:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7febb00019f0 con 0x7febb815e320 2023-10-14T12:34:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 >> v1:172.21.15.72:6789/0 conn(0x7febb815e320 legacy=0x7febb80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feba4003a00 0x7feba4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7feba40048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba4004f40 0x7feba400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb80cb510 con 0x7feba40043f0 2023-10-14T12:34:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb815ee40 con 0x7feba4004f40 2023-10-14T12:34:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba400bf50 con 0x7feba4003a00 2023-10-14T12:34:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb6ffd700 1 --2- 172.21.15.72:0/3260191730 >> v2:172.21.15.123:3300/0 conn(0x7febb815dec0 0x7febb806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:32.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb77fe700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb815a250 0x7febb80717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:32.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb7fff700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba4004f40 0x7feba400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb6ffd700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7feba40048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.721+0000 7febb77fe700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feba4003a00 0x7feba4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb6ffd700 1 -- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feba4003a00 msgr2=0x7feba4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:32.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb6ffd700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feba4003a00 0x7feba4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb6ffd700 1 -- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba4004f40 msgr2=0x7feba400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:32.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb6ffd700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba4004f40 0x7feba400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb6ffd700 1 -- 172.21.15.72:0/3260191730 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40035b0 con 0x7feba40043f0 2023-10-14T12:34:32.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb7fff700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feba4004f40 0x7feba400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:32.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb6ffd700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7feba40048d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7feba8009d10 tx=0x7feba4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212110237ed17a0b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:32.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8009e60 con 0x7feba40043f0 2023-10-14T12:34:32.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba800e9a0 con 0x7feba40043f0 2023-10-14T12:34:32.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb67fc700 1 -- 172.21.15.72:0/3260191730 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba800ed10 con 0x7feba40043f0 2023-10-14T12:34:32.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febbe115700 1 -- 172.21.15.72:0/3260191730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 msgr2=0x7feba40048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febbe115700 1 --2- 172.21.15.72:0/3260191730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7feba40048d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7feba8009d10 tx=0x7feba4005880 comp rx=0 tx=0).stop 2023-10-14T12:34:32.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febb7fff700 1 -- 172.21.15.72:0/3260191730 reap_dead start 2023-10-14T12:34:32.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febbe115700 1 -- 172.21.15.72:0/3260191730 shutdown_connections 2023-10-14T12:34:32.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febbe115700 1 -- 172.21.15.72:0/3260191730 >> 172.21.15.72:0/3260191730 conn(0x7febb80ccbe0 msgr2=0x7febb80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:32.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febbe115700 1 -- 172.21.15.72:0/3260191730 shutdown_connections 2023-10-14T12:34:32.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.722+0000 7febbe115700 1 -- 172.21.15.72:0/3260191730 wait complete. 2023-10-14T12:34:32.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.724+0000 7febbe115700 1 Processor -- start 2023-10-14T12:34:32.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.724+0000 7febbe115700 1 -- start start 2023-10-14T12:34:32.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febbe115700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7febb814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febbe115700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febb815d720 0x7febb80c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febbe115700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb80c60b0 0x7febb80c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febbe115700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb80c6540 con 0x7feba40043f0 2023-10-14T12:34:32.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febbe115700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb814f7d0 con 0x7febb815d720 2023-10-14T12:34:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febbe115700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb815b2e0 con 0x7febb80c60b0 2023-10-14T12:34:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7febb814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7febb814f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48316/0 (socket says 172.21.15.72:48316) 2023-10-14T12:34:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb77fe700 1 -- 172.21.15.72:0/3080763161 learned_addr learned my addr 172.21.15.72:0/3080763161 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb6ffd700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febb815d720 0x7febb80c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb7fff700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb80c60b0 0x7febb80c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb77fe700 1 -- 172.21.15.72:0/3080763161 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb80c60b0 msgr2=0x7febb80c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb77fe700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb80c60b0 0x7febb80c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb77fe700 1 -- 172.21.15.72:0/3080763161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febb815d720 msgr2=0x7febb80c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb77fe700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febb815d720 0x7febb80c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:32.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb77fe700 1 -- 172.21.15.72:0/3080763161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb815c2f0 con 0x7feba40043f0 2023-10-14T12:34:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febb77fe700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7febb814f290 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feba0011c00 tx=0x7feba0011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febaffff700 1 -- 172.21.15.72:0/3080763161 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba000f860 con 0x7feba40043f0 2023-10-14T12:34:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febaffff700 1 -- 172.21.15.72:0/3080763161 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba000f9c0 con 0x7feba40043f0 2023-10-14T12:34:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febaffff700 1 -- 172.21.15.72:0/3080763161 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba000fd50 con 0x7feba40043f0 2023-10-14T12:34:32.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb815b530 con 0x7feba40043f0 2023-10-14T12:34:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.725+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb815baf0 con 0x7feba40043f0 2023-10-14T12:34:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.726+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb804ebb0 con 0x7feba40043f0 2023-10-14T12:34:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.727+0000 7febaffff700 1 -- 172.21.15.72:0/3080763161 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feba0014440 con 0x7feba40043f0 2023-10-14T12:34:32.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.727+0000 7febaffff700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb9806af00 0x7feb9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.728+0000 7febb6ffd700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb9806af00 0x7feb9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.728+0000 7febaffff700 1 -- 172.21.15.72:0/3080763161 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7feba0089ed0 con 0x7feba40043f0 2023-10-14T12:34:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.728+0000 7febb6ffd700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb9806af00 0x7feb9806d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feba40047d0 tx=0x7feba801d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:32.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.732+0000 7febaffff700 1 -- 172.21.15.72:0/3080763161 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feba0054b60 con 0x7feba40043f0 2023-10-14T12:34:32.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:32.967+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7febb8072ac0 con 0x7feba40043f0 2023-10-14T12:34:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.582+0000 7febaffff700 1 -- 172.21.15.72:0/3080763161 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7feba0058180 con 0x7feba40043f0 2023-10-14T12:34:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb9806af00 msgr2=0x7feb9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb9806af00 0x7feb9806d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feba40047d0 tx=0x7feba801d040 comp rx=0 tx=0).stop 2023-10-14T12:34:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 msgr2=0x7febb814f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7febb814f290 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feba0011c00 tx=0x7feba0011f10 comp rx=0 tx=0).stop 2023-10-14T12:34:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 shutdown_connections 2023-10-14T12:34:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7feb9806af00 0x7feb9806d3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7febb80c60b0 0x7febb80c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba40043f0 0x7febb814f290 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 --2- 172.21.15.72:0/3080763161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febb815d720 0x7febb80c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 >> 172.21.15.72:0/3080763161 conn(0x7febb80ccbe0 msgr2=0x7febb81598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 shutdown_connections 2023-10-14T12:34:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.585+0000 7febbe115700 1 -- 172.21.15.72:0/3080763161 wait complete. 2023-10-14T12:34:33.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T12:34:33.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.733+0000 7f0b73c91700 1 Processor -- start 2023-10-14T12:34:33.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.733+0000 7f0b73c91700 1 -- start start 2023-10-14T12:34:33.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.734+0000 7f0b73c91700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b6c15b4e0 0x7f0b6c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:33.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.734+0000 7f0b73c91700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b6c0b33f0 0x7f0b6c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:33.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.734+0000 7f0b73c91700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c070620 con 0x7f0b6c0cd770 2023-10-14T12:34:33.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.734+0000 7f0b73c91700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c070900 con 0x7f0b6c0b33f0 2023-10-14T12:34:33.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.734+0000 7f0b73c91700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c070be0 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.734+0000 7f0b7122c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0b6c0cd770 0x7f0b6c0b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54626/0 (socket says 172.21.15.72:54626) 2023-10-14T12:34:33.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.734+0000 7f0b7122c700 1 -- 172.21.15.72:0/3166067593 learned_addr learned my addr 172.21.15.72:0/3166067593 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:33.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.734+0000 7f0b7222e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b6c0b33f0 0x7f0b6c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:33.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b71a2d700 1 --2- 172.21.15.72:0/3166067593 >> v2:172.21.15.123:3300/0 conn(0x7f0b6c15b4e0 0x7f0b6c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:33.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b7222e700 1 -- 172.21.15.72:0/3166067593 >> v2:172.21.15.123:3300/0 conn(0x7f0b6c15b4e0 msgr2=0x7f0b6c06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:33.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b7222e700 1 --2- 172.21.15.72:0/3166067593 >> v2:172.21.15.123:3300/0 conn(0x7f0b6c15b4e0 0x7f0b6c06f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b7222e700 1 -- 172.21.15.72:0/3166067593 >> v1:172.21.15.72:6789/0 conn(0x7f0b6c0cd770 legacy=0x7f0b6c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b70a2b700 1 -- 172.21.15.72:0/3166067593 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118176933 0 0) 0x7f0b6c070620 con 0x7f0b6c0cd770 2023-10-14T12:34:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b7222e700 1 -- 172.21.15.72:0/3166067593 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c070ec0 con 0x7f0b6c0b33f0 2023-10-14T12:34:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b71a2d700 1 --2- 172.21.15.72:0/3166067593 >> v2:172.21.15.123:3300/0 conn(0x7f0b6c15b4e0 0x7f0b6c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:33.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b7222e700 1 --2- 172.21.15.72:0/3166067593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c0b33f0 0x7f0b6c0b4450 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0c4d60 tx=0x7f0b68009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762d9be7fff88a87 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:33.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b70a2b700 1 -- 172.21.15.72:0/3166067593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68011830 con 0x7f0b6c0b33f0 2023-10-14T12:34:33.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b70a2b700 1 -- 172.21.15.72:0/3166067593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b68011990 con 0x7f0b6c0b33f0 2023-10-14T12:34:33.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b70a2b700 1 -- 172.21.15.72:0/3166067593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68011d20 con 0x7f0b6c0b33f0 2023-10-14T12:34:33.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b73c91700 1 -- 172.21.15.72:0/3166067593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c0b33f0 msgr2=0x7f0b6c0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:33.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.735+0000 7f0b73c91700 1 --2- 172.21.15.72:0/3166067593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c0b33f0 0x7f0b6c0b4450 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0c4d60 tx=0x7f0b68009b20 comp rx=0 tx=0).stop 2023-10-14T12:34:33.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.736+0000 7f0b73c91700 1 -- 172.21.15.72:0/3166067593 shutdown_connections 2023-10-14T12:34:33.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.736+0000 7f0b73c91700 1 --2- 172.21.15.72:0/3166067593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c0b33f0 0x7f0b6c0b4450 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:33.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.736+0000 7f0b73c91700 1 --2- 172.21.15.72:0/3166067593 >> v2:172.21.15.123:3300/0 conn(0x7f0b6c15b4e0 0x7f0b6c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:33.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.736+0000 7f0b73c91700 1 -- 172.21.15.72:0/3166067593 >> 172.21.15.72:0/3166067593 conn(0x7f0b6c0cdce0 msgr2=0x7f0b6c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:33.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.736+0000 7f0b73c91700 1 -- 172.21.15.72:0/3166067593 shutdown_connections 2023-10-14T12:34:33.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.736+0000 7f0b73c91700 1 -- 172.21.15.72:0/3166067593 wait complete. 2023-10-14T12:34:33.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.737+0000 7f0b73c91700 1 Processor -- start 2023-10-14T12:34:33.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.737+0000 7f0b73c91700 1 -- start start 2023-10-14T12:34:33.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b73c91700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6c0b33f0 0x7f0b6c1e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:33.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b73c91700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b6c0cd770 0x7f0b6c0c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:33.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b73c91700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c15b4e0 0x7f0b6c0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:33.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b73c91700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1e5c80 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b73c91700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1e65e0 con 0x7f0b6c0b33f0 2023-10-14T12:34:33.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b73c91700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1e5000 con 0x7f0b6c0cd770 2023-10-14T12:34:33.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7222e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c15b4e0 0x7f0b6c0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:33.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7222e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c15b4e0 0x7f0b6c0c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48334/0 (socket says 172.21.15.72:48334) 2023-10-14T12:34:33.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7222e700 1 -- 172.21.15.72:0/3554462868 learned_addr learned my addr 172.21.15.72:0/3554462868 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:33.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b71a2d700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6c0b33f0 0x7f0b6c1e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7122c700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b6c0cd770 0x7f0b6c0c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7222e700 1 -- 172.21.15.72:0/3554462868 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b6c0cd770 msgr2=0x7f0b6c0c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7222e700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b6c0cd770 0x7f0b6c0c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7222e700 1 -- 172.21.15.72:0/3554462868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6c0b33f0 msgr2=0x7f0b6c1e60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:33.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7222e700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6c0b33f0 0x7f0b6c1e60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7222e700 1 -- 172.21.15.72:0/3554462868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680094a0 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b71a2d700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6c0b33f0 0x7f0b6c1e60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b7222e700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c15b4e0 0x7f0b6c0c67f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0b680090b0 tx=0x7f0b68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b627fc700 1 -- 172.21.15.72:0/3554462868 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680045f0 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b627fc700 1 -- 172.21.15.72:0/3554462868 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6801f070 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c1e52e0 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b627fc700 1 -- 172.21.15.72:0/3554462868 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68003b20 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.738+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c1e58a0 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.739+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c1e5dc0 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.740+0000 7f0b627fc700 1 -- 172.21.15.72:0/3554462868 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b68003c80 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.740+0000 7f0b627fc700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b5006af00 0x7f0b5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:33.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.740+0000 7f0b627fc700 1 -- 172.21.15.72:0/3554462868 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f0b68021070 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.740+0000 7f0b71a2d700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b5006af00 0x7f0b5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:33.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.740+0000 7f0b71a2d700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b5006af00 0x7f0b5006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400e3d0 tx=0x7f0b64007a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:33.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.745+0000 7f0b627fc700 1 -- 172.21.15.72:0/3554462868 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b6c1e5dc0 con 0x7f0b6c15b4e0 2023-10-14T12:34:33.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:33.934+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0b6c1e5dc0 con 0x7f0b6c15b4e0 2023-10-14T12:34:34.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.671+0000 7f0b627fc700 1 -- 172.21.15.72:0/3554462868 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0b6c1e5dc0 con 0x7f0b6c15b4e0 2023-10-14T12:34:34.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b5006af00 msgr2=0x7f0b5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:34.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b5006af00 0x7f0b5006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400e3d0 tx=0x7f0b64007a10 comp rx=0 tx=0).stop 2023-10-14T12:34:34.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c15b4e0 msgr2=0x7f0b6c0c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:34.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c15b4e0 0x7f0b6c0c67f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0b680090b0 tx=0x7f0b68004750 comp rx=0 tx=0).stop 2023-10-14T12:34:34.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 shutdown_connections 2023-10-14T12:34:34.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b5006af00 0x7f0b5006d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:34.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b6c15b4e0 0x7f0b6c0c67f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:34.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b6c0b33f0 0x7f0b6c1e60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:34.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 --2- 172.21.15.72:0/3554462868 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0b6c0cd770 0x7f0b6c0c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:34.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 >> 172.21.15.72:0/3554462868 conn(0x7f0b6c0cdce0 msgr2=0x7f0b6c0c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:34.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.674+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 shutdown_connections 2023-10-14T12:34:34.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.675+0000 7f0b73c91700 1 -- 172.21.15.72:0/3554462868 wait complete. 2023-10-14T12:34:34.678 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-10-14T12:34:34.694 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T12:34:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.824+0000 7f81fc05e700 1 Processor -- start 2023-10-14T12:34:34.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.824+0000 7f81fc05e700 1 -- start start 2023-10-14T12:34:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.825+0000 7f81fc05e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 0x7f81f40ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.825+0000 7f81fc05e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f40cfab0 0x7f81f40b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.825+0000 7f81fc05e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f40cea10 con 0x7f81f406b7c0 2023-10-14T12:34:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.825+0000 7f81fc05e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f40b9590 con 0x7f81f40cfab0 2023-10-14T12:34:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.825+0000 7f81fc05e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f40cecf0 con 0x7f81f415d6b0 2023-10-14T12:34:34.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f95f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f40cfab0 0x7f81f40b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:34.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f95f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f40cfab0 0x7f81f40b9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48338/0 (socket says 172.21.15.72:48338) 2023-10-14T12:34:34.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f95f9700 1 -- 172.21.15.72:0/3940554003 learned_addr learned my addr 172.21.15.72:0/3940554003 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:34.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f9dfa700 1 --2- 172.21.15.72:0/3940554003 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 0x7f81f40ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:34.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f95f9700 1 -- 172.21.15.72:0/3940554003 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 msgr2=0x7f81f40ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f95f9700 1 --2- 172.21.15.72:0/3940554003 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 0x7f81f40ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f95f9700 1 -- 172.21.15.72:0/3940554003 >> v1:172.21.15.123:6789/0 conn(0x7f81f406b7c0 legacy=0x7f81f40b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f95f9700 1 -- 172.21.15.72:0/3940554003 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40cefd0 con 0x7f81f40cfab0 2023-10-14T12:34:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f95f9700 1 --2- 172.21.15.72:0/3940554003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40cfab0 0x7f81f40b9050 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f81f00098f0 tx=0x7f81f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b7cf633845a85e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:34.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f8df8700 1 -- 172.21.15.72:0/3940554003 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0011830 con 0x7f81f40cfab0 2023-10-14T12:34:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f8df8700 1 -- 172.21.15.72:0/3940554003 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f0011990 con 0x7f81f40cfab0 2023-10-14T12:34:34.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.826+0000 7f81f8df8700 1 -- 172.21.15.72:0/3940554003 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0011d20 con 0x7f81f40cfab0 2023-10-14T12:34:34.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.827+0000 7f81fc05e700 1 -- 172.21.15.72:0/3940554003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40cfab0 msgr2=0x7f81f40b9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:34.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.827+0000 7f81fc05e700 1 --2- 172.21.15.72:0/3940554003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40cfab0 0x7f81f40b9050 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f81f00098f0 tx=0x7f81f0009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.827+0000 7f81fc05e700 1 -- 172.21.15.72:0/3940554003 shutdown_connections 2023-10-14T12:34:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.827+0000 7f81fc05e700 1 --2- 172.21.15.72:0/3940554003 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 0x7f81f40ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.827+0000 7f81fc05e700 1 --2- 172.21.15.72:0/3940554003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f40cfab0 0x7f81f40b9050 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.827+0000 7f81fc05e700 1 -- 172.21.15.72:0/3940554003 >> 172.21.15.72:0/3940554003 conn(0x7f81f4072340 msgr2=0x7f81f4072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:34.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.827+0000 7f81fc05e700 1 -- 172.21.15.72:0/3940554003 shutdown_connections 2023-10-14T12:34:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.827+0000 7f81fc05e700 1 -- 172.21.15.72:0/3940554003 wait complete. 2023-10-14T12:34:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.828+0000 7f81fc05e700 1 Processor -- start 2023-10-14T12:34:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.828+0000 7f81fc05e700 1 -- start start 2023-10-14T12:34:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81fc05e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f406b7c0 0x7f81f41f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:34.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81fc05e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81f40cfab0 0x7f81f40ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81fc05e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 0x7f81f40ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81fc05e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4150080 con 0x7f81f406b7c0 2023-10-14T12:34:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81fc05e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f41f2c60 con 0x7f81f40cfab0 2023-10-14T12:34:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81fc05e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f4160330 con 0x7f81f415d6b0 2023-10-14T12:34:34.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81f9dfa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f406b7c0 0x7f81f41f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81f9dfa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f406b7c0 0x7f81f41f2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48344/0 (socket says 172.21.15.72:48344) 2023-10-14T12:34:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81f9dfa700 1 -- 172.21.15.72:0/3810721925 learned_addr learned my addr 172.21.15.72:0/3810721925 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81f95f9700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81f40cfab0 0x7f81f40ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81fa5fb700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 0x7f81f40ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:34.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81f9dfa700 1 -- 172.21.15.72:0/3810721925 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 msgr2=0x7f81f40ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81f9dfa700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 0x7f81f40ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81f9dfa700 1 -- 172.21.15.72:0/3810721925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81f40cfab0 msgr2=0x7f81f40ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81f9dfa700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81f40cfab0 0x7f81f40ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81f9dfa700 1 -- 172.21.15.72:0/3810721925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f0009550 con 0x7f81f406b7c0 2023-10-14T12:34:34.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.829+0000 7f81fa5fb700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 0x7f81f40ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.830+0000 7f81f9dfa700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f406b7c0 0x7f81f41f2720 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e870 tx=0x7f81e400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.830+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3810721925 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4009590 con 0x7f81f406b7c0 2023-10-14T12:34:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.830+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3810721925 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e400ee70 con 0x7f81f406b7c0 2023-10-14T12:34:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.830+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f4160610 con 0x7f81f406b7c0 2023-10-14T12:34:34.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.830+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3810721925 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400ca50 con 0x7f81f406b7c0 2023-10-14T12:34:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.830+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f40aaea0 con 0x7f81f406b7c0 2023-10-14T12:34:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.831+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f404ebb0 con 0x7f81f406b7c0 2023-10-14T12:34:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.831+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3810721925 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f81e400cbb0 con 0x7f81f406b7c0 2023-10-14T12:34:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.832+0000 7f81ea7fc700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f81d806af00 0x7f81d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.832+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3810721925 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f81e40897b0 con 0x7f81f406b7c0 2023-10-14T12:34:34.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.832+0000 7f81f95f9700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f81d806af00 0x7f81d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.832+0000 7f81f95f9700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f81d806af00 0x7f81d806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009c40 tx=0x7f81f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:34.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:34.836+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3810721925 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81e4054690 con 0x7f81f406b7c0 2023-10-14T12:34:35.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.027+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f81f40d0780 con 0x7f81f406b7c0 2023-10-14T12:34:35.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.687+0000 7f81ea7fc700 1 -- 172.21.15.72:0/3810721925 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f81e400ce60 con 0x7f81f406b7c0 2023-10-14T12:34:35.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f81d806af00 msgr2=0x7f81d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:35.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f81d806af00 0x7f81d806d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009c40 tx=0x7f81f0008030 comp rx=0 tx=0).stop 2023-10-14T12:34:35.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f406b7c0 msgr2=0x7f81f41f2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:35.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f406b7c0 0x7f81f41f2720 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e870 tx=0x7f81e400ec30 comp rx=0 tx=0).stop 2023-10-14T12:34:35.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 shutdown_connections 2023-10-14T12:34:35.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f81d806af00 0x7f81d806d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f81f415d6b0 0x7f81f40ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f406b7c0 0x7f81f41f2720 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 --2- 172.21.15.72:0/3810721925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81f40cfab0 0x7f81f40ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.691+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 >> 172.21.15.72:0/3810721925 conn(0x7f81f4072340 msgr2=0x7f81f40b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:35.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.692+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 shutdown_connections 2023-10-14T12:34:35.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.692+0000 7f81fc05e700 1 -- 172.21.15.72:0/3810721925 wait complete. 2023-10-14T12:34:35.696 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-10-14T12:34:35.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-14T12:34:35.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.839+0000 7f5958b62700 1 Processor -- start 2023-10-14T12:34:35.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.840+0000 7f5958b62700 1 -- start start 2023-10-14T12:34:35.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5958b62700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f595415b4e0 0x7f595406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:35.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5958b62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59540cd770 0x7f59540b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:35.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5958b62700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f59540b3220 0x7f59540cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:35.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5958b62700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59540b3670 con 0x7f59540cd770 2023-10-14T12:34:35.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5958b62700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5954070620 con 0x7f595415b4e0 2023-10-14T12:34:35.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5958b62700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5954070900 con 0x7f59540b3220 2023-10-14T12:34:35.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5951d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59540cd770 0x7f59540b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:35.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5951d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59540cd770 0x7f59540b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48354/0 (socket says 172.21.15.72:48354) 2023-10-14T12:34:35.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5951d9b700 1 -- 172.21.15.72:0/2179421282 learned_addr learned my addr 172.21.15.72:0/2179421282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f595259c700 1 --2- 172.21.15.72:0/2179421282 >> v2:172.21.15.123:3300/0 conn(0x7f595415b4e0 0x7f595406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5952d9d700 1 --2- 172.21.15.72:0/2179421282 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f59540b3220 0x7f59540cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5951d9b700 1 -- 172.21.15.72:0/2179421282 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f59540b3220 msgr2=0x7f59540cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5951d9b700 1 --2- 172.21.15.72:0/2179421282 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f59540b3220 0x7f59540cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5951d9b700 1 -- 172.21.15.72:0/2179421282 >> v2:172.21.15.123:3300/0 conn(0x7f595415b4e0 msgr2=0x7f595406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5951d9b700 1 --2- 172.21.15.72:0/2179421282 >> v2:172.21.15.123:3300/0 conn(0x7f595415b4e0 0x7f595406f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5951d9b700 1 -- 172.21.15.72:0/2179421282 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954070be0 con 0x7f59540cd770 2023-10-14T12:34:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f595259c700 1 --2- 172.21.15.72:0/2179421282 >> v2:172.21.15.123:3300/0 conn(0x7f595415b4e0 0x7f595406f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f5951d9b700 1 --2- 172.21.15.72:0/2179421282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540cd770 0x7f59540b2ce0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f59540c4d60 tx=0x7f593c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788986d437c17ad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:35.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.841+0000 7f595159a700 1 -- 172.21.15.72:0/2179421282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00b870 con 0x7f59540cd770 2023-10-14T12:34:35.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f595159a700 1 -- 172.21.15.72:0/2179421282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593c00b9d0 con 0x7f59540cd770 2023-10-14T12:34:35.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f595159a700 1 -- 172.21.15.72:0/2179421282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593c00bd60 con 0x7f59540cd770 2023-10-14T12:34:35.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f5958b62700 1 -- 172.21.15.72:0/2179421282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540cd770 msgr2=0x7f59540b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:35.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f5958b62700 1 --2- 172.21.15.72:0/2179421282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540cd770 0x7f59540b2ce0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f59540c4d60 tx=0x7f593c009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f5958b62700 1 -- 172.21.15.72:0/2179421282 shutdown_connections 2023-10-14T12:34:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f5958b62700 1 --2- 172.21.15.72:0/2179421282 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f59540b3220 0x7f59540cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f5958b62700 1 --2- 172.21.15.72:0/2179421282 >> v2:172.21.15.123:3300/0 conn(0x7f595415b4e0 0x7f595406f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f5958b62700 1 --2- 172.21.15.72:0/2179421282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540cd770 0x7f59540b2ce0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f5958b62700 1 -- 172.21.15.72:0/2179421282 >> 172.21.15.72:0/2179421282 conn(0x7f59540cdce0 msgr2=0x7f59540ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:35.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f5958b62700 1 -- 172.21.15.72:0/2179421282 shutdown_connections 2023-10-14T12:34:35.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.842+0000 7f5958b62700 1 -- 172.21.15.72:0/2179421282 wait complete. 2023-10-14T12:34:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.843+0000 7f5958b62700 1 Processor -- start 2023-10-14T12:34:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f5958b62700 1 -- start start 2023-10-14T12:34:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f5958b62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540b3220 0x7f595406bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f5958b62700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59540cd770 0x7f59541539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f5958b62700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f595415b4e0 0x7f5954156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f5958b62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59541f2a30 con 0x7f59540b3220 2023-10-14T12:34:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f5958b62700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59541570e0 con 0x7f59540cd770 2023-10-14T12:34:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f5958b62700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5954153f10 con 0x7f595415b4e0 2023-10-14T12:34:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f595259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540b3220 0x7f595406bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:35.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f595259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540b3220 0x7f595406bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48358/0 (socket says 172.21.15.72:48358) 2023-10-14T12:34:35.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.844+0000 7f595259c700 1 -- 172.21.15.72:0/1492683918 learned_addr learned my addr 172.21.15.72:0/1492683918 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:35.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f5951d9b700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59540cd770 0x7f59541539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:35.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f595259c700 1 -- 172.21.15.72:0/1492683918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f595415b4e0 msgr2=0x7f5954156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:35.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f595259c700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f595415b4e0 0x7f5954156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f595259c700 1 -- 172.21.15.72:0/1492683918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59540cd770 msgr2=0x7f59541539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:35.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f595259c700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59540cd770 0x7f59541539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:35.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f595259c700 1 -- 172.21.15.72:0/1492683918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c009550 con 0x7f59540b3220 2023-10-14T12:34:35.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f5951d9b700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59540cd770 0x7f59541539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:35.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f595259c700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540b3220 0x7f595406bfe0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f594400e760 tx=0x7f594400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:35.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f594affd700 1 -- 172.21.15.72:0/1492683918 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944013610 con 0x7f59540b3220 2023-10-14T12:34:35.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f594affd700 1 -- 172.21.15.72:0/1492683918 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5944013770 con 0x7f59540b3220 2023-10-14T12:34:35.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59541565c0 con 0x7f59540b3220 2023-10-14T12:34:35.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f594affd700 1 -- 172.21.15.72:0/1492683918 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944013b20 con 0x7f59540b3220 2023-10-14T12:34:35.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.845+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5954156b20 con 0x7f59540b3220 2023-10-14T12:34:35.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.846+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595404ebb0 con 0x7f59540b3220 2023-10-14T12:34:35.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.846+0000 7f594affd700 1 -- 172.21.15.72:0/1492683918 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5944013c80 con 0x7f59540b3220 2023-10-14T12:34:35.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.847+0000 7f594affd700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f593406af00 0x7f593406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:35.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.847+0000 7f594affd700 1 -- 172.21.15.72:0/1492683918 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f5944089120 con 0x7f59540b3220 2023-10-14T12:34:35.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.847+0000 7f5951d9b700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f593406af00 0x7f593406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:35.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.847+0000 7f5951d9b700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f593406af00 0x7f593406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59540cdbe0 tx=0x7f593c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:35.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:35.851+0000 7f594affd700 1 -- 172.21.15.72:0/1492683918 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5944054210 con 0x7f59540b3220 2023-10-14T12:34:36.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.040+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59540d0bf0 con 0x7f59540b3220 2023-10-14T12:34:36.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.694+0000 7f594affd700 1 -- 172.21.15.72:0/1492683918 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f5944057830 con 0x7f59540b3220 2023-10-14T12:34:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.696+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f593406af00 msgr2=0x7f593406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.696+0000 7f5958b62700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f593406af00 0x7f593406d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f59540cdbe0 tx=0x7f593c008030 comp rx=0 tx=0).stop 2023-10-14T12:34:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.696+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540b3220 msgr2=0x7f595406bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.696+0000 7f5958b62700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540b3220 0x7f595406bfe0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f594400e760 tx=0x7f594400eb20 comp rx=0 tx=0).stop 2023-10-14T12:34:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.696+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 shutdown_connections 2023-10-14T12:34:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.696+0000 7f5958b62700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f593406af00 0x7f593406d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.696+0000 7f5958b62700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f595415b4e0 0x7f5954156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.696+0000 7f5958b62700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59540b3220 0x7f595406bfe0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.697+0000 7f5958b62700 1 --2- 172.21.15.72:0/1492683918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59540cd770 0x7f59541539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.697+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 >> 172.21.15.72:0/1492683918 conn(0x7f59540cdce0 msgr2=0x7f59540c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.697+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 shutdown_connections 2023-10-14T12:34:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.697+0000 7f5958b62700 1 -- 172.21.15.72:0/1492683918 wait complete. 2023-10-14T12:34:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' removed 2023-10-14T12:34:36.712 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T12:34:36.713 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T12:34:36.713 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T12:34:36.713 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:34:36.714 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T12:34:36.714 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T12:34:36.714 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T12:34:36.715 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:34:36.715 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T12:34:36.715 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T12:34:36.716 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T12:34:36.716 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:34:36.716 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T12:34:36.716 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T12:34:36.717 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T12:34:36.717 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:34:36.724 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T12:34:36.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T12:34:36.725 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T12:34:36.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T12:34:36.727 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T12:34:36.727 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T12:34:36.728 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T12:34:36.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T12:34:36.767 INFO:tasks.ceph.mds.a:Started 2023-10-14T12:34:36.768 DEBUG:teuthology.parallel:result is None 2023-10-14T12:34:36.769 INFO:tasks.ceph.mds.c:Started 2023-10-14T12:34:36.769 DEBUG:teuthology.parallel:result is None 2023-10-14T12:34:36.770 INFO:tasks.ceph.mds.b:Started 2023-10-14T12:34:36.770 DEBUG:teuthology.parallel:result is None 2023-10-14T12:34:36.771 INFO:tasks.ceph.mds.d:Started 2023-10-14T12:34:36.772 DEBUG:teuthology.parallel:result is None 2023-10-14T12:34:36.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T12:34:36.845 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-10-14T12:34:36.846 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-10-14T12:34:36.858 INFO:tasks.ceph.mds.b.smithi123.stdout:starting mds.b at 2023-10-14T12:34:36.859 INFO:tasks.ceph.mds.d.smithi123.stdout:starting mds.d at 2023-10-14T12:34:36.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.897+0000 7f756438b700 1 Processor -- start 2023-10-14T12:34:36.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.897+0000 7f756438b700 1 -- start start 2023-10-14T12:34:36.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.898+0000 7f756438b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f755c160b50 0x7f755c0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:36.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.898+0000 7f756438b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f755c0b5700 0x7f755c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:36.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.898+0000 7f756438b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c0b94b0 con 0x7f755c0b9000 2023-10-14T12:34:36.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.898+0000 7f756438b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c0d0010 con 0x7f755c160b50 2023-10-14T12:34:36.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.898+0000 7f756438b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c0d02f0 con 0x7f755c0b5700 2023-10-14T12:34:36.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.898+0000 7f7562127700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f755c160b50 0x7f755c0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:36.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.898+0000 7f7562127700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f755c160b50 0x7f755c0cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48390/0 (socket says 172.21.15.72:48390) 2023-10-14T12:34:36.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.898+0000 7f7561926700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f755c0b9000 0x7f755c0b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54690/0 (socket says 172.21.15.72:54690) 2023-10-14T12:34:36.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.898+0000 7f7562127700 1 -- 172.21.15.72:0/372784847 learned_addr learned my addr 172.21.15.72:0/372784847 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7562928700 1 --2- 172.21.15.72:0/372784847 >> v2:172.21.15.123:3300/0 conn(0x7f755c0b5700 0x7f755c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7562127700 1 -- 172.21.15.72:0/372784847 >> v2:172.21.15.123:3300/0 conn(0x7f755c0b5700 msgr2=0x7f755c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7562127700 1 --2- 172.21.15.72:0/372784847 >> v2:172.21.15.123:3300/0 conn(0x7f755c0b5700 0x7f755c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7562127700 1 -- 172.21.15.72:0/372784847 >> v1:172.21.15.72:6789/0 conn(0x7f755c0b9000 legacy=0x7f755c0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7562127700 1 -- 172.21.15.72:0/372784847 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c0d05d0 con 0x7f755c160b50 2023-10-14T12:34:36.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7561125700 1 -- 172.21.15.72:0/372784847 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603299248 0 0) 0x7f755c0b94b0 con 0x7f755c0b9000 2023-10-14T12:34:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7562127700 1 --2- 172.21.15.72:0/372784847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 0x7f755c0cf980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f754c0098f0 tx=0x7f754c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd143cc582f570ba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7561125700 1 -- 172.21.15.72:0/372784847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00b860 con 0x7f755c160b50 2023-10-14T12:34:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7561125700 1 -- 172.21.15.72:0/372784847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00b9c0 con 0x7f755c160b50 2023-10-14T12:34:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f7561125700 1 -- 172.21.15.72:0/372784847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00bd50 con 0x7f755c160b50 2023-10-14T12:34:36.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f756438b700 1 -- 172.21.15.72:0/372784847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 msgr2=0x7f755c0cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f756438b700 1 --2- 172.21.15.72:0/372784847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 0x7f755c0cf980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f754c0098f0 tx=0x7f754c009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f756438b700 1 -- 172.21.15.72:0/372784847 shutdown_connections 2023-10-14T12:34:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f756438b700 1 --2- 172.21.15.72:0/372784847 >> v2:172.21.15.123:3300/0 conn(0x7f755c0b5700 0x7f755c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:36.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.899+0000 7f756438b700 1 --2- 172.21.15.72:0/372784847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 0x7f755c0cf980 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:36.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.900+0000 7f756438b700 1 -- 172.21.15.72:0/372784847 >> 172.21.15.72:0/372784847 conn(0x7f755c06bc70 msgr2=0x7f755c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:36.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.900+0000 7f756438b700 1 -- 172.21.15.72:0/372784847 shutdown_connections 2023-10-14T12:34:36.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.900+0000 7f756438b700 1 -- 172.21.15.72:0/372784847 wait complete. 2023-10-14T12:34:36.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.901+0000 7f756438b700 1 Processor -- start 2023-10-14T12:34:36.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.901+0000 7f756438b700 1 -- start start 2023-10-14T12:34:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.901+0000 7f756438b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f755c0b5700 0x7f755c1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.901+0000 7f756438b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f755c0b9000 0x7f755c0c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.901+0000 7f756438b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 0x7f755c144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.901+0000 7f756438b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1464d0 con 0x7f755c160b50 2023-10-14T12:34:36.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.901+0000 7f756438b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c146e30 con 0x7f755c0b5700 2023-10-14T12:34:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.901+0000 7f756438b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c145850 con 0x7f755c0b9000 2023-10-14T12:34:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562928700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 0x7f755c144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562928700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 0x7f755c144e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48396/0 (socket says 172.21.15.72:48396) 2023-10-14T12:34:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562928700 1 -- 172.21.15.72:0/1821896474 learned_addr learned my addr 172.21.15.72:0/1821896474 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:36.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562127700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f755c0b5700 0x7f755c1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7561926700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f755c0b9000 0x7f755c0c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562928700 1 -- 172.21.15.72:0/1821896474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f755c0b9000 msgr2=0x7f755c0c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562928700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f755c0b9000 0x7f755c0c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562928700 1 -- 172.21.15.72:0/1821896474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f755c0b5700 msgr2=0x7f755c1468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:36.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562928700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f755c0b5700 0x7f755c1468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:36.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562928700 1 -- 172.21.15.72:0/1821896474 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c009550 con 0x7f755c160b50 2023-10-14T12:34:36.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562127700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f755c0b5700 0x7f755c1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:36.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7562928700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 0x7f755c144e70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7554007e30 tx=0x7f755400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:36.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7552ffd700 1 -- 172.21.15.72:0/1821896474 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755400eea0 con 0x7f755c160b50 2023-10-14T12:34:36.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7552ffd700 1 -- 172.21.15.72:0/1821896474 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7554014420 con 0x7f755c160b50 2023-10-14T12:34:36.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c145b30 con 0x7f755c160b50 2023-10-14T12:34:36.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f7552ffd700 1 -- 172.21.15.72:0/1821896474 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75540147d0 con 0x7f755c160b50 2023-10-14T12:34:36.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.902+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c1460f0 con 0x7f755c160b50 2023-10-14T12:34:36.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.903+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c146610 con 0x7f755c160b50 2023-10-14T12:34:36.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.904+0000 7f7552ffd700 1 -- 172.21.15.72:0/1821896474 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7554014930 con 0x7f755c160b50 2023-10-14T12:34:36.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.904+0000 7f7552ffd700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f754006af00 0x7f754006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:36.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.904+0000 7f7562127700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f754006af00 0x7f754006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:36.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.904+0000 7f7552ffd700 1 -- 172.21.15.72:0/1821896474 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7554089b30 con 0x7f755c160b50 2023-10-14T12:34:36.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.904+0000 7f7562127700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f754006af00 0x7f754006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f754c014040 tx=0x7f754c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:36.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:36.908+0000 7f7552ffd700 1 -- 172.21.15.72:0/1821896474 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f755c146610 con 0x7f755c160b50 2023-10-14T12:34:37.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:34:37.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:34:37.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.115+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f755c146610 con 0x7f755c160b50 2023-10-14T12:34:37.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.705+0000 7f7552ffd700 1 -- 172.21.15.72:0/1821896474 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7f755c146610 con 0x7f755c160b50 2023-10-14T12:34:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f754006af00 msgr2=0x7f754006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:37.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f754006af00 0x7f754006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f754c014040 tx=0x7f754c008030 comp rx=0 tx=0).stop 2023-10-14T12:34:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 msgr2=0x7f755c144e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 0x7f755c144e70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7554007e30 tx=0x7f755400e3c0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 shutdown_connections 2023-10-14T12:34:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f754006af00 0x7f754006d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f755c160b50 0x7f755c144e70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f755c0b5700 0x7f755c1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 --2- 172.21.15.72:0/1821896474 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f755c0b9000 0x7f755c0c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 >> 172.21.15.72:0/1821896474 conn(0x7f755c06bc70 msgr2=0x7f755c155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 shutdown_connections 2023-10-14T12:34:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.708+0000 7f756438b700 1 -- 172.21.15.72:0/1821896474 wait complete. 2023-10-14T12:34:37.712 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-10-14T12:34:37.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T12:34:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.841+0000 7f3e1b5ba700 1 Processor -- start 2023-10-14T12:34:37.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.842+0000 7f3e1b5ba700 1 -- start start 2023-10-14T12:34:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.842+0000 7f3e1b5ba700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e1415b250 0x7f3e140cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.842+0000 7f3e1b5ba700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e140b3480 0x7f3e14070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.842+0000 7f3e1b5ba700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e14070800 con 0x7f3e140d0370 2023-10-14T12:34:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.842+0000 7f3e1b5ba700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e140cc1b0 con 0x7f3e1415b250 2023-10-14T12:34:37.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.842+0000 7f3e1b5ba700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e140cbc50 con 0x7f3e140b3480 2023-10-14T12:34:37.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19356700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e1415b250 0x7f3e140cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:37.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19356700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e1415b250 0x7f3e140cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48404/0 (socket says 172.21.15.72:48404) 2023-10-14T12:34:37.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19356700 1 -- 172.21.15.72:0/1297001090 learned_addr learned my addr 172.21.15.72:0/1297001090 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:37.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19b57700 1 --2- 172.21.15.72:0/1297001090 >> v2:172.21.15.123:3300/0 conn(0x7f3e140b3480 0x7f3e14070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:37.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19356700 1 -- 172.21.15.72:0/1297001090 >> v2:172.21.15.123:3300/0 conn(0x7f3e140b3480 msgr2=0x7f3e14070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:37.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19356700 1 --2- 172.21.15.72:0/1297001090 >> v2:172.21.15.123:3300/0 conn(0x7f3e140b3480 0x7f3e14070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19356700 1 -- 172.21.15.72:0/1297001090 >> v1:172.21.15.123:6789/0 conn(0x7f3e140d0370 legacy=0x7f3e140b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:37.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19356700 1 -- 172.21.15.72:0/1297001090 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e140cbef0 con 0x7f3e1415b250 2023-10-14T12:34:37.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19b57700 1 --2- 172.21.15.72:0/1297001090 >> v2:172.21.15.123:3300/0 conn(0x7f3e140b3480 0x7f3e14070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:37.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e19356700 1 --2- 172.21.15.72:0/1297001090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 0x7f3e140cd620 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3e140c8370 tx=0x7f3e04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d40ac81ed131ca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e0bfff700 1 -- 172.21.15.72:0/1297001090 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04004230 con 0x7f3e1415b250 2023-10-14T12:34:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e0bfff700 1 -- 172.21.15.72:0/1297001090 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04004390 con 0x7f3e1415b250 2023-10-14T12:34:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.843+0000 7f3e0bfff700 1 -- 172.21.15.72:0/1297001090 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040036a0 con 0x7f3e1415b250 2023-10-14T12:34:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.844+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/1297001090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 msgr2=0x7f3e140cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.844+0000 7f3e1b5ba700 1 --2- 172.21.15.72:0/1297001090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 0x7f3e140cd620 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3e140c8370 tx=0x7f3e04009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.844+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/1297001090 shutdown_connections 2023-10-14T12:34:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.844+0000 7f3e1b5ba700 1 --2- 172.21.15.72:0/1297001090 >> v2:172.21.15.123:3300/0 conn(0x7f3e140b3480 0x7f3e14070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.844+0000 7f3e1b5ba700 1 --2- 172.21.15.72:0/1297001090 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 0x7f3e140cd620 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.844+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/1297001090 >> 172.21.15.72:0/1297001090 conn(0x7f3e140cdd70 msgr2=0x7f3e140ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.844+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/1297001090 shutdown_connections 2023-10-14T12:34:37.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.844+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/1297001090 wait complete. 2023-10-14T12:34:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.845+0000 7f3e1b5ba700 1 Processor -- start 2023-10-14T12:34:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.845+0000 7f3e1b5ba700 1 -- start start 2023-10-14T12:34:37.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e1b5ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e140b3480 0x7f3e140c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e1b5ba700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e140d0370 0x7f3e140c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e1b5ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 0x7f3e140c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e1b5ba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1406b930 con 0x7f3e1415b250 2023-10-14T12:34:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e1b5ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140c8a50 con 0x7f3e140b3480 2023-10-14T12:34:37.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e1b5ba700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140c8d30 con 0x7f3e140d0370 2023-10-14T12:34:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19b57700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 0x7f3e140c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19b57700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 0x7f3e140c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48414/0 (socket says 172.21.15.72:48414) 2023-10-14T12:34:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19b57700 1 -- 172.21.15.72:0/2020150901 learned_addr learned my addr 172.21.15.72:0/2020150901 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19356700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e140b3480 0x7f3e140c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:37.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e18b55700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e140d0370 0x7f3e140c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19b57700 1 -- 172.21.15.72:0/2020150901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e140d0370 msgr2=0x7f3e140c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19b57700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e140d0370 0x7f3e140c5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19b57700 1 -- 172.21.15.72:0/2020150901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e140b3480 msgr2=0x7f3e140c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19b57700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e140b3480 0x7f3e140c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:37.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19b57700 1 -- 172.21.15.72:0/2020150901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04009550 con 0x7f3e1415b250 2023-10-14T12:34:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e19b57700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 0x7f3e140c63b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00cef0 tx=0x7f3e0c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e09ffb700 1 -- 172.21.15.72:0/2020150901 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00adb0 con 0x7f3e1415b250 2023-10-14T12:34:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e09ffb700 1 -- 172.21.15.72:0/2020150901 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c015440 con 0x7f3e1415b250 2023-10-14T12:34:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e140c9010 con 0x7f3e1415b250 2023-10-14T12:34:37.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.846+0000 7f3e09ffb700 1 -- 172.21.15.72:0/2020150901 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0157f0 con 0x7f3e1415b250 2023-10-14T12:34:37.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.847+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1414db10 con 0x7f3e1415b250 2023-10-14T12:34:37.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.847+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1406baa0 con 0x7f3e1415b250 2023-10-14T12:34:37.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.848+0000 7f3e09ffb700 1 -- 172.21.15.72:0/2020150901 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3e0c00d430 con 0x7f3e1415b250 2023-10-14T12:34:37.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.848+0000 7f3e09ffb700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3df806af00 0x7f3df806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:37.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.848+0000 7f3e09ffb700 1 -- 172.21.15.72:0/2020150901 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3e0c089960 con 0x7f3e1415b250 2023-10-14T12:34:37.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.848+0000 7f3e19356700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3df806af00 0x7f3df806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:37.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.849+0000 7f3e19356700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3df806af00 0x7f3df806d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009130 tx=0x7f3e04008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:37.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:37.853+0000 7f3e09ffb700 1 -- 172.21.15.72:0/2020150901 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e1406baa0 con 0x7f3e1415b250 2023-10-14T12:34:38.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.119+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3e1406baa0 con 0x7f3e1415b250 2023-10-14T12:34:38.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.120+0000 7f3e09ffb700 1 -- 172.21.15.72:0/2020150901 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f3e1406baa0 con 0x7f3e1415b250 2023-10-14T12:34:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:38.123 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:34:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-10-14T12:34:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-10-14T12:34:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBniipljRF0HBAA7p2KLjIe8kIBXe5VokuL7Q==", 2023-10-14T12:34:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-10-14T12:34:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-10-14T12:34:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-10-14T12:34:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-10-14T12:34:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBniiplbP+PKBAAzc9e2Fbyhd7Ej7Y203MiMw==", 2023-10-14T12:34:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-10-14T12:34:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-10-14T12:34:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-10-14T12:34:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-10-14T12:34:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBniiplbTOzIxAAE67DHYZlOwMouQqtLR+9IQ==", 2023-10-14T12:34:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-10-14T12:34:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-10-14T12:34:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-10-14T12:34:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-10-14T12:34:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBniiplMAbTLxAAtQEe6vxLT8qIwvWadHJ5WA==", 2023-10-14T12:34:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-10-14T12:34:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-10-14T12:34:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-10-14T12:34:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-10-14T12:34:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBriiplO5T3FRAAtFKzVz7NTxg94lg3RdS57g==", 2023-10-14T12:34:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-10-14T12:34:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-10-14T12:34:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-10-14T12:34:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBuiipllEHnFRAAKJRQWsn5FL3ZsPOGTMkVKA==", 2023-10-14T12:34:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-10-14T12:34:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-10-14T12:34:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-10-14T12:34:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBxiiplXSf9FBAATR15ePkTEDTqAVke9yNHLQ==", 2023-10-14T12:34:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-10-14T12:34:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-10-14T12:34:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-10-14T12:34:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQB0iiplSdonFRAASnJCvmMBZz28LjqXuFwBfw==", 2023-10-14T12:34:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-10-14T12:34:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-10-14T12:34:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-10-14T12:34:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQB6iiplR68gKhAAsqnwjg/k7ZLl1x7b/s/y6A==", 2023-10-14T12:34:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-10-14T12:34:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-10-14T12:34:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-10-14T12:34:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQB9iiplZUTnKhAAokxi7A0gtASkNUNBAZhF5g==", 2023-10-14T12:34:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-10-14T12:34:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-10-14T12:34:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-10-14T12:34:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCAiiplOqmQKhAAER+f7Vu0/2CFvthS/yfX0w==", 2023-10-14T12:34:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-10-14T12:34:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-10-14T12:34:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-10-14T12:34:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCDiiplUn41KhAA+GV4jUrNCOfodz/VjfDvSg==", 2023-10-14T12:34:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-10-14T12:34:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-10-14T12:34:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-10-14T12:34:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBniiplx+gcNBAA9Bt6El4sSwdUx/6c4Ruo3g==", 2023-10-14T12:34:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-10-14T12:34:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-10-14T12:34:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-10-14T12:34:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-10-14T12:34:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-10-14T12:34:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBoiiplqwaHARAArzGlYBbUVvOD6htSNdKeAw==", 2023-10-14T12:34:38.157 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-10-14T12:34:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-10-14T12:34:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-10-14T12:34:38.158 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-10-14T12:34:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.159 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2023-10-14T12:34:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBniiplN1/SORAAryVAHkbO9GacQgehR58mXQ==", 2023-10-14T12:34:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-10-14T12:34:38.160 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-10-14T12:34:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-10-14T12:34:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-10-14T12:34:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2023-10-14T12:34:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBoiiplf1c5BxAAVvs8eeU/bW4ZBUWT6MmyBg==", 2023-10-14T12:34:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.162 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-10-14T12:34:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-10-14T12:34:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-10-14T12:34:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-10-14T12:34:38.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-10-14T12:34:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBmiiplIl35ORAAzrcqGsa29DwGn7rfZGcmtQ==", 2023-10-14T12:34:38.164 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-10-14T12:34:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-10-14T12:34:38.165 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-10-14T12:34:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mds", 2023-10-14T12:34:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCJiiplHifBKxAApdp0IiRE0BUA0zWVJDbgWQ==", 2023-10-14T12:34:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T12:34:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T12:34:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCJiiplVC/BKxAAViLWfW+QpNqNNLSYPxX6cw==", 2023-10-14T12:34:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T12:34:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-osd", 2023-10-14T12:34:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCJiiplWDjBKxAAorCqGwbhZkc7WY+oB+APbA==", 2023-10-14T12:34:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T12:34:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T12:34:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCJiiplLz/BKxAAyNY2USqMx759h5Oq/Q0JKQ==", 2023-10-14T12:34:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T12:34:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T12:34:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCJiiplFEbBKxAAChQeLoKnVzXcxNJBCkKneg==", 2023-10-14T12:34:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T12:34:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T12:34:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCJiiplJ03BKxAAHm0l8czhM9NacAD7/p4ntw==", 2023-10-14T12:34:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T12:34:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-10-14T12:34:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBniiplwUwPGRAAHrSf1H0UuInKI/grT1DQow==", 2023-10-14T12:34:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-10-14T12:34:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-10-14T12:34:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-14T12:34:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-10-14T12:34:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQBniiplPDK+ExAApFFqoR2bLlT+hh483RFA1g==", 2023-10-14T12:34:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-10-14T12:34:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-10-14T12:34:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-10-14T12:34:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-10-14T12:34:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-10-14T12:34:38.182 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:34:38.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3df806af00 msgr2=0x7f3df806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3df806af00 0x7f3df806d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009130 tx=0x7f3e04008030 comp rx=0 tx=0).stop 2023-10-14T12:34:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 msgr2=0x7f3e140c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 0x7f3e140c63b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00cef0 tx=0x7f3e0c00cf20 comp rx=0 tx=0).stop 2023-10-14T12:34:38.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 shutdown_connections 2023-10-14T12:34:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3df806af00 0x7f3df806d3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1415b250 0x7f3e140c63b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e140b3480 0x7f3e140c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 --2- 172.21.15.72:0/2020150901 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3e140d0370 0x7f3e140c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 >> 172.21.15.72:0/2020150901 conn(0x7f3e140cdd70 msgr2=0x7f3e140ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:38.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 shutdown_connections 2023-10-14T12:34:38.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.122+0000 7f3e1b5ba700 1 -- 172.21.15.72:0/2020150901 wait complete. 2023-10-14T12:34:38.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T12:34:38.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.309+0000 7f5f9b87f700 1 Processor -- start 2023-10-14T12:34:38.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.310+0000 7f5f9b87f700 1 -- start start 2023-10-14T12:34:38.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.310+0000 7f5f9b87f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f940cf7d0 0x7f5f9415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.310+0000 7f5f9b87f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940ca7d0 0x7f5f94071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.310+0000 7f5f9b87f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f940cfeb0 con 0x7f5f9406a820 2023-10-14T12:34:38.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.310+0000 7f5f9b87f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f940ce410 con 0x7f5f940cf7d0 2023-10-14T12:34:38.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.310+0000 7f5f9b87f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940cfc30 con 0x7f5f940ca7d0 2023-10-14T12:34:38.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f9961b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5f9406a820 0x7f5f9406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54718/0 (socket says 172.21.15.72:54718) 2023-10-14T12:34:38.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f9961b700 1 -- 172.21.15.72:0/896906991 learned_addr learned my addr 172.21.15.72:0/896906991 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:38.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f99e1c700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940ca7d0 0x7f5f94071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f98e1a700 1 --2- 172.21.15.72:0/896906991 >> v2:172.21.15.123:3300/0 conn(0x7f5f940cf7d0 0x7f5f9415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271635480 0 0) 0x7f5f940cfeb0 con 0x7f5f9406a820 2023-10-14T12:34:38.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f800035b0 con 0x7f5f9406a820 2023-10-14T12:34:38.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3998974848 0 0) 0x7f5f800035b0 con 0x7f5f9406a820 2023-10-14T12:34:38.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940ca7d0 msgr2=0x7f5f94071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:38.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940ca7d0 0x7f5f94071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 >> v2:172.21.15.123:3300/0 conn(0x7f5f940cf7d0 msgr2=0x7f5f9415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:38.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 --2- 172.21.15.72:0/896906991 >> v2:172.21.15.123:3300/0 conn(0x7f5f940cf7d0 0x7f5f9415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f940af9d0 con 0x7f5f9406a820 2023-10-14T12:34:38.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f5f84001670 con 0x7f5f9406a820 2023-10-14T12:34:38.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f98e1a700 1 --2- 172.21.15.72:0/896906991 >> v2:172.21.15.123:3300/0 conn(0x7f5f940cf7d0 0x7f5f9415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:38.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 >> v1:172.21.15.72:6789/0 conn(0x7f5f9406a820 legacy=0x7f5f9406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f80003a00 0x7f5f80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f80004850 0x7f5f80004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940ca7d0 0x7f5f80005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940ce410 con 0x7f5f80004850 2023-10-14T12:34:38.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940cfc30 con 0x7f5f80003a00 2023-10-14T12:34:38.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8000ba10 con 0x7f5f940ca7d0 2023-10-14T12:34:38.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f98e1a700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f80004850 0x7f5f80004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f9961b700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f80003a00 0x7f5f80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.311+0000 7f5f99e1c700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940ca7d0 0x7f5f80005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f98e1a700 1 -- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940ca7d0 msgr2=0x7f5f80005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:38.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f98e1a700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940ca7d0 0x7f5f80005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f98e1a700 1 -- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f80003a00 msgr2=0x7f5f80003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f98e1a700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f80003a00 0x7f5f80003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f98e1a700 1 -- 172.21.15.72:0/896906991 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f800035b0 con 0x7f5f80004850 2023-10-14T12:34:38.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f99e1c700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940ca7d0 0x7f5f80005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:38.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f98e1a700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f80004850 0x7f5f80004cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009d60 tx=0x7f5f80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcd7d6a50963c0e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:38.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000e9a0 con 0x7f5f80004850 2023-10-14T12:34:38.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9000eb00 con 0x7f5f80004850 2023-10-14T12:34:38.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f8bfff700 1 -- 172.21.15.72:0/896906991 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9000eeb0 con 0x7f5f80004850 2023-10-14T12:34:38.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f9b87f700 1 -- 172.21.15.72:0/896906991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f80004850 msgr2=0x7f5f80004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f9b87f700 1 --2- 172.21.15.72:0/896906991 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f80004850 0x7f5f80004cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009d60 tx=0x7f5f80005880 comp rx=0 tx=0).stop 2023-10-14T12:34:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f99e1c700 1 -- 172.21.15.72:0/896906991 reap_dead start 2023-10-14T12:34:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f9b87f700 1 -- 172.21.15.72:0/896906991 shutdown_connections 2023-10-14T12:34:38.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.312+0000 7f5f9b87f700 1 -- 172.21.15.72:0/896906991 >> 172.21.15.72:0/896906991 conn(0x7f5f940d0180 msgr2=0x7f5f940d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.313+0000 7f5f9b87f700 1 -- 172.21.15.72:0/896906991 shutdown_connections 2023-10-14T12:34:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.313+0000 7f5f9b87f700 1 -- 172.21.15.72:0/896906991 wait complete. 2023-10-14T12:34:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.314+0000 7f5f9b87f700 1 Processor -- start 2023-10-14T12:34:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.314+0000 7f5f9b87f700 1 -- start start 2023-10-14T12:34:38.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.314+0000 7f5f9b87f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f80004850 0x7f5f94156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.314+0000 7f5f9b87f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940aeb80 0x7f5f940c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.314+0000 7f5f9b87f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f94156000 0x7f5f9415ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.314+0000 7f5f9b87f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940af000 con 0x7f5f94156000 2023-10-14T12:34:38.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.314+0000 7f5f9b87f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940c41d0 con 0x7f5f80004850 2023-10-14T12:34:38.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.314+0000 7f5f9b87f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f94156bb0 con 0x7f5f940aeb80 2023-10-14T12:34:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f99e1c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f94156000 0x7f5f9415ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f99e1c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f94156000 0x7f5f9415ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48434/0 (socket says 172.21.15.72:48434) 2023-10-14T12:34:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f99e1c700 1 -- 172.21.15.72:0/1037361206 learned_addr learned my addr 172.21.15.72:0/1037361206 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f9961b700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f80004850 0x7f5f94156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f98e1a700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940aeb80 0x7f5f940c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f99e1c700 1 -- 172.21.15.72:0/1037361206 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940aeb80 msgr2=0x7f5f940c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f99e1c700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940aeb80 0x7f5f940c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f99e1c700 1 -- 172.21.15.72:0/1037361206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f80004850 msgr2=0x7f5f94156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f99e1c700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f80004850 0x7f5f94156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f99e1c700 1 -- 172.21.15.72:0/1037361206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f941574a0 con 0x7f5f94156000 2023-10-14T12:34:38.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f98e1a700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940aeb80 0x7f5f940c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:38.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f99e1c700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f94156000 0x7f5f9415ff20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5f9406f450 tx=0x7f5f8c0104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:38.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f89ffb700 1 -- 172.21.15.72:0/1037361206 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00e050 con 0x7f5f94156000 2023-10-14T12:34:38.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f89ffb700 1 -- 172.21.15.72:0/1037361206 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00f040 con 0x7f5f94156000 2023-10-14T12:34:38.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f89ffb700 1 -- 172.21.15.72:0/1037361206 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c010e50 con 0x7f5f94156000 2023-10-14T12:34:38.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f94157780 con 0x7f5f94156000 2023-10-14T12:34:38.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.315+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f94157d40 con 0x7f5f94156000 2023-10-14T12:34:38.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.316+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9404ebb0 con 0x7f5f94156000 2023-10-14T12:34:38.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.317+0000 7f5f89ffb700 1 -- 172.21.15.72:0/1037361206 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f8c015440 con 0x7f5f94156000 2023-10-14T12:34:38.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.317+0000 7f5f89ffb700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5f7806af00 0x7f5f7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.317+0000 7f5f89ffb700 1 -- 172.21.15.72:0/1037361206 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5f8c0894d0 con 0x7f5f94156000 2023-10-14T12:34:38.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.317+0000 7f5f9961b700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5f7806af00 0x7f5f7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.318+0000 7f5f9961b700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5f7806af00 0x7f5f7806d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5f84001cf0 tx=0x7f5f84007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:38.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.322+0000 7f5f89ffb700 1 -- 172.21.15.72:0/1037361206 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5f8c054780 con 0x7f5f94156000 2023-10-14T12:34:38.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.588+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5f940d1040 con 0x7f5f94156000 2023-10-14T12:34:38.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.590+0000 7f5f89ffb700 1 -- 172.21.15.72:0/1037361206 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5f8c057da0 con 0x7f5f94156000 2023-10-14T12:34:38.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5f7806af00 msgr2=0x7f5f7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5f7806af00 0x7f5f7806d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5f84001cf0 tx=0x7f5f84007980 comp rx=0 tx=0).stop 2023-10-14T12:34:38.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f94156000 msgr2=0x7f5f9415ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f94156000 0x7f5f9415ff20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5f9406f450 tx=0x7f5f8c0104a0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 shutdown_connections 2023-10-14T12:34:38.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5f7806af00 0x7f5f7806d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f94156000 0x7f5f9415ff20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f80004850 0x7f5f94156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 --2- 172.21.15.72:0/1037361206 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5f940aeb80 0x7f5f940c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 >> 172.21.15.72:0/1037361206 conn(0x7f5f940d0180 msgr2=0x7f5f9415a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:38.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 shutdown_connections 2023-10-14T12:34:38.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.592+0000 7f5f9b87f700 1 -- 172.21.15.72:0/1037361206 wait complete. 2023-10-14T12:34:38.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T12:34:38.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.727+0000 7fc8f983e700 1 Processor -- start 2023-10-14T12:34:38.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.727+0000 7fc8f983e700 1 -- start start 2023-10-14T12:34:38.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f983e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8f4152470 0x7fc8f40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f983e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f40b3410 0x7fc8f40b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f983e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f4070d70 con 0x7fc8f40cb8d0 2023-10-14T12:34:38.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f983e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f4071200 con 0x7fc8f4152470 2023-10-14T12:34:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f983e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40cbd80 con 0x7fc8f40b3410 2023-10-14T12:34:38.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8f4152470 0x7fc8f40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f27fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc8f40cb8d0 0x7fc8f40b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54740/0 (socket says 172.21.15.72:54740) 2023-10-14T12:34:38.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f27fc700 1 -- 172.21.15.72:0/3478854315 learned_addr learned my addr 172.21.15.72:0/3478854315 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:38.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f37fe700 1 --2- 172.21.15.72:0/3478854315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f40b3410 0x7fc8f40b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f2ffd700 1 -- 172.21.15.72:0/3478854315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f40b3410 msgr2=0x7fc8f40b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:38.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f2ffd700 1 --2- 172.21.15.72:0/3478854315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f40b3410 0x7fc8f40b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f2ffd700 1 -- 172.21.15.72:0/3478854315 >> v1:172.21.15.72:6789/0 conn(0x7fc8f40cb8d0 legacy=0x7fc8f40b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f2ffd700 1 -- 172.21.15.72:0/3478854315 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4070440 con 0x7fc8f4152470 2023-10-14T12:34:38.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.728+0000 7fc8f1ffb700 1 -- 172.21.15.72:0/3478854315 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839651705 0 0) 0x7fc8f4070d70 con 0x7fc8f40cb8d0 2023-10-14T12:34:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f2ffd700 1 --2- 172.21.15.72:0/3478854315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f4152470 0x7fc8f40cd570 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009840 tx=0x7fc8e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142f113deb6e0c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f1ffb700 1 -- 172.21.15.72:0/3478854315 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011830 con 0x7fc8f4152470 2023-10-14T12:34:38.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f1ffb700 1 -- 172.21.15.72:0/3478854315 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e8011990 con 0x7fc8f4152470 2023-10-14T12:34:38.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f1ffb700 1 -- 172.21.15.72:0/3478854315 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8011d20 con 0x7fc8f4152470 2023-10-14T12:34:38.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f983e700 1 -- 172.21.15.72:0/3478854315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f4152470 msgr2=0x7fc8f40cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f983e700 1 --2- 172.21.15.72:0/3478854315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f4152470 0x7fc8f40cd570 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009840 tx=0x7fc8e8009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:38.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f983e700 1 -- 172.21.15.72:0/3478854315 shutdown_connections 2023-10-14T12:34:38.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f983e700 1 --2- 172.21.15.72:0/3478854315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f40b3410 0x7fc8f40b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f983e700 1 --2- 172.21.15.72:0/3478854315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f4152470 0x7fc8f40cd570 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f983e700 1 -- 172.21.15.72:0/3478854315 >> 172.21.15.72:0/3478854315 conn(0x7fc8f40cdd00 msgr2=0x7fc8f40ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:38.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f983e700 1 -- 172.21.15.72:0/3478854315 shutdown_connections 2023-10-14T12:34:38.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.729+0000 7fc8f983e700 1 -- 172.21.15.72:0/3478854315 wait complete. 2023-10-14T12:34:38.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.731+0000 7fc8f983e700 1 Processor -- start 2023-10-14T12:34:38.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.731+0000 7fc8f983e700 1 -- start start 2023-10-14T12:34:38.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.731+0000 7fc8f983e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f40b3410 0x7fc8f414dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.731+0000 7fc8f983e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8f40cb8d0 0x7fc8f40c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.731+0000 7fc8f983e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f4152470 0x7fc8f40c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.731+0000 7fc8f983e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f415d260 con 0x7fc8f40b3410 2023-10-14T12:34:38.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.731+0000 7fc8f983e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40caf60 con 0x7fc8f40cb8d0 2023-10-14T12:34:38.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.731+0000 7fc8f983e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f415c390 con 0x7fc8f4152470 2023-10-14T12:34:38.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f40b3410 0x7fc8f414dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f40b3410 0x7fc8f414dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48446/0 (socket says 172.21.15.72:48446) 2023-10-14T12:34:38.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f2ffd700 1 -- 172.21.15.72:0/2670391785 learned_addr learned my addr 172.21.15.72:0/2670391785 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:38.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f37fe700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f4152470 0x7fc8f40c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f27fc700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8f40cb8d0 0x7fc8f40c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f2ffd700 1 -- 172.21.15.72:0/2670391785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f4152470 msgr2=0x7fc8f40c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f2ffd700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f4152470 0x7fc8f40c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f2ffd700 1 -- 172.21.15.72:0/2670391785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8f40cb8d0 msgr2=0x7fc8f40c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:38.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f2ffd700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8f40cb8d0 0x7fc8f40c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:38.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f2ffd700 1 -- 172.21.15.72:0/2670391785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80094a0 con 0x7fc8f40b3410 2023-10-14T12:34:38.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f2ffd700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f40b3410 0x7fc8f414dc00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80090b0 tx=0x7fc8e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:38.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8dbfff700 1 -- 172.21.15.72:0/2670391785 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80038a0 con 0x7fc8f40b3410 2023-10-14T12:34:38.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8dbfff700 1 -- 172.21.15.72:0/2670391785 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e801e070 con 0x7fc8f40b3410 2023-10-14T12:34:38.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f40ca350 con 0x7fc8f40b3410 2023-10-14T12:34:38.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8dbfff700 1 -- 172.21.15.72:0/2670391785 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8003c20 con 0x7fc8f40b3410 2023-10-14T12:34:38.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.732+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f40ca910 con 0x7fc8f40b3410 2023-10-14T12:34:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.733+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f404ebb0 con 0x7fc8f40b3410 2023-10-14T12:34:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.734+0000 7fc8dbfff700 1 -- 172.21.15.72:0/2670391785 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc8e801a420 con 0x7fc8f40b3410 2023-10-14T12:34:38.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.734+0000 7fc8dbfff700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc8e006af00 0x7fc8e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:38.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.734+0000 7fc8dbfff700 1 -- 172.21.15.72:0/2670391785 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc8e808a470 con 0x7fc8f40b3410 2023-10-14T12:34:38.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.734+0000 7fc8f27fc700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc8e006af00 0x7fc8e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:38.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.734+0000 7fc8f27fc700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc8e006af00 0x7fc8e006d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc8f41f4070 tx=0x7fc8e4007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:38.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:38.738+0000 7fc8dbfff700 1 -- 172.21.15.72:0/2670391785 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8e80557c0 con 0x7fc8f40b3410 2023-10-14T12:34:39.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.005+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc8f406f630 con 0x7fc8f40b3410 2023-10-14T12:34:39.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.007+0000 7fc8dbfff700 1 -- 172.21.15.72:0/2670391785 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc8e8058de0 con 0x7fc8f40b3410 2023-10-14T12:34:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc8e006af00 msgr2=0x7fc8e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc8e006af00 0x7fc8e006d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc8f41f4070 tx=0x7fc8e4007be0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f40b3410 msgr2=0x7fc8f414dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f40b3410 0x7fc8f414dc00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80090b0 tx=0x7fc8e8004750 comp rx=0 tx=0).stop 2023-10-14T12:34:39.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 shutdown_connections 2023-10-14T12:34:39.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc8e006af00 0x7fc8e006d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc8f4152470 0x7fc8f40c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f40b3410 0x7fc8f414dc00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 --2- 172.21.15.72:0/2670391785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8f40cb8d0 0x7fc8f40c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 >> 172.21.15.72:0/2670391785 conn(0x7fc8f40cdd00 msgr2=0x7fc8f415f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 shutdown_connections 2023-10-14T12:34:39.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.010+0000 7fc8f983e700 1 -- 172.21.15.72:0/2670391785 wait complete. 2023-10-14T12:34:39.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T12:34:39.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54f57b0700 1 Processor -- start 2023-10-14T12:34:39.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54f57b0700 1 -- start start 2023-10-14T12:34:39.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54f57b0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54f0157d30 0x7f54f00d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54f57b0700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f54f00cf580 0x7f54f00cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54f57b0700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f006c350 con 0x7f54f015e870 2023-10-14T12:34:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54f57b0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f015edd0 con 0x7f54f0157d30 2023-10-14T12:34:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54f57b0700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f0158110 con 0x7f54f00cf580 2023-10-14T12:34:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54eeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54f0157d30 0x7f54f00d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54eeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54f0157d30 0x7f54f00d1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48454/0 (socket says 172.21.15.72:48454) 2023-10-14T12:34:39.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.143+0000 7f54eeffd700 1 -- 172.21.15.72:0/2807373823 learned_addr learned my addr 172.21.15.72:0/2807373823 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:39.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.144+0000 7f54eeffd700 1 -- 172.21.15.72:0/2807373823 >> v2:172.21.15.123:3300/0 conn(0x7f54f00cf580 msgr2=0x7f54f00cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:39.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.144+0000 7f54eeffd700 1 --2- 172.21.15.72:0/2807373823 >> v2:172.21.15.123:3300/0 conn(0x7f54f00cf580 0x7f54f00cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.144+0000 7f54eeffd700 1 -- 172.21.15.72:0/2807373823 >> v1:172.21.15.123:6789/0 conn(0x7f54f015e870 legacy=0x7f54f00cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:39.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.144+0000 7f54eeffd700 1 -- 172.21.15.72:0/2807373823 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f00d20c0 con 0x7f54f0157d30 2023-10-14T12:34:39.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.144+0000 7f54eeffd700 1 --2- 172.21.15.72:0/2807373823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f0157d30 0x7f54f00d1870 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f54f0143f10 tx=0x7f54e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6517b4cdda611bd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:39.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.144+0000 7f54edffb700 1 -- 172.21.15.72:0/2807373823 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0004230 con 0x7f54f0157d30 2023-10-14T12:34:39.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.144+0000 7f54edffb700 1 -- 172.21.15.72:0/2807373823 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e0004390 con 0x7f54f0157d30 2023-10-14T12:34:39.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.144+0000 7f54edffb700 1 -- 172.21.15.72:0/2807373823 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e00036a0 con 0x7f54f0157d30 2023-10-14T12:34:39.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.145+0000 7f54f57b0700 1 -- 172.21.15.72:0/2807373823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f0157d30 msgr2=0x7f54f00d1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.145+0000 7f54f57b0700 1 --2- 172.21.15.72:0/2807373823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f0157d30 0x7f54f00d1870 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f54f0143f10 tx=0x7f54e0009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.145+0000 7f54f57b0700 1 -- 172.21.15.72:0/2807373823 shutdown_connections 2023-10-14T12:34:39.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.145+0000 7f54f57b0700 1 --2- 172.21.15.72:0/2807373823 >> v2:172.21.15.123:3300/0 conn(0x7f54f00cf580 0x7f54f00cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.145+0000 7f54f57b0700 1 --2- 172.21.15.72:0/2807373823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f0157d30 0x7f54f00d1870 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.145+0000 7f54f57b0700 1 -- 172.21.15.72:0/2807373823 >> 172.21.15.72:0/2807373823 conn(0x7f54f006a820 msgr2=0x7f54f006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:39.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.145+0000 7f54f57b0700 1 -- 172.21.15.72:0/2807373823 shutdown_connections 2023-10-14T12:34:39.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.145+0000 7f54f57b0700 1 -- 172.21.15.72:0/2807373823 wait complete. 2023-10-14T12:34:39.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.146+0000 7f54f57b0700 1 Processor -- start 2023-10-14T12:34:39.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.146+0000 7f54f57b0700 1 -- start start 2023-10-14T12:34:39.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54f57b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f00cf580 0x7f54f01f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54f57b0700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54f0157d30 0x7f54f00ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54f57b0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f015e870 0x7f54f00caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54f57b0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00cafa0 con 0x7f54f00cf580 2023-10-14T12:34:39.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54f57b0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00cc9a0 con 0x7f54f015e870 2023-10-14T12:34:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54f57b0700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f00ccc80 con 0x7f54f0157d30 2023-10-14T12:34:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f00cf580 0x7f54f01f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54eeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f00cf580 0x7f54f01f26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48460/0 (socket says 172.21.15.72:48460) 2023-10-14T12:34:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54eeffd700 1 -- 172.21.15.72:0/3304277978 learned_addr learned my addr 172.21.15.72:0/3304277978 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:39.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54ef7fe700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f015e870 0x7f54f00caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54eeffd700 1 -- 172.21.15.72:0/3304277978 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54f0157d30 msgr2=0x7f54f00ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54eeffd700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54f0157d30 0x7f54f00ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54eeffd700 1 -- 172.21.15.72:0/3304277978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f015e870 msgr2=0x7f54f00caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54eeffd700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f015e870 0x7f54f00caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54eeffd700 1 -- 172.21.15.72:0/3304277978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e0009550 con 0x7f54f00cf580 2023-10-14T12:34:39.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54eeffd700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f00cf580 0x7f54f01f26b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f54f00d23a0 tx=0x7f54e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:39.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54e77fe700 1 -- 172.21.15.72:0/3304277978 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0011630 con 0x7f54f00cf580 2023-10-14T12:34:39.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54e77fe700 1 -- 172.21.15.72:0/3304277978 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e0011790 con 0x7f54f00cf580 2023-10-14T12:34:39.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f00ccf60 con 0x7f54f00cf580 2023-10-14T12:34:39.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54e77fe700 1 -- 172.21.15.72:0/3304277978 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0011b40 con 0x7f54f00cf580 2023-10-14T12:34:39.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.147+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f00cd520 con 0x7f54f00cf580 2023-10-14T12:34:39.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.148+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f004ebb0 con 0x7f54f00cf580 2023-10-14T12:34:39.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.149+0000 7f54e77fe700 1 -- 172.21.15.72:0/3304277978 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f54e0011ca0 con 0x7f54f00cf580 2023-10-14T12:34:39.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.149+0000 7f54e77fe700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54d006af00 0x7f54d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.149+0000 7f54e77fe700 1 -- 172.21.15.72:0/3304277978 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f54e008aaf0 con 0x7f54f00cf580 2023-10-14T12:34:39.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.149+0000 7f54ee7fc700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54d006af00 0x7f54d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.149+0000 7f54ee7fc700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54d006af00 0x7f54d006d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54d80096d0 tx=0x7f54d8006c30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:39.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.153+0000 7f54e77fe700 1 -- 172.21.15.72:0/3304277978 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f54e0055ef0 con 0x7f54f00cf580 2023-10-14T12:34:39.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.422+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f54f00b36e0 con 0x7f54f00cf580 2023-10-14T12:34:39.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.424+0000 7f54e77fe700 1 -- 172.21.15.72:0/3304277978 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f54e0059510 con 0x7f54f00cf580 2023-10-14T12:34:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.426+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54d006af00 msgr2=0x7f54d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.426+0000 7f54f57b0700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54d006af00 0x7f54d006d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f54d80096d0 tx=0x7f54d8006c30 comp rx=0 tx=0).stop 2023-10-14T12:34:39.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.426+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f00cf580 msgr2=0x7f54f01f26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.426+0000 7f54f57b0700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f00cf580 0x7f54f01f26b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f54f00d23a0 tx=0x7f54e0004750 comp rx=0 tx=0).stop 2023-10-14T12:34:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.427+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 shutdown_connections 2023-10-14T12:34:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.427+0000 7f54f57b0700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54d006af00 0x7f54d006d3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.427+0000 7f54f57b0700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54f015e870 0x7f54f00caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.427+0000 7f54f57b0700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54f00cf580 0x7f54f01f26b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.427+0000 7f54f57b0700 1 --2- 172.21.15.72:0/3304277978 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f54f0157d30 0x7f54f00ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.427+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 >> 172.21.15.72:0/3304277978 conn(0x7f54f006a820 msgr2=0x7f54f006ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:39.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.427+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 shutdown_connections 2023-10-14T12:34:39.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.427+0000 7f54f57b0700 1 -- 172.21.15.72:0/3304277978 wait complete. 2023-10-14T12:34:39.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T12:34:39.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.560+0000 7f3daea5e700 1 Processor -- start 2023-10-14T12:34:39.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.560+0000 7f3daea5e700 1 -- start start 2023-10-14T12:34:39.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3daea5e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3da806b7e0 0x7f3da806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3daea5e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da80ce7e0 con 0x7f3da815d890 2023-10-14T12:34:39.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3daea5e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da80ceab0 con 0x7f3da80b6620 2023-10-14T12:34:39.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3daea5e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da806c1d0 con 0x7f3da806b7e0 2023-10-14T12:34:39.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3da77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3da806b7e0 0x7f3da806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3da7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3da815d890 0x7f3da80ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54768/0 (socket says 172.21.15.72:54768) 2023-10-14T12:34:39.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3da7fff700 1 -- 172.21.15.72:0/1222788313 learned_addr learned my addr 172.21.15.72:0/1222788313 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:39.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3da77fe700 1 -- 172.21.15.72:0/1222788313 >> v1:172.21.15.123:6789/0 conn(0x7f3da80b6620 legacy=0x7f3da80b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:39.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3da77fe700 1 -- 172.21.15.72:0/1222788313 >> v1:172.21.15.72:6789/0 conn(0x7f3da815d890 legacy=0x7f3da80ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3da77fe700 1 -- 172.21.15.72:0/1222788313 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80ced90 con 0x7f3da806b7e0 2023-10-14T12:34:39.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.561+0000 7f3da6ffd700 1 -- 172.21.15.72:0/1222788313 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234561641 0 0) 0x7f3da80ce7e0 con 0x7f3da815d890 2023-10-14T12:34:39.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3da77fe700 1 --2- 172.21.15.72:0/1222788313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da806b7e0 0x7f3da806bc90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009840 tx=0x7f3d98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921f66c54ead2705 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3da6ffd700 1 -- 172.21.15.72:0/1222788313 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98004230 con 0x7f3da806b7e0 2023-10-14T12:34:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3da6ffd700 1 -- 172.21.15.72:0/1222788313 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d98004390 con 0x7f3da806b7e0 2023-10-14T12:34:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3da6ffd700 1 -- 172.21.15.72:0/1222788313 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980036a0 con 0x7f3da806b7e0 2023-10-14T12:34:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3daea5e700 1 -- 172.21.15.72:0/1222788313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da806b7e0 msgr2=0x7f3da806bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3daea5e700 1 --2- 172.21.15.72:0/1222788313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da806b7e0 0x7f3da806bc90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009840 tx=0x7f3d98009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:39.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3daea5e700 1 -- 172.21.15.72:0/1222788313 shutdown_connections 2023-10-14T12:34:39.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3daea5e700 1 --2- 172.21.15.72:0/1222788313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da806b7e0 0x7f3da806bc90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3daea5e700 1 -- 172.21.15.72:0/1222788313 >> 172.21.15.72:0/1222788313 conn(0x7f3da8072340 msgr2=0x7f3da8072750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:39.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3daea5e700 1 -- 172.21.15.72:0/1222788313 shutdown_connections 2023-10-14T12:34:39.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.562+0000 7f3daea5e700 1 -- 172.21.15.72:0/1222788313 wait complete. 2023-10-14T12:34:39.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.563+0000 7f3daea5e700 1 Processor -- start 2023-10-14T12:34:39.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.564+0000 7f3daea5e700 1 -- start start 2023-10-14T12:34:39.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.564+0000 7f3daea5e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3da806b7e0 0x7f3da80cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.564+0000 7f3daea5e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da80b6620 0x7f3da81f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.564+0000 7f3daea5e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da815d890 0x7f3da815e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.564+0000 7f3daea5e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80cd9a0 con 0x7f3da80b6620 2023-10-14T12:34:39.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.564+0000 7f3daea5e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8155430 con 0x7f3da815d890 2023-10-14T12:34:39.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.564+0000 7f3daea5e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8155710 con 0x7f3da806b7e0 2023-10-14T12:34:39.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.564+0000 7f3da77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da80b6620 0x7f3da81f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da80b6620 0x7f3da81f22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48476/0 (socket says 172.21.15.72:48476) 2023-10-14T12:34:39.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da77fe700 1 -- 172.21.15.72:0/4132036961 learned_addr learned my addr 172.21.15.72:0/4132036961 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:39.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da7fff700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3da806b7e0 0x7f3da80cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3dacffb700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da815d890 0x7f3da815e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da77fe700 1 -- 172.21.15.72:0/4132036961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3da806b7e0 msgr2=0x7f3da80cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da77fe700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3da806b7e0 0x7f3da80cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da77fe700 1 -- 172.21.15.72:0/4132036961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da815d890 msgr2=0x7f3da815e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da77fe700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da815d890 0x7f3da815e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da77fe700 1 -- 172.21.15.72:0/4132036961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980094a0 con 0x7f3da80b6620 2023-10-14T12:34:39.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da77fe700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da80b6620 0x7f3da81f22e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d98000c00 tx=0x7f3d98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:39.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da4ff9700 1 -- 172.21.15.72:0/4132036961 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98003de0 con 0x7f3da80b6620 2023-10-14T12:34:39.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da4ff9700 1 -- 172.21.15.72:0/4132036961 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9801e070 con 0x7f3da80b6620 2023-10-14T12:34:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da80cab10 con 0x7f3da80b6620 2023-10-14T12:34:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3da4ff9700 1 -- 172.21.15.72:0/4132036961 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98011870 con 0x7f3da80b6620 2023-10-14T12:34:39.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.565+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da80cb0d0 con 0x7f3da80b6620 2023-10-14T12:34:39.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.566+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da804ebb0 con 0x7f3da80b6620 2023-10-14T12:34:39.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.566+0000 7f3da4ff9700 1 -- 172.21.15.72:0/4132036961 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d980119d0 con 0x7f3da80b6620 2023-10-14T12:34:39.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.567+0000 7f3da4ff9700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d9406af00 0x7f3d9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.567+0000 7f3da4ff9700 1 -- 172.21.15.72:0/4132036961 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3d9808a610 con 0x7f3da80b6620 2023-10-14T12:34:39.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.567+0000 7f3da7fff700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d9406af00 0x7f3d9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.567+0000 7f3da7fff700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d9406af00 0x7f3d9406d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c000f60 tx=0x7f3d9c004a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:39.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.571+0000 7f3da4ff9700 1 -- 172.21.15.72:0/4132036961 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d98055960 con 0x7f3da80b6620 2023-10-14T12:34:39.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.841+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3da8072aa0 con 0x7f3da80b6620 2023-10-14T12:34:39.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.843+0000 7f3da4ff9700 1 -- 172.21.15.72:0/4132036961 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3d98020020 con 0x7f3da80b6620 2023-10-14T12:34:39.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d9406af00 msgr2=0x7f3d9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d9406af00 0x7f3d9406d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c000f60 tx=0x7f3d9c004a50 comp rx=0 tx=0).stop 2023-10-14T12:34:39.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da80b6620 msgr2=0x7f3da81f22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da80b6620 0x7f3da81f22e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d98000c00 tx=0x7f3d98004750 comp rx=0 tx=0).stop 2023-10-14T12:34:39.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 shutdown_connections 2023-10-14T12:34:39.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d9406af00 0x7f3d9406d3c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3da815d890 0x7f3da815e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3da806b7e0 0x7f3da80cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 --2- 172.21.15.72:0/4132036961 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3da80b6620 0x7f3da81f22e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.845+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 >> 172.21.15.72:0/4132036961 conn(0x7f3da8072340 msgr2=0x7f3da80b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:39.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.846+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 shutdown_connections 2023-10-14T12:34:39.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.846+0000 7f3daea5e700 1 -- 172.21.15.72:0/4132036961 wait complete. 2023-10-14T12:34:39.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T12:34:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.979+0000 7f4f07010700 1 Processor -- start 2023-10-14T12:34:39.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.979+0000 7f4f07010700 1 -- start start 2023-10-14T12:34:39.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.980+0000 7f4f07010700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f000cb400 0x7f4f0015e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.980+0000 7f4f07010700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f0015eb80 0x7f4f000aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.980+0000 7f4f07010700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0015e1b0 con 0x7f4f0015a240 2023-10-14T12:34:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.980+0000 7f4f07010700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0015de60 con 0x7f4f000cb400 2023-10-14T12:34:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.980+0000 7f4f07010700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000cb9c0 con 0x7f4f0015eb80 2023-10-14T12:34:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.980+0000 7f4efffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4f000cb400 0x7f4f0015e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.980+0000 7f4f04dac700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4f0015a240 0x7f4f000caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54782/0 (socket says 172.21.15.72:54782) 2023-10-14T12:34:39.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.980+0000 7f4f04dac700 1 -- 172.21.15.72:0/674115660 learned_addr learned my addr 172.21.15.72:0/674115660 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:39.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4efffff700 1 -- 172.21.15.72:0/674115660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f0015eb80 msgr2=0x7f4f000aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:39.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4efffff700 1 --2- 172.21.15.72:0/674115660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f0015eb80 0x7f4f000aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4efffff700 1 -- 172.21.15.72:0/674115660 >> v1:172.21.15.72:6789/0 conn(0x7f4f0015a240 legacy=0x7f4f000caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4eff7fe700 1 -- 172.21.15.72:0/674115660 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590336841 0 0) 0x7f4f0015e1b0 con 0x7f4f0015a240 2023-10-14T12:34:39.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4efffff700 1 -- 172.21.15.72:0/674115660 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f000cbca0 con 0x7f4f000cb400 2023-10-14T12:34:39.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4efffff700 1 --2- 172.21.15.72:0/674115660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f000cb400 0x7f4f0015e640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009840 tx=0x7f4eec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55287afe54a52704 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:39.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4eff7fe700 1 -- 172.21.15.72:0/674115660 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec011830 con 0x7f4f000cb400 2023-10-14T12:34:39.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4eff7fe700 1 -- 172.21.15.72:0/674115660 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec011990 con 0x7f4f000cb400 2023-10-14T12:34:39.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4eff7fe700 1 -- 172.21.15.72:0/674115660 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec011d20 con 0x7f4f000cb400 2023-10-14T12:34:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4f07010700 1 -- 172.21.15.72:0/674115660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f000cb400 msgr2=0x7f4f0015e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4f07010700 1 --2- 172.21.15.72:0/674115660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f000cb400 0x7f4f0015e640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009840 tx=0x7f4eec009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4f07010700 1 -- 172.21.15.72:0/674115660 shutdown_connections 2023-10-14T12:34:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4f07010700 1 --2- 172.21.15.72:0/674115660 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f0015eb80 0x7f4f000aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4f07010700 1 --2- 172.21.15.72:0/674115660 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f000cb400 0x7f4f0015e640 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4f07010700 1 -- 172.21.15.72:0/674115660 >> 172.21.15.72:0/674115660 conn(0x7f4f000ccbd0 msgr2=0x7f4f000ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:39.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4f07010700 1 -- 172.21.15.72:0/674115660 shutdown_connections 2023-10-14T12:34:39.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.981+0000 7f4f07010700 1 -- 172.21.15.72:0/674115660 wait complete. 2023-10-14T12:34:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.983+0000 7f4f07010700 1 Processor -- start 2023-10-14T12:34:39.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.983+0000 7f4f07010700 1 -- start start 2023-10-14T12:34:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.983+0000 7f4f07010700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f000cb400 0x7f4f000c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.983+0000 7f4f07010700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f0015a240 0x7f4f00156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4f07010700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f0015eb80 0x7f4f000c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4f07010700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000ada60 con 0x7f4f0015a240 2023-10-14T12:34:39.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4f07010700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000ad530 con 0x7f4f0015eb80 2023-10-14T12:34:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4f07010700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f001f3400 con 0x7f4f000cb400 2023-10-14T12:34:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f0015a240 0x7f4f00156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f0015a240 0x7f4f00156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48490/0 (socket says 172.21.15.72:48490) 2023-10-14T12:34:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efffff700 1 -- 172.21.15.72:0/1916721422 learned_addr learned my addr 172.21.15.72:0/1916721422 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:39.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efffff700 1 -- 172.21.15.72:0/1916721422 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f000cb400 msgr2=0x7f4f000c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efffff700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f000cb400 0x7f4f000c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efffff700 1 -- 172.21.15.72:0/1916721422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f0015eb80 msgr2=0x7f4f000c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:39.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efffff700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f0015eb80 0x7f4f000c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:39.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efffff700 1 -- 172.21.15.72:0/1916721422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0094a0 con 0x7f4f0015a240 2023-10-14T12:34:39.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efffff700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f0015a240 0x7f4f00156c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4f0006c910 tx=0x7f4eec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:39.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efd7fa700 1 -- 172.21.15.72:0/1916721422 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec0038a0 con 0x7f4f0015a240 2023-10-14T12:34:39.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efd7fa700 1 -- 172.21.15.72:0/1916721422 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec01f070 con 0x7f4f0015a240 2023-10-14T12:34:39.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f000ad780 con 0x7f4f0015a240 2023-10-14T12:34:39.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4efd7fa700 1 -- 172.21.15.72:0/1916721422 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec003c40 con 0x7f4f0015a240 2023-10-14T12:34:39.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.984+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f001f3950 con 0x7f4f0015a240 2023-10-14T12:34:39.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.985+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0004ebb0 con 0x7f4f0015a240 2023-10-14T12:34:39.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.985+0000 7f4efd7fa700 1 -- 172.21.15.72:0/1916721422 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4eec026480 con 0x7f4f0015a240 2023-10-14T12:34:39.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.986+0000 7f4efd7fa700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4ee406af00 0x7f4ee406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:39.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.986+0000 7f4efd7fa700 1 -- 172.21.15.72:0/1916721422 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4eec021070 con 0x7f4f0015a240 2023-10-14T12:34:39.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.986+0000 7f4f04dac700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4ee406af00 0x7f4ee406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:39.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.986+0000 7f4f04dac700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4ee406af00 0x7f4ee406d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40011e0 tx=0x7f4ef40079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:39.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:39.990+0000 7f4efd7fa700 1 -- 172.21.15.72:0/1916721422 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4eec0561a0 con 0x7f4f0015a240 2023-10-14T12:34:40.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.258+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4f000adbf0 con 0x7f4f0015a240 2023-10-14T12:34:40.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.261+0000 7f4efd7fa700 1 -- 172.21.15.72:0/1916721422 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4eec0597c0 con 0x7f4f0015a240 2023-10-14T12:34:40.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4ee406af00 msgr2=0x7f4ee406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4ee406af00 0x7f4ee406d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40011e0 tx=0x7f4ef40079b0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f0015a240 msgr2=0x7f4f00156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f0015a240 0x7f4f00156c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4f0006c910 tx=0x7f4eec004750 comp rx=0 tx=0).stop 2023-10-14T12:34:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 shutdown_connections 2023-10-14T12:34:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f4ee406af00 0x7f4ee406d3c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f0015eb80 0x7f4f000c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4f000cb400 0x7f4f000c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 --2- 172.21.15.72:0/1916721422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f0015a240 0x7f4f00156c10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 >> 172.21.15.72:0/1916721422 conn(0x7f4f000ccbd0 msgr2=0x7f4f000c69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 shutdown_connections 2023-10-14T12:34:40.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.263+0000 7f4f07010700 1 -- 172.21.15.72:0/1916721422 wait complete. 2023-10-14T12:34:40.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T12:34:40.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.395+0000 7f23aaffd700 1 Processor -- start 2023-10-14T12:34:40.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.395+0000 7f23aaffd700 1 -- start start 2023-10-14T12:34:40.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23aaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23a40cf7d0 0x7f23a415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23aaffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f23a40ca7d0 0x7f23a4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23aaffd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a40cfeb0 con 0x7f23a406a820 2023-10-14T12:34:40.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23aaffd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a40ce410 con 0x7f23a40cf7d0 2023-10-14T12:34:40.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23aaffd700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a40cfc30 con 0x7f23a40ca7d0 2023-10-14T12:34:40.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23a8d99700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f23a406a820 0x7f23a406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54796/0 (socket says 172.21.15.72:54796) 2023-10-14T12:34:40.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23a8d99700 1 -- 172.21.15.72:0/3456839008 learned_addr learned my addr 172.21.15.72:0/3456839008 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:40.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23a3fff700 1 --2- 172.21.15.72:0/3456839008 >> v2:172.21.15.72:3300/0 conn(0x7f23a40cf7d0 0x7f23a415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23a959a700 1 --2- 172.21.15.72:0/3456839008 >> v2:172.21.15.123:3300/0 conn(0x7f23a40ca7d0 0x7f23a4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.396+0000 7f23a37fe700 1 -- 172.21.15.72:0/3456839008 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977051550 0 0) 0x7f23a40cfeb0 con 0x7f23a406a820 2023-10-14T12:34:40.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a37fe700 1 -- 172.21.15.72:0/3456839008 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23940035b0 con 0x7f23a406a820 2023-10-14T12:34:40.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a3fff700 1 -- 172.21.15.72:0/3456839008 >> v2:172.21.15.123:3300/0 conn(0x7f23a40ca7d0 msgr2=0x7f23a4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:40.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a3fff700 1 --2- 172.21.15.72:0/3456839008 >> v2:172.21.15.123:3300/0 conn(0x7f23a40ca7d0 0x7f23a4071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a3fff700 1 -- 172.21.15.72:0/3456839008 >> v1:172.21.15.72:6789/0 conn(0x7f23a406a820 legacy=0x7f23a406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a3fff700 1 -- 172.21.15.72:0/3456839008 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40af9d0 con 0x7f23a40cf7d0 2023-10-14T12:34:40.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a959a700 1 --2- 172.21.15.72:0/3456839008 >> v2:172.21.15.123:3300/0 conn(0x7f23a40ca7d0 0x7f23a4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:40.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a3fff700 1 --2- 172.21.15.72:0/3456839008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40cf7d0 0x7f23a415e7f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f23a40b2cb0 tx=0x7f2390009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ad83d622a0400a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:40.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a37fe700 1 -- 172.21.15.72:0/3456839008 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390011830 con 0x7f23a40cf7d0 2023-10-14T12:34:40.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a37fe700 1 -- 172.21.15.72:0/3456839008 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390011990 con 0x7f23a40cf7d0 2023-10-14T12:34:40.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23a37fe700 1 -- 172.21.15.72:0/3456839008 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390011d20 con 0x7f23a40cf7d0 2023-10-14T12:34:40.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23aaffd700 1 -- 172.21.15.72:0/3456839008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40cf7d0 msgr2=0x7f23a415e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23aaffd700 1 --2- 172.21.15.72:0/3456839008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40cf7d0 0x7f23a415e7f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f23a40b2cb0 tx=0x7f2390009b20 comp rx=0 tx=0).stop 2023-10-14T12:34:40.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23aaffd700 1 -- 172.21.15.72:0/3456839008 shutdown_connections 2023-10-14T12:34:40.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23aaffd700 1 --2- 172.21.15.72:0/3456839008 >> v2:172.21.15.123:3300/0 conn(0x7f23a40ca7d0 0x7f23a4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23aaffd700 1 --2- 172.21.15.72:0/3456839008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40cf7d0 0x7f23a415e7f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23aaffd700 1 -- 172.21.15.72:0/3456839008 >> 172.21.15.72:0/3456839008 conn(0x7f23a40d0180 msgr2=0x7f23a40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:40.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23aaffd700 1 -- 172.21.15.72:0/3456839008 shutdown_connections 2023-10-14T12:34:40.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.397+0000 7f23aaffd700 1 -- 172.21.15.72:0/3456839008 wait complete. 2023-10-14T12:34:40.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.399+0000 7f23aaffd700 1 Processor -- start 2023-10-14T12:34:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.399+0000 7f23aaffd700 1 -- start start 2023-10-14T12:34:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23aaffd700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23a406a820 0x7f23a4158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23aaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40ca7d0 0x7f23a40c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23aaffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23a40cf7d0 0x7f23a40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23aaffd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a40c46a0 con 0x7f23a40ca7d0 2023-10-14T12:34:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23aaffd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a40c48f0 con 0x7f23a40cf7d0 2023-10-14T12:34:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23aaffd700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a40c4bd0 con 0x7f23a406a820 2023-10-14T12:34:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23a3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40ca7d0 0x7f23a40c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23a3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40ca7d0 0x7f23a40c63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48504/0 (socket says 172.21.15.72:48504) 2023-10-14T12:34:40.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23a3fff700 1 -- 172.21.15.72:0/272648378 learned_addr learned my addr 172.21.15.72:0/272648378 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:40.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.400+0000 7f23a959a700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23a40cf7d0 0x7f23a40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a8d99700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23a406a820 0x7f23a4158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a3fff700 1 -- 172.21.15.72:0/272648378 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23a406a820 msgr2=0x7f23a4158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a3fff700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23a406a820 0x7f23a4158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a3fff700 1 -- 172.21.15.72:0/272648378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23a40cf7d0 msgr2=0x7f23a40b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a3fff700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23a40cf7d0 0x7f23a40b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a3fff700 1 -- 172.21.15.72:0/272648378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900094a0 con 0x7f23a40ca7d0 2023-10-14T12:34:40.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a3fff700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40ca7d0 0x7f23a40c63a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2390000c00 tx=0x7f2390004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:40.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a17fa700 1 -- 172.21.15.72:0/272648378 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23900036a0 con 0x7f23a40ca7d0 2023-10-14T12:34:40.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a17fa700 1 -- 172.21.15.72:0/272648378 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239001e070 con 0x7f23a40ca7d0 2023-10-14T12:34:40.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a40b45e0 con 0x7f23a40ca7d0 2023-10-14T12:34:40.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23a17fa700 1 -- 172.21.15.72:0/272648378 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390003a60 con 0x7f23a40ca7d0 2023-10-14T12:34:40.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.401+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a4159300 con 0x7f23a40ca7d0 2023-10-14T12:34:40.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.402+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a40b47f0 con 0x7f23a40ca7d0 2023-10-14T12:34:40.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.402+0000 7f23a17fa700 1 -- 172.21.15.72:0/272648378 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2390003bc0 con 0x7f23a40ca7d0 2023-10-14T12:34:40.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.403+0000 7f23a17fa700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f238806af00 0x7f238806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.403+0000 7f23a17fa700 1 -- 172.21.15.72:0/272648378 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f239008a330 con 0x7f23a40ca7d0 2023-10-14T12:34:40.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.403+0000 7f23a8d99700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f238806af00 0x7f238806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.403+0000 7f23a8d99700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f238806af00 0x7f238806d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23980011e0 tx=0x7f2398009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:40.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.407+0000 7f23a17fa700 1 -- 172.21.15.72:0/272648378 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2390055680 con 0x7f23a40ca7d0 2023-10-14T12:34:40.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.674+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f23a404ebb0 con 0x7f23a40ca7d0 2023-10-14T12:34:40.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.676+0000 7f23a17fa700 1 -- 172.21.15.72:0/272648378 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2390058ca0 con 0x7f23a40ca7d0 2023-10-14T12:34:40.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f238806af00 msgr2=0x7f238806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f238806af00 0x7f238806d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23980011e0 tx=0x7f2398009040 comp rx=0 tx=0).stop 2023-10-14T12:34:40.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40ca7d0 msgr2=0x7f23a40c63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40ca7d0 0x7f23a40c63a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2390000c00 tx=0x7f2390004750 comp rx=0 tx=0).stop 2023-10-14T12:34:40.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 shutdown_connections 2023-10-14T12:34:40.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f238806af00 0x7f238806d3c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23a40cf7d0 0x7f23a40b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23a406a820 0x7f23a4158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 --2- 172.21.15.72:0/272648378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23a40ca7d0 0x7f23a40c63a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 >> 172.21.15.72:0/272648378 conn(0x7f23a40d0180 msgr2=0x7f23a40cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 shutdown_connections 2023-10-14T12:34:40.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.679+0000 7f23aaffd700 1 -- 172.21.15.72:0/272648378 wait complete. 2023-10-14T12:34:40.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:40.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.811+0000 7f47e4e54700 1 Processor -- start 2023-10-14T12:34:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.811+0000 7f47e4e54700 1 -- start start 2023-10-14T12:34:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.812+0000 7f47e4e54700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47e00cf7d0 0x7f47e015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.812+0000 7f47e4e54700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e00cfeb0 con 0x7f47e006a820 2023-10-14T12:34:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.812+0000 7f47e4e54700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e00cfc30 con 0x7f47e00ca7d0 2023-10-14T12:34:40.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.812+0000 7f47e4e54700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00ce410 con 0x7f47e00cf7d0 2023-10-14T12:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.812+0000 7f47ddd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f47e00cf7d0 0x7f47e015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.812+0000 7f47de59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f47e006a820 0x7f47e006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54810/0 (socket says 172.21.15.72:54810) 2023-10-14T12:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.812+0000 7f47de59c700 1 -- 172.21.15.72:0/308847827 learned_addr learned my addr 172.21.15.72:0/308847827 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.813+0000 7f47ddd9b700 1 -- 172.21.15.72:0/308847827 >> v1:172.21.15.123:6789/0 conn(0x7f47e00ca7d0 legacy=0x7f47e0071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.813+0000 7f47ddd9b700 1 -- 172.21.15.72:0/308847827 >> v1:172.21.15.72:6789/0 conn(0x7f47e006a820 legacy=0x7f47e006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.813+0000 7f47ddd9b700 1 -- 172.21.15.72:0/308847827 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00af9d0 con 0x7f47e00cf7d0 2023-10-14T12:34:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.813+0000 7f47dd59a700 1 -- 172.21.15.72:0/308847827 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114111053 0 0) 0x7f47e00cfeb0 con 0x7f47e006a820 2023-10-14T12:34:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.813+0000 7f47ddd9b700 1 --2- 172.21.15.72:0/308847827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00cf7d0 0x7f47e015e7f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009840 tx=0x7f47d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c4bb8018d107e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.813+0000 7f47dd59a700 1 -- 172.21.15.72:0/308847827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0011830 con 0x7f47e00cf7d0 2023-10-14T12:34:40.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.813+0000 7f47dd59a700 1 -- 172.21.15.72:0/308847827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0011990 con 0x7f47e00cf7d0 2023-10-14T12:34:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.813+0000 7f47dd59a700 1 -- 172.21.15.72:0/308847827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0011d20 con 0x7f47e00cf7d0 2023-10-14T12:34:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.814+0000 7f47e4e54700 1 -- 172.21.15.72:0/308847827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00cf7d0 msgr2=0x7f47e015e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.814+0000 7f47e4e54700 1 --2- 172.21.15.72:0/308847827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00cf7d0 0x7f47e015e7f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009840 tx=0x7f47d0009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.814+0000 7f47e4e54700 1 -- 172.21.15.72:0/308847827 shutdown_connections 2023-10-14T12:34:40.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.814+0000 7f47e4e54700 1 --2- 172.21.15.72:0/308847827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00cf7d0 0x7f47e015e7f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.814+0000 7f47e4e54700 1 -- 172.21.15.72:0/308847827 >> 172.21.15.72:0/308847827 conn(0x7f47e00d0180 msgr2=0x7f47e00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.814+0000 7f47e4e54700 1 -- 172.21.15.72:0/308847827 shutdown_connections 2023-10-14T12:34:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.814+0000 7f47e4e54700 1 -- 172.21.15.72:0/308847827 wait complete. 2023-10-14T12:34:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.815+0000 7f47e4e54700 1 Processor -- start 2023-10-14T12:34:40.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.815+0000 7f47e4e54700 1 -- start start 2023-10-14T12:34:40.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47e4e54700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47e006a820 0x7f47e0155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47e4e54700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00ca7d0 0x7f47e0156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47e4e54700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47e00cf7d0 0x7f47e015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47e4e54700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00ae530 con 0x7f47e00ca7d0 2023-10-14T12:34:40.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47e4e54700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00ae780 con 0x7f47e006a820 2023-10-14T12:34:40.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47e4e54700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00aea60 con 0x7f47e00cf7d0 2023-10-14T12:34:40.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ddd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00ca7d0 0x7f47e0156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ddd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00ca7d0 0x7f47e0156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48516/0 (socket says 172.21.15.72:48516) 2023-10-14T12:34:40.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ddd9b700 1 -- 172.21.15.72:0/2258174137 learned_addr learned my addr 172.21.15.72:0/2258174137 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:40.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47de59c700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47e006a820 0x7f47e0155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ded9d700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47e00cf7d0 0x7f47e015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ddd9b700 1 -- 172.21.15.72:0/2258174137 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47e00cf7d0 msgr2=0x7f47e015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ddd9b700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47e00cf7d0 0x7f47e015c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ddd9b700 1 -- 172.21.15.72:0/2258174137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47e006a820 msgr2=0x7f47e0155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:40.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ddd9b700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47e006a820 0x7f47e0155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:40.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ddd9b700 1 -- 172.21.15.72:0/2258174137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d00094a0 con 0x7f47e00ca7d0 2023-10-14T12:34:40.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ddd9b700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00ca7d0 0x7f47e0156910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f47d0014040 tx=0x7f47d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:40.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ceffd700 1 -- 172.21.15.72:0/2258174137 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d001a850 con 0x7f47e00ca7d0 2023-10-14T12:34:40.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ceffd700 1 -- 172.21.15.72:0/2258174137 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d001a9b0 con 0x7f47e00ca7d0 2023-10-14T12:34:40.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e00aed40 con 0x7f47e00ca7d0 2023-10-14T12:34:40.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47ceffd700 1 -- 172.21.15.72:0/2258174137 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d001ad20 con 0x7f47e00ca7d0 2023-10-14T12:34:40.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.816+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e0157ed0 con 0x7f47e00ca7d0 2023-10-14T12:34:40.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.817+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e004ebb0 con 0x7f47e00ca7d0 2023-10-14T12:34:40.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.818+0000 7f47ceffd700 1 -- 172.21.15.72:0/2258174137 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f47d0022070 con 0x7f47e00ca7d0 2023-10-14T12:34:40.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.818+0000 7f47ceffd700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f47c006af00 0x7f47c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:40.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.818+0000 7f47ceffd700 1 -- 172.21.15.72:0/2258174137 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f47d008a540 con 0x7f47e00ca7d0 2023-10-14T12:34:40.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.818+0000 7f47de59c700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f47c006af00 0x7f47c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:40.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.818+0000 7f47de59c700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f47c006af00 0x7f47c006d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47d4007b10 tx=0x7f47d4007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:40.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:40.823+0000 7f47ceffd700 1 -- 172.21.15.72:0/2258174137 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47d00559b0 con 0x7f47e00ca7d0 2023-10-14T12:34:41.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.013+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47e00af3e0 con 0x7f47e00ca7d0 2023-10-14T12:34:41.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.013+0000 7f47ceffd700 1 -- 172.21.15.72:0/2258174137 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f47d0015090 con 0x7f47e00ca7d0 2023-10-14T12:34:41.016 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:41.016 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":34,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:37.715202+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:41.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.015+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f47c006af00 msgr2=0x7f47c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.015+0000 7f47e4e54700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f47c006af00 0x7f47c006d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47d4007b10 tx=0x7f47d4007a60 comp rx=0 tx=0).stop 2023-10-14T12:34:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.015+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00ca7d0 msgr2=0x7f47e0156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.015+0000 7f47e4e54700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00ca7d0 0x7f47e0156910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f47d0014040 tx=0x7f47d0004750 comp rx=0 tx=0).stop 2023-10-14T12:34:41.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.015+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 shutdown_connections 2023-10-14T12:34:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.015+0000 7f47e4e54700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f47c006af00 0x7f47c006d3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.015+0000 7f47e4e54700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f47e00cf7d0 0x7f47e015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.015+0000 7f47e4e54700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47e006a820 0x7f47e0155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.015+0000 7f47e4e54700 1 --2- 172.21.15.72:0/2258174137 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47e00ca7d0 0x7f47e0156910 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.016+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 >> 172.21.15.72:0/2258174137 conn(0x7f47e00d0180 msgr2=0x7f47e0158300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:41.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.016+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 shutdown_connections 2023-10-14T12:34:41.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.016+0000 7f47e4e54700 1 -- 172.21.15.72:0/2258174137 wait complete. 2023-10-14T12:34:41.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:33:25.420931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:34:41.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:34:41.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.152+0000 7f43f16e9700 1 Processor -- start 2023-10-14T12:34:41.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.152+0000 7f43f16e9700 1 -- start start 2023-10-14T12:34:41.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.152+0000 7f43f16e9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f43ec0b32e0 0x7f43ec15e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43f16e9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0d15e0 con 0x7f43ec0d0d40 2023-10-14T12:34:41.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43f16e9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0d18c0 con 0x7f43ec0cf560 2023-10-14T12:34:41.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43f16e9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0d2160 con 0x7f43ec0b32e0 2023-10-14T12:34:41.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43ea7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f43ec0d0d40 0x7f43ec0cee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54822/0 (socket says 172.21.15.72:54822) 2023-10-14T12:34:41.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43eaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f43ec0b32e0 0x7f43ec15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43ea7fc700 1 -- 172.21.15.72:0/1584370251 learned_addr learned my addr 172.21.15.72:0/1584370251 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:41.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43eaffd700 1 -- 172.21.15.72:0/1584370251 >> v1:172.21.15.123:6789/0 conn(0x7f43ec0cf560 legacy=0x7f43ec06bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43eaffd700 1 -- 172.21.15.72:0/1584370251 >> v1:172.21.15.72:6789/0 conn(0x7f43ec0d0d40 legacy=0x7f43ec0cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43eaffd700 1 -- 172.21.15.72:0/1584370251 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0d1ba0 con 0x7f43ec0b32e0 2023-10-14T12:34:41.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43e9ffb700 1 -- 172.21.15.72:0/1584370251 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895316375 0 0) 0x7f43ec0d15e0 con 0x7f43ec0d0d40 2023-10-14T12:34:41.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43eaffd700 1 --2- 172.21.15.72:0/1584370251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0b32e0 0x7f43ec15e710 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009840 tx=0x7f43dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d44c440c64e6de0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:41.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43e9ffb700 1 -- 172.21.15.72:0/1584370251 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc011830 con 0x7f43ec0b32e0 2023-10-14T12:34:41.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43e9ffb700 1 -- 172.21.15.72:0/1584370251 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc011990 con 0x7f43ec0b32e0 2023-10-14T12:34:41.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.153+0000 7f43e9ffb700 1 -- 172.21.15.72:0/1584370251 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc011d20 con 0x7f43ec0b32e0 2023-10-14T12:34:41.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.154+0000 7f43f16e9700 1 -- 172.21.15.72:0/1584370251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0b32e0 msgr2=0x7f43ec15e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.154+0000 7f43f16e9700 1 --2- 172.21.15.72:0/1584370251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0b32e0 0x7f43ec15e710 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009840 tx=0x7f43dc009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:41.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.154+0000 7f43f16e9700 1 -- 172.21.15.72:0/1584370251 shutdown_connections 2023-10-14T12:34:41.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.154+0000 7f43f16e9700 1 --2- 172.21.15.72:0/1584370251 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0b32e0 0x7f43ec15e710 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.154+0000 7f43f16e9700 1 -- 172.21.15.72:0/1584370251 >> 172.21.15.72:0/1584370251 conn(0x7f43ec06a820 msgr2=0x7f43ec06ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:41.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.154+0000 7f43f16e9700 1 -- 172.21.15.72:0/1584370251 shutdown_connections 2023-10-14T12:34:41.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.154+0000 7f43f16e9700 1 -- 172.21.15.72:0/1584370251 wait complete. 2023-10-14T12:34:41.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.155+0000 7f43f16e9700 1 Processor -- start 2023-10-14T12:34:41.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.155+0000 7f43f16e9700 1 -- start start 2023-10-14T12:34:41.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43f16e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0cf560 0x7f43ec06c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43f16e9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43ec0d0d40 0x7f43ec0ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43f16e9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ec0aefd0 0x7f43ec0af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43f16e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0c7a30 con 0x7f43ec0cf560 2023-10-14T12:34:41.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43f16e9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec06cb10 con 0x7f43ec0aefd0 2023-10-14T12:34:41.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43f16e9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec06cdf0 con 0x7f43ec0d0d40 2023-10-14T12:34:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0cf560 0x7f43ec06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0cf560 0x7f43ec06c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48526/0 (socket says 172.21.15.72:48526) 2023-10-14T12:34:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43eaffd700 1 -- 172.21.15.72:0/3637501026 learned_addr learned my addr 172.21.15.72:0/3637501026 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:41.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43eb7fe700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ec0aefd0 0x7f43ec0af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43ea7fc700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43ec0d0d40 0x7f43ec0ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43eaffd700 1 -- 172.21.15.72:0/3637501026 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43ec0d0d40 msgr2=0x7f43ec0ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43eaffd700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43ec0d0d40 0x7f43ec0ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43eaffd700 1 -- 172.21.15.72:0/3637501026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ec0aefd0 msgr2=0x7f43ec0af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43eaffd700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ec0aefd0 0x7f43ec0af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43eaffd700 1 -- 172.21.15.72:0/3637501026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0094a0 con 0x7f43ec0cf560 2023-10-14T12:34:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.156+0000 7f43ea7fc700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43ec0d0d40 0x7f43ec0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.157+0000 7f43eaffd700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0cf560 0x7f43ec06c520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0090b0 tx=0x7f43dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.157+0000 7f43d37fe700 1 -- 172.21.15.72:0/3637501026 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc01a850 con 0x7f43ec0cf560 2023-10-14T12:34:41.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.157+0000 7f43d37fe700 1 -- 172.21.15.72:0/3637501026 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc01a9b0 con 0x7f43ec0cf560 2023-10-14T12:34:41.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.157+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec06d0d0 con 0x7f43ec0cf560 2023-10-14T12:34:41.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.157+0000 7f43d37fe700 1 -- 172.21.15.72:0/3637501026 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc01ad20 con 0x7f43ec0cf560 2023-10-14T12:34:41.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.157+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec0b4f90 con 0x7f43ec0cf560 2023-10-14T12:34:41.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.158+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec04ebb0 con 0x7f43ec0cf560 2023-10-14T12:34:41.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.158+0000 7f43d37fe700 1 -- 172.21.15.72:0/3637501026 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f43dc022070 con 0x7f43ec0cf560 2023-10-14T12:34:41.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.159+0000 7f43d37fe700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f43d806af00 0x7f43d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.159+0000 7f43d37fe700 1 -- 172.21.15.72:0/3637501026 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f43dc08a730 con 0x7f43ec0cf560 2023-10-14T12:34:41.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.159+0000 7f43ea7fc700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f43d806af00 0x7f43d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.159+0000 7f43ea7fc700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f43d806af00 0x7f43d806d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0aed60 tx=0x7f43e0007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:41.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.163+0000 7f43d37fe700 1 -- 172.21.15.72:0/3637501026 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43dc055ba0 con 0x7f43ec0cf560 2023-10-14T12:34:41.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.351+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f43ec0b16b0 con 0x7f43ec0cf560 2023-10-14T12:34:41.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.352+0000 7f43d37fe700 1 -- 172.21.15.72:0/3637501026 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f43dc029020 con 0x7f43ec0cf560 2023-10-14T12:34:41.353 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-10-14T12:34:41.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f43d806af00 msgr2=0x7f43d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f43d806af00 0x7f43d806d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0aed60 tx=0x7f43e0007e50 comp rx=0 tx=0).stop 2023-10-14T12:34:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0cf560 msgr2=0x7f43ec06c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0cf560 0x7f43ec06c520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0090b0 tx=0x7f43dc004750 comp rx=0 tx=0).stop 2023-10-14T12:34:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 shutdown_connections 2023-10-14T12:34:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f43d806af00 0x7f43d806d3c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43ec0aefd0 0x7f43ec0af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ec0cf560 0x7f43ec06c520 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 --2- 172.21.15.72:0/3637501026 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43ec0d0d40 0x7f43ec0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 >> 172.21.15.72:0/3637501026 conn(0x7f43ec06a820 msgr2=0x7f43ec0b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 shutdown_connections 2023-10-14T12:34:41.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.354+0000 7f43f16e9700 1 -- 172.21.15.72:0/3637501026 wait complete. 2023-10-14T12:34:41.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T12:34:41.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.486+0000 7fdce766f700 1 Processor -- start 2023-10-14T12:34:41.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.486+0000 7fdce766f700 1 -- start start 2023-10-14T12:34:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce766f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce015d810 0x7fdce00af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce766f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdce015dbf0 0x7fdce00ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce766f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce00cfc30 con 0x7fdce00af030 2023-10-14T12:34:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce766f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce00cf990 con 0x7fdce015d810 2023-10-14T12:34:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce766f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce00cff10 con 0x7fdce015dbf0 2023-10-14T12:34:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce540b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdce015d810 0x7fdce00af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce5c0c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdce00af030 0x7fdce0161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54838/0 (socket says 172.21.15.72:54838) 2023-10-14T12:34:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce5c0c700 1 -- 172.21.15.72:0/875883257 learned_addr learned my addr 172.21.15.72:0/875883257 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:41.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce4c0a700 1 --2- 172.21.15.72:0/875883257 >> v2:172.21.15.123:3300/0 conn(0x7fdce015dbf0 0x7fdce00ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce540b700 1 -- 172.21.15.72:0/875883257 >> v2:172.21.15.123:3300/0 conn(0x7fdce015dbf0 msgr2=0x7fdce00ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:41.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce540b700 1 --2- 172.21.15.72:0/875883257 >> v2:172.21.15.123:3300/0 conn(0x7fdce015dbf0 0x7fdce00ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce540b700 1 -- 172.21.15.72:0/875883257 >> v1:172.21.15.72:6789/0 conn(0x7fdce00af030 legacy=0x7fdce0161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce540b700 1 -- 172.21.15.72:0/875883257 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce0072290 con 0x7fdce015d810 2023-10-14T12:34:41.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdcd7fff700 1 -- 172.21.15.72:0/875883257 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884312700 0 0) 0x7fdce00cfc30 con 0x7fdce00af030 2023-10-14T12:34:41.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdce540b700 1 --2- 172.21.15.72:0/875883257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 0x7fdce00af580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdce006f750 tx=0x7fdcdc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af14d4e7c4fb03d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:41.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.487+0000 7fdcd7fff700 1 -- 172.21.15.72:0/875883257 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc011830 con 0x7fdce015d810 2023-10-14T12:34:41.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdcd7fff700 1 -- 172.21.15.72:0/875883257 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc011990 con 0x7fdce015d810 2023-10-14T12:34:41.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdcd7fff700 1 -- 172.21.15.72:0/875883257 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc011d20 con 0x7fdce015d810 2023-10-14T12:34:41.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdce766f700 1 -- 172.21.15.72:0/875883257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 msgr2=0x7fdce00af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdce766f700 1 --2- 172.21.15.72:0/875883257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 0x7fdce00af580 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdce006f750 tx=0x7fdcdc009b20 comp rx=0 tx=0).stop 2023-10-14T12:34:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdce766f700 1 -- 172.21.15.72:0/875883257 shutdown_connections 2023-10-14T12:34:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdce766f700 1 --2- 172.21.15.72:0/875883257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 0x7fdce00af580 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdce766f700 1 --2- 172.21.15.72:0/875883257 >> v2:172.21.15.123:3300/0 conn(0x7fdce015dbf0 0x7fdce00ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdce766f700 1 -- 172.21.15.72:0/875883257 >> 172.21.15.72:0/875883257 conn(0x7fdce00d0180 msgr2=0x7fdce00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdce766f700 1 -- 172.21.15.72:0/875883257 shutdown_connections 2023-10-14T12:34:41.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.488+0000 7fdce766f700 1 -- 172.21.15.72:0/875883257 wait complete. 2023-10-14T12:34:41.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.489+0000 7fdce766f700 1 Processor -- start 2023-10-14T12:34:41.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.489+0000 7fdce766f700 1 -- start start 2023-10-14T12:34:41.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce766f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce00af030 0x7fdce01f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce766f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 0x7fdce00b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce766f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce015dbf0 0x7fdce00b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce766f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01f6e80 con 0x7fdce015d810 2023-10-14T12:34:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce766f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01f2d50 con 0x7fdce00af030 2023-10-14T12:34:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce766f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01f3030 con 0x7fdce015dbf0 2023-10-14T12:34:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce4c0a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 0x7fdce00b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce4c0a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 0x7fdce00b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48542/0 (socket says 172.21.15.72:48542) 2023-10-14T12:34:41.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce4c0a700 1 -- 172.21.15.72:0/117396223 learned_addr learned my addr 172.21.15.72:0/117396223 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce540b700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce00af030 0x7fdce01f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce5c0c700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce015dbf0 0x7fdce00b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce4c0a700 1 -- 172.21.15.72:0/117396223 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce015dbf0 msgr2=0x7fdce00b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce4c0a700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce015dbf0 0x7fdce00b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce4c0a700 1 -- 172.21.15.72:0/117396223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce00af030 msgr2=0x7fdce01f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce4c0a700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce00af030 0x7fdce01f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce4c0a700 1 -- 172.21.15.72:0/117396223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0094a0 con 0x7fdce015d810 2023-10-14T12:34:41.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.490+0000 7fdce540b700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce00af030 0x7fdce01f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:41.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.491+0000 7fdce4c0a700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 0x7fdce00b0560 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000e980 tx=0x7fdcd000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:41.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.491+0000 7fdcd5ffb700 1 -- 172.21.15.72:0/117396223 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0009710 con 0x7fdce015d810 2023-10-14T12:34:41.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.491+0000 7fdcd5ffb700 1 -- 172.21.15.72:0/117396223 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000c850 con 0x7fdce015d810 2023-10-14T12:34:41.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.491+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce01f3310 con 0x7fdce015d810 2023-10-14T12:34:41.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.491+0000 7fdcd5ffb700 1 -- 172.21.15.72:0/117396223 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000cc00 con 0x7fdce015d810 2023-10-14T12:34:41.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.491+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce01f2b00 con 0x7fdce015d810 2023-10-14T12:34:41.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.492+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce01f2e90 con 0x7fdce015d810 2023-10-14T12:34:41.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.492+0000 7fdcd5ffb700 1 -- 172.21.15.72:0/117396223 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdcd0013470 con 0x7fdce015d810 2023-10-14T12:34:41.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.493+0000 7fdcd5ffb700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdcc406af00 0x7fdcc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.493+0000 7fdcd5ffb700 1 -- 172.21.15.72:0/117396223 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdcd00894b0 con 0x7fdce015d810 2023-10-14T12:34:41.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.493+0000 7fdce540b700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdcc406af00 0x7fdcc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.493+0000 7fdce540b700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdcc406af00 0x7fdcc406d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0090b0 tx=0x7fdcdc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:41.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.497+0000 7fdcd5ffb700 1 -- 172.21.15.72:0/117396223 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdce01f2e90 con 0x7fdce015d810 2023-10-14T12:34:41.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.688+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdce01f2e90 con 0x7fdce015d810 2023-10-14T12:34:41.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.688+0000 7fdcd5ffb700 1 -- 172.21.15.72:0/117396223 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdce01f2e90 con 0x7fdce015d810 2023-10-14T12:34:41.690 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:41.690 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-10-14T12:34:41.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-10-14T12:34:41.691 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-10-14T12:34:41.691 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-10-14T12:34:41.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-14T12:34:41.692 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-10-14T12:34:41.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdcc406af00 msgr2=0x7fdcc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdcc406af00 0x7fdcc406d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0090b0 tx=0x7fdcdc008030 comp rx=0 tx=0).stop 2023-10-14T12:34:41.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 msgr2=0x7fdce00b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 0x7fdce00b0560 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000e980 tx=0x7fdcd000ed40 comp rx=0 tx=0).stop 2023-10-14T12:34:41.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 shutdown_connections 2023-10-14T12:34:41.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fdcc406af00 0x7fdcc406d3c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fdce015dbf0 0x7fdce00b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce00af030 0x7fdce01f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 --2- 172.21.15.72:0/117396223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdce015d810 0x7fdce00b0560 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 >> 172.21.15.72:0/117396223 conn(0x7fdce00d0180 msgr2=0x7fdce00ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:41.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 shutdown_connections 2023-10-14T12:34:41.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.690+0000 7fdce766f700 1 -- 172.21.15.72:0/117396223 wait complete. 2023-10-14T12:34:41.703 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-14T12:34:41.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-14T12:34:41.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.827+0000 7f0ba79b7700 1 Processor -- start 2023-10-14T12:34:41.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.827+0000 7f0ba79b7700 1 -- start start 2023-10-14T12:34:41.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.828+0000 7f0ba79b7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ba00b33f0 0x7f0ba006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.828+0000 7f0ba79b7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 0x7f0ba00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.828+0000 7f0ba79b7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba0070620 con 0x7f0ba015b4e0 2023-10-14T12:34:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.828+0000 7f0ba79b7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba0070900 con 0x7f0ba00b33f0 2023-10-14T12:34:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.828+0000 7f0ba79b7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba0070be0 con 0x7f0ba00cd770 2023-10-14T12:34:41.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.828+0000 7f0ba5753700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0ba015b4e0 0x7f0ba00b2ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54848/0 (socket says 172.21.15.72:54848) 2023-10-14T12:34:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.828+0000 7f0ba5753700 1 -- 172.21.15.72:0/881507572 learned_addr learned my addr 172.21.15.72:0/881507572 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.828+0000 7f0ba4f52700 1 --2- 172.21.15.72:0/881507572 >> v2:172.21.15.123:3300/0 conn(0x7f0ba00b33f0 0x7f0ba006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.828+0000 7f0ba5f54700 1 --2- 172.21.15.72:0/881507572 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 0x7f0ba00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0b97fff700 1 -- 172.21.15.72:0/881507572 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800684042 0 0) 0x7f0ba0070620 con 0x7f0ba015b4e0 2023-10-14T12:34:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0b97fff700 1 -- 172.21.15.72:0/881507572 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b8c0035b0 con 0x7f0ba015b4e0 2023-10-14T12:34:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0ba4f52700 1 -- 172.21.15.72:0/881507572 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 msgr2=0x7f0ba00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0b97fff700 1 -- 172.21.15.72:0/881507572 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 383318245 0 0) 0x7f0b8c0035b0 con 0x7f0ba015b4e0 2023-10-14T12:34:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0ba4f52700 1 --2- 172.21.15.72:0/881507572 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 0x7f0ba00b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0ba4f52700 1 -- 172.21.15.72:0/881507572 >> v1:172.21.15.72:6789/0 conn(0x7f0ba015b4e0 legacy=0x7f0ba00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0ba4f52700 1 -- 172.21.15.72:0/881507572 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba0070ec0 con 0x7f0ba00b33f0 2023-10-14T12:34:41.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0ba5f54700 1 --2- 172.21.15.72:0/881507572 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 0x7f0ba00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:41.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0ba4f52700 1 --2- 172.21.15.72:0/881507572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ba00b33f0 0x7f0ba006f280 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009870 tx=0x7f0b9c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=267c89da5a8b11ca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:41.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0b97fff700 1 -- 172.21.15.72:0/881507572 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90001670 con 0x7f0ba00b33f0 2023-10-14T12:34:41.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0b97fff700 1 -- 172.21.15.72:0/881507572 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c004030 con 0x7f0ba00b33f0 2023-10-14T12:34:41.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.829+0000 7f0b97fff700 1 -- 172.21.15.72:0/881507572 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0043a0 con 0x7f0ba00b33f0 2023-10-14T12:34:41.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.830+0000 7f0ba79b7700 1 -- 172.21.15.72:0/881507572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ba00b33f0 msgr2=0x7f0ba006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.830+0000 7f0ba79b7700 1 --2- 172.21.15.72:0/881507572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ba00b33f0 0x7f0ba006f280 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009870 tx=0x7f0b9c009b80 comp rx=0 tx=0).stop 2023-10-14T12:34:41.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.830+0000 7f0ba79b7700 1 -- 172.21.15.72:0/881507572 shutdown_connections 2023-10-14T12:34:41.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.830+0000 7f0ba79b7700 1 --2- 172.21.15.72:0/881507572 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 0x7f0ba00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.830+0000 7f0ba79b7700 1 --2- 172.21.15.72:0/881507572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ba00b33f0 0x7f0ba006f280 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.830+0000 7f0ba79b7700 1 -- 172.21.15.72:0/881507572 >> 172.21.15.72:0/881507572 conn(0x7f0ba00cdce0 msgr2=0x7f0ba00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:41.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.830+0000 7f0ba79b7700 1 -- 172.21.15.72:0/881507572 shutdown_connections 2023-10-14T12:34:41.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.830+0000 7f0ba79b7700 1 -- 172.21.15.72:0/881507572 wait complete. 2023-10-14T12:34:41.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.831+0000 7f0ba79b7700 1 Processor -- start 2023-10-14T12:34:41.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.831+0000 7f0ba79b7700 1 -- start start 2023-10-14T12:34:41.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba79b7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ba00b33f0 0x7f0ba01f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba79b7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 0x7f0ba00c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba79b7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba015b4e0 0x7f0ba00c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba79b7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba00a87e0 con 0x7f0ba015b4e0 2023-10-14T12:34:41.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba79b7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba01f6bf0 con 0x7f0ba00b33f0 2023-10-14T12:34:41.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba79b7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba01e5f80 con 0x7f0ba00cd770 2023-10-14T12:34:41.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5f54700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba015b4e0 0x7f0ba00c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5f54700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba015b4e0 0x7f0ba00c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48558/0 (socket says 172.21.15.72:48558) 2023-10-14T12:34:41.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5f54700 1 -- 172.21.15.72:0/2963413502 learned_addr learned my addr 172.21.15.72:0/2963413502 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:41.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5753700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ba00b33f0 0x7f0ba01f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba4f52700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 0x7f0ba00c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5f54700 1 -- 172.21.15.72:0/2963413502 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 msgr2=0x7f0ba00c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5f54700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 0x7f0ba00c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5f54700 1 -- 172.21.15.72:0/2963413502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ba00b33f0 msgr2=0x7f0ba01f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:41.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5f54700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ba00b33f0 0x7f0ba01f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:41.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5f54700 1 -- 172.21.15.72:0/2963413502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b98009a70 con 0x7f0ba015b4e0 2023-10-14T12:34:41.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba5f54700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba015b4e0 0x7f0ba00c34e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800ef90 tx=0x7f0b9800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:41.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0b95ffb700 1 -- 172.21.15.72:0/2963413502 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800cc90 con 0x7f0ba015b4e0 2023-10-14T12:34:41.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0b95ffb700 1 -- 172.21.15.72:0/2963413502 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9800f040 con 0x7f0ba015b4e0 2023-10-14T12:34:41.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0b95ffb700 1 -- 172.21.15.72:0/2963413502 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b980146c0 con 0x7f0ba015b4e0 2023-10-14T12:34:41.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.832+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c0094a0 con 0x7f0ba015b4e0 2023-10-14T12:34:41.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.833+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba01e6540 con 0x7f0ba015b4e0 2023-10-14T12:34:41.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.833+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba004ebb0 con 0x7f0ba015b4e0 2023-10-14T12:34:41.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.834+0000 7f0b95ffb700 1 -- 172.21.15.72:0/2963413502 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b98014820 con 0x7f0ba015b4e0 2023-10-14T12:34:41.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.834+0000 7f0b95ffb700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b8406af00 0x7f0b8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:41.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.834+0000 7f0b95ffb700 1 -- 172.21.15.72:0/2963413502 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0b9808a090 con 0x7f0ba015b4e0 2023-10-14T12:34:41.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.834+0000 7f0ba5753700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b8406af00 0x7f0b8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:41.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.835+0000 7f0ba5753700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b8406af00 0x7f0b8406d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00c82e0 tx=0x7f0b90001da0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:41.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:41.839+0000 7f0b95ffb700 1 -- 172.21.15.72:0/2963413502 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b980552d0 con 0x7f0ba015b4e0 2023-10-14T12:34:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.029+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0ba00d0bf0 con 0x7f0ba015b4e0 2023-10-14T12:34:42.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.715+0000 7f0b95ffb700 1 -- 172.21.15.72:0/2963413502 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v35) v1 ==== 148+0+0 (secure 0 0 0) 0x7f0b98009d70 con 0x7f0ba015b4e0 2023-10-14T12:34:42.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b8406af00 msgr2=0x7f0b8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:42.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b8406af00 0x7f0b8406d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00c82e0 tx=0x7f0b90001da0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba015b4e0 msgr2=0x7f0ba00c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:42.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba015b4e0 0x7f0ba00c34e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800ef90 tx=0x7f0b9800c3a0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 shutdown_connections 2023-10-14T12:34:42.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f0b8406af00 0x7f0b8406d3c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ba015b4e0 0x7f0ba00c34e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ba00b33f0 0x7f0ba01f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 --2- 172.21.15.72:0/2963413502 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0ba00cd770 0x7f0ba00c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 >> 172.21.15.72:0/2963413502 conn(0x7f0ba00cdce0 msgr2=0x7f0ba0159370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:42.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 shutdown_connections 2023-10-14T12:34:42.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.718+0000 7f0ba79b7700 1 -- 172.21.15.72:0/2963413502 wait complete. 2023-10-14T12:34:42.722 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'testcephfs1_metadata' created 2023-10-14T12:34:42.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T12:34:42.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.871+0000 7f87c926f700 1 Processor -- start 2023-10-14T12:34:42.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.871+0000 7f87c926f700 1 -- start start 2023-10-14T12:34:42.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.871+0000 7f87c926f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 0x7f87c40ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:42.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.871+0000 7f87c926f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87c40cfa50 0x7f87c40d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:42.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.871+0000 7f87c926f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c40ce630 con 0x7f87c40ceec0 2023-10-14T12:34:42.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.871+0000 7f87c926f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c40d0710 con 0x7f87c40cfa50 2023-10-14T12:34:42.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.871+0000 7f87c926f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40cb940 con 0x7f87c415b3e0 2023-10-14T12:34:42.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87c40cfa50 0x7f87c40d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:42.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c27fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f87c40ceec0 0x7f87c40cf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54864/0 (socket says 172.21.15.72:54864) 2023-10-14T12:34:42.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c27fc700 1 -- 172.21.15.72:0/896419283 learned_addr learned my addr 172.21.15.72:0/896419283 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:42.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c2ffd700 1 --2- 172.21.15.72:0/896419283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 0x7f87c40ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:42.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c37fe700 1 -- 172.21.15.72:0/896419283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 msgr2=0x7f87c40ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:42.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c37fe700 1 --2- 172.21.15.72:0/896419283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 0x7f87c40ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c37fe700 1 -- 172.21.15.72:0/896419283 >> v1:172.21.15.72:6789/0 conn(0x7f87c40ceec0 legacy=0x7f87c40cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:42.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c37fe700 1 -- 172.21.15.72:0/896419283 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c415b7c0 con 0x7f87c40cfa50 2023-10-14T12:34:42.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c1ffb700 1 -- 172.21.15.72:0/896419283 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770626505 0 0) 0x7f87c40ce630 con 0x7f87c40ceec0 2023-10-14T12:34:42.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c37fe700 1 --2- 172.21.15.72:0/896419283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 0x7f87c40d11a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009840 tx=0x7f87b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8689ca74667078b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:42.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c1ffb700 1 -- 172.21.15.72:0/896419283 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4011830 con 0x7f87c40cfa50 2023-10-14T12:34:42.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c1ffb700 1 -- 172.21.15.72:0/896419283 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b4011990 con 0x7f87c40cfa50 2023-10-14T12:34:42.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.872+0000 7f87c1ffb700 1 -- 172.21.15.72:0/896419283 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4011d20 con 0x7f87c40cfa50 2023-10-14T12:34:42.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.873+0000 7f87c926f700 1 -- 172.21.15.72:0/896419283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 msgr2=0x7f87c40d11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.873+0000 7f87c926f700 1 --2- 172.21.15.72:0/896419283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 0x7f87c40d11a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009840 tx=0x7f87b4009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.873+0000 7f87c926f700 1 -- 172.21.15.72:0/896419283 shutdown_connections 2023-10-14T12:34:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.873+0000 7f87c926f700 1 --2- 172.21.15.72:0/896419283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 0x7f87c40d11a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.873+0000 7f87c926f700 1 --2- 172.21.15.72:0/896419283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 0x7f87c40ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.873+0000 7f87c926f700 1 -- 172.21.15.72:0/896419283 >> 172.21.15.72:0/896419283 conn(0x7f87c406a820 msgr2=0x7f87c406ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.873+0000 7f87c926f700 1 -- 172.21.15.72:0/896419283 shutdown_connections 2023-10-14T12:34:42.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.873+0000 7f87c926f700 1 -- 172.21.15.72:0/896419283 wait complete. 2023-10-14T12:34:42.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.874+0000 7f87c926f700 1 Processor -- start 2023-10-14T12:34:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.874+0000 7f87c926f700 1 -- start start 2023-10-14T12:34:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c926f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87c40ceec0 0x7f87c40c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c926f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 0x7f87c40c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c926f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 0x7f87c4156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:42.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c926f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41565c0 con 0x7f87c40cfa50 2023-10-14T12:34:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c926f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40c9830 con 0x7f87c40ceec0 2023-10-14T12:34:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c926f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40c89a0 con 0x7f87c415b3e0 2023-10-14T12:34:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 0x7f87c40c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 0x7f87c40c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48570/0 (socket says 172.21.15.72:48570) 2023-10-14T12:34:42.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c27fc700 1 -- 172.21.15.72:0/853518139 learned_addr learned my addr 172.21.15.72:0/853518139 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c2ffd700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87c40ceec0 0x7f87c40c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c37fe700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 0x7f87c4156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c27fc700 1 -- 172.21.15.72:0/853518139 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 msgr2=0x7f87c4156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c27fc700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 0x7f87c4156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c27fc700 1 -- 172.21.15.72:0/853518139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87c40ceec0 msgr2=0x7f87c40c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:42.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c27fc700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87c40ceec0 0x7f87c40c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:42.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c27fc700 1 -- 172.21.15.72:0/853518139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b40094a0 con 0x7f87c40cfa50 2023-10-14T12:34:42.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c27fc700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 0x7f87c40c7d40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f87b80011e0 tx=0x7f87b800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:42.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87ab7fe700 1 -- 172.21.15.72:0/853518139 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8004c80 con 0x7f87c40cfa50 2023-10-14T12:34:42.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87ab7fe700 1 -- 172.21.15.72:0/853518139 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b8004e00 con 0x7f87c40cfa50 2023-10-14T12:34:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.875+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c40c8c80 con 0x7f87c40cfa50 2023-10-14T12:34:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.876+0000 7f87ab7fe700 1 -- 172.21.15.72:0/853518139 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8007310 con 0x7f87c40cfa50 2023-10-14T12:34:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.876+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c40c9240 con 0x7f87c40cfa50 2023-10-14T12:34:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.877+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c40c9430 con 0x7f87c40cfa50 2023-10-14T12:34:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.877+0000 7f87ab7fe700 1 -- 172.21.15.72:0/853518139 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f87b8007470 con 0x7f87c40cfa50 2023-10-14T12:34:42.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.877+0000 7f87ab7fe700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f87b006af00 0x7f87b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.878+0000 7f87ab7fe700 1 -- 172.21.15.72:0/853518139 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5552+0+0 (secure 0 0 0) 0x7f87b8089160 con 0x7f87c40cfa50 2023-10-14T12:34:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.878+0000 7f87c2ffd700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f87b006af00 0x7f87b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.878+0000 7f87c2ffd700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f87b006af00 0x7f87b006d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00f360 tx=0x7f87bc007710 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:42.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:42.882+0000 7f87ab7fe700 1 -- 172.21.15.72:0/853518139 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f87b80542b0 con 0x7f87c40cfa50 2023-10-14T12:34:43.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.071+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f87c404ebb0 con 0x7f87c40cfa50 2023-10-14T12:34:43.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.717+0000 7f87ab7fe700 1 -- 172.21.15.72:0/853518139 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v36) v1 ==== 180+0+0 (secure 0 0 0) 0x7f87b80578d0 con 0x7f87c40cfa50 2023-10-14T12:34:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.719+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f87b006af00 msgr2=0x7f87b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.719+0000 7f87c926f700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f87b006af00 0x7f87b006d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00f360 tx=0x7f87bc007710 comp rx=0 tx=0).stop 2023-10-14T12:34:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 msgr2=0x7f87c40c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:43.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 0x7f87c40c7d40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f87b80011e0 tx=0x7f87b800ca30 comp rx=0 tx=0).stop 2023-10-14T12:34:43.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 shutdown_connections 2023-10-14T12:34:43.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f87b006af00 0x7f87b006d3c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:43.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f87c415b3e0 0x7f87c4156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:43.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87c40ceec0 0x7f87c40c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:43.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 --2- 172.21.15.72:0/853518139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c40cfa50 0x7f87c40c7d40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:43.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 >> 172.21.15.72:0/853518139 conn(0x7f87c406a820 msgr2=0x7f87c4159350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:43.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 shutdown_connections 2023-10-14T12:34:43.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.720+0000 7f87c926f700 1 -- 172.21.15.72:0/853518139 wait complete. 2023-10-14T12:34:43.726 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'testcephfs1_data' created 2023-10-14T12:34:43.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-14T12:34:43.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.871+0000 7fd241c16700 1 Processor -- start 2023-10-14T12:34:43.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.871+0000 7fd241c16700 1 -- start start 2023-10-14T12:34:43.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.871+0000 7fd241c16700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c0b33f0 0x7fd23c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:43.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.871+0000 7fd241c16700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd23c0cd770 0x7fd23c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:43.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.871+0000 7fd241c16700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c070620 con 0x7fd23c15b4e0 2023-10-14T12:34:43.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.871+0000 7fd241c16700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c070900 con 0x7fd23c0cd770 2023-10-14T12:34:43.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.871+0000 7fd241c16700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c070be0 con 0x7fd23c0b33f0 2023-10-14T12:34:43.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd23c0cd770 0x7fd23c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:43.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd23c0cd770 0x7fd23c0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48580/0 (socket says 172.21.15.72:48580) 2023-10-14T12:34:43.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23bfff700 1 -- 172.21.15.72:0/1593307542 learned_addr learned my addr 172.21.15.72:0/1593307542 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:43.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23affd700 1 --2- 172.21.15.72:0/1593307542 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c0b33f0 0x7fd23c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:43.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23bfff700 1 -- 172.21.15.72:0/1593307542 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c0b33f0 msgr2=0x7fd23c06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:43.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23bfff700 1 --2- 172.21.15.72:0/1593307542 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c0b33f0 0x7fd23c06f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:43.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23bfff700 1 -- 172.21.15.72:0/1593307542 >> v1:172.21.15.123:6789/0 conn(0x7fd23c15b4e0 legacy=0x7fd23c0b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:43.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23bfff700 1 -- 172.21.15.72:0/1593307542 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c070ec0 con 0x7fd23c0cd770 2023-10-14T12:34:43.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23affd700 1 --2- 172.21.15.72:0/1593307542 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c0b33f0 0x7fd23c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:43.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23bfff700 1 --2- 172.21.15.72:0/1593307542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 0x7fd23c0b4450 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd234009e50 tx=0x7fd23400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55b54b688c39da7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:43.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23a7fc700 1 -- 172.21.15.72:0/1593307542 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400e070 con 0x7fd23c0cd770 2023-10-14T12:34:43.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23a7fc700 1 -- 172.21.15.72:0/1593307542 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400b9c0 con 0x7fd23c0cd770 2023-10-14T12:34:43.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.872+0000 7fd23a7fc700 1 -- 172.21.15.72:0/1593307542 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400bd70 con 0x7fd23c0cd770 2023-10-14T12:34:43.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.873+0000 7fd241c16700 1 -- 172.21.15.72:0/1593307542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 msgr2=0x7fd23c0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:43.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.873+0000 7fd241c16700 1 --2- 172.21.15.72:0/1593307542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 0x7fd23c0b4450 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd234009e50 tx=0x7fd23400b330 comp rx=0 tx=0).stop 2023-10-14T12:34:43.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.873+0000 7fd241c16700 1 -- 172.21.15.72:0/1593307542 shutdown_connections 2023-10-14T12:34:43.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.873+0000 7fd241c16700 1 --2- 172.21.15.72:0/1593307542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 0x7fd23c0b4450 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:43.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.873+0000 7fd241c16700 1 --2- 172.21.15.72:0/1593307542 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c0b33f0 0x7fd23c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:43.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.873+0000 7fd241c16700 1 -- 172.21.15.72:0/1593307542 >> 172.21.15.72:0/1593307542 conn(0x7fd23c0cdce0 msgr2=0x7fd23c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:43.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.873+0000 7fd241c16700 1 -- 172.21.15.72:0/1593307542 shutdown_connections 2023-10-14T12:34:43.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.873+0000 7fd241c16700 1 -- 172.21.15.72:0/1593307542 wait complete. 2023-10-14T12:34:43.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.874+0000 7fd241c16700 1 Processor -- start 2023-10-14T12:34:43.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.875+0000 7fd241c16700 1 -- start start 2023-10-14T12:34:43.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.875+0000 7fd241c16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0b33f0 0x7fd23c1f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:43.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.875+0000 7fd241c16700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 0x7fd23c0cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:43.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.875+0000 7fd241c16700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c15b4e0 0x7fd23c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:43.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.875+0000 7fd241c16700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0c9e30 con 0x7fd23c0cd770 2023-10-14T12:34:43.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.875+0000 7fd241c16700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1f19f0 con 0x7fd23c0b33f0 2023-10-14T12:34:43.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.875+0000 7fd241c16700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0c9220 con 0x7fd23c15b4e0 2023-10-14T12:34:43.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 0x7fd23c0cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:43.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 0x7fd23c0cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48584/0 (socket says 172.21.15.72:48584) 2023-10-14T12:34:43.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23affd700 1 -- 172.21.15.72:0/1371971840 learned_addr learned my addr 172.21.15.72:0/1371971840 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:43.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23affd700 1 -- 172.21.15.72:0/1371971840 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c15b4e0 msgr2=0x7fd23c0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:43.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23affd700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c15b4e0 0x7fd23c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:43.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23b7fe700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0b33f0 0x7fd23c1f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:43.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23affd700 1 -- 172.21.15.72:0/1371971840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0b33f0 msgr2=0x7fd23c1f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:43.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23affd700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0b33f0 0x7fd23c1f14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:43.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23affd700 1 -- 172.21.15.72:0/1371971840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234009b30 con 0x7fd23c0cd770 2023-10-14T12:34:43.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd23affd700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 0x7fd23c0cab70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd22400c750 tx=0x7fd22400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:43.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd233fff700 1 -- 172.21.15.72:0/1371971840 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224011800 con 0x7fd23c0cd770 2023-10-14T12:34:43.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd233fff700 1 -- 172.21.15.72:0/1371971840 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd224011960 con 0x7fd23c0cd770 2023-10-14T12:34:43.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c0c9500 con 0x7fd23c0cd770 2023-10-14T12:34:43.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd233fff700 1 -- 172.21.15.72:0/1371971840 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224011cd0 con 0x7fd23c0cd770 2023-10-14T12:34:43.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.876+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c0c9ac0 con 0x7fd23c0cd770 2023-10-14T12:34:43.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.877+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c0c9fe0 con 0x7fd23c0cd770 2023-10-14T12:34:43.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.878+0000 7fd233fff700 1 -- 172.21.15.72:0/1371971840 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd224021350 con 0x7fd23c0cd770 2023-10-14T12:34:43.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.878+0000 7fd233fff700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd21c06aed0 0x7fd21c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:43.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.878+0000 7fd233fff700 1 -- 172.21.15.72:0/1371971840 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fd2240896b0 con 0x7fd23c0cd770 2023-10-14T12:34:43.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.878+0000 7fd23b7fe700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd21c06aed0 0x7fd21c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:43.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.879+0000 7fd23b7fe700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd21c06aed0 0x7fd21c06d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000f60 tx=0x7fd22c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:43.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:43.883+0000 7fd233fff700 1 -- 172.21.15.72:0/1371971840 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd23c0c9fe0 con 0x7fd23c0cd770 2023-10-14T12:34:44.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.114+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7fd23c04ebb0 con 0x7fd23c0cd770 2023-10-14T12:34:44.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.745+0000 7fd233fff700 1 -- 172.21.15.72:0/1371971840 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 187+0+0 (secure 0 0 0) 0x7fd224058060 con 0x7fd23c0cd770 2023-10-14T12:34:44.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.748+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd21c06aed0 msgr2=0x7fd21c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:44.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.748+0000 7fd241c16700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd21c06aed0 0x7fd21c06d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd22c000f60 tx=0x7fd22c009040 comp rx=0 tx=0).stop 2023-10-14T12:34:44.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.748+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 msgr2=0x7fd23c0cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:44.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.748+0000 7fd241c16700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 0x7fd23c0cab70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd22400c750 tx=0x7fd22400cb10 comp rx=0 tx=0).stop 2023-10-14T12:34:44.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.749+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 shutdown_connections 2023-10-14T12:34:44.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.749+0000 7fd241c16700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd21c06aed0 0x7fd21c06d390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:44.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.749+0000 7fd241c16700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd23c15b4e0 0x7fd23c0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:44.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.749+0000 7fd241c16700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd23c0b33f0 0x7fd23c1f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:44.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.749+0000 7fd241c16700 1 --2- 172.21.15.72:0/1371971840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd23c0cd770 0x7fd23c0cab70 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:44.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.749+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 >> 172.21.15.72:0/1371971840 conn(0x7fd23c0cdce0 msgr2=0x7fd23c15ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:44.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.750+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 shutdown_connections 2023-10-14T12:34:44.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.750+0000 7fd241c16700 1 -- 172.21.15.72:0/1371971840 wait complete. 2023-10-14T12:34:44.774 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 5 and data pool 6 2023-10-14T12:34:44.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.908+0000 7faf76543700 1 Processor -- start 2023-10-14T12:34:44.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.908+0000 7faf76543700 1 -- start start 2023-10-14T12:34:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf76543700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 0x7faf70071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf76543700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf700cfeb0 con 0x7faf700cf7d0 2023-10-14T12:34:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf76543700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7015ec80 con 0x7faf7006a820 2023-10-14T12:34:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf76543700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf700ce410 con 0x7faf7015e7f0 2023-10-14T12:34:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf6f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faf700cf7d0 0x7faf700ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54908/0 (socket says 172.21.15.72:54908) 2023-10-14T12:34:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf6f7fe700 1 -- 172.21.15.72:0/1346562039 learned_addr learned my addr 172.21.15.72:0/1346562039 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:44.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf74ae0700 1 --2- 172.21.15.72:0/1346562039 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 0x7faf70071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf6effd700 1 -- 172.21.15.72:0/1346562039 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285351974 0 0) 0x7faf700cfeb0 con 0x7faf700cf7d0 2023-10-14T12:34:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf6effd700 1 -- 172.21.15.72:0/1346562039 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf580035b0 con 0x7faf700cf7d0 2023-10-14T12:34:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf6effd700 1 -- 172.21.15.72:0/1346562039 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877340286 0 0) 0x7faf7015ec80 con 0x7faf7006a820 2023-10-14T12:34:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf6effd700 1 -- 172.21.15.72:0/1346562039 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf700cfeb0 con 0x7faf7006a820 2023-10-14T12:34:44.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf74ae0700 1 -- 172.21.15.72:0/1346562039 >> v1:172.21.15.123:6789/0 conn(0x7faf7006a820 legacy=0x7faf7006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf74ae0700 1 -- 172.21.15.72:0/1346562039 >> v1:172.21.15.72:6789/0 conn(0x7faf700cf7d0 legacy=0x7faf700ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf74ae0700 1 -- 172.21.15.72:0/1346562039 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf700cfc30 con 0x7faf7015e7f0 2023-10-14T12:34:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.909+0000 7faf74ae0700 1 --2- 172.21.15.72:0/1346562039 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 0x7faf70071ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf68009dc0 tx=0x7faf6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c281f7d4bb7c851 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf6effd700 1 -- 172.21.15.72:0/1346562039 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6800e070 con 0x7faf7015e7f0 2023-10-14T12:34:44.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf6effd700 1 -- 172.21.15.72:0/1346562039 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6800bb20 con 0x7faf7015e7f0 2023-10-14T12:34:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf6effd700 1 -- 172.21.15.72:0/1346562039 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68012430 con 0x7faf7015e7f0 2023-10-14T12:34:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf76543700 1 -- 172.21.15.72:0/1346562039 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 msgr2=0x7faf70071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf76543700 1 --2- 172.21.15.72:0/1346562039 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 0x7faf70071ea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf68009dc0 tx=0x7faf6800b330 comp rx=0 tx=0).stop 2023-10-14T12:34:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf76543700 1 -- 172.21.15.72:0/1346562039 shutdown_connections 2023-10-14T12:34:44.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf76543700 1 --2- 172.21.15.72:0/1346562039 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 0x7faf70071ea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:44.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf76543700 1 -- 172.21.15.72:0/1346562039 >> 172.21.15.72:0/1346562039 conn(0x7faf700d0180 msgr2=0x7faf700d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:44.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf76543700 1 -- 172.21.15.72:0/1346562039 shutdown_connections 2023-10-14T12:34:44.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.910+0000 7faf76543700 1 -- 172.21.15.72:0/1346562039 wait complete. 2023-10-14T12:34:44.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.911+0000 7faf76543700 1 Processor -- start 2023-10-14T12:34:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf76543700 1 -- start start 2023-10-14T12:34:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf76543700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf7006a820 0x7faf700afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:44.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf76543700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf700cf7d0 0x7faf700b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf76543700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 0x7faf700b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf76543700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7014b9b0 con 0x7faf700cf7d0 2023-10-14T12:34:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf76543700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7014b3c0 con 0x7faf7006a820 2023-10-14T12:34:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf76543700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7014b130 con 0x7faf7015e7f0 2023-10-14T12:34:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf6f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf700cf7d0 0x7faf700b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf6f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf700cf7d0 0x7faf700b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48614/0 (socket says 172.21.15.72:48614) 2023-10-14T12:34:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf6f7fe700 1 -- 172.21.15.72:0/1719198038 learned_addr learned my addr 172.21.15.72:0/1719198038 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf74ae0700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 0x7faf700b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.912+0000 7faf6ffff700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf7006a820 0x7faf700afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf6f7fe700 1 -- 172.21.15.72:0/1719198038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 msgr2=0x7faf700b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf6f7fe700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 0x7faf700b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf6f7fe700 1 -- 172.21.15.72:0/1719198038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf7006a820 msgr2=0x7faf700afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf6f7fe700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf7006a820 0x7faf700afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf6f7fe700 1 -- 172.21.15.72:0/1719198038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf68009a70 con 0x7faf700cf7d0 2023-10-14T12:34:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf6f7fe700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf700cf7d0 0x7faf700b0120 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faf6400c700 tx=0x7faf6400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:44.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf6cff9700 1 -- 172.21.15.72:0/1719198038 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64005d70 con 0x7faf700cf7d0 2023-10-14T12:34:44.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf6cff9700 1 -- 172.21.15.72:0/1719198038 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf640070d0 con 0x7faf700cf7d0 2023-10-14T12:34:44.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf6cff9700 1 -- 172.21.15.72:0/1719198038 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64007460 con 0x7faf700cf7d0 2023-10-14T12:34:44.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf700b57c0 con 0x7faf700cf7d0 2023-10-14T12:34:44.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.913+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7014b5d0 con 0x7faf700cf7d0 2023-10-14T12:34:44.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.914+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7014baf0 con 0x7faf700cf7d0 2023-10-14T12:34:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.914+0000 7faf6cff9700 1 -- 172.21.15.72:0/1719198038 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf640075c0 con 0x7faf700cf7d0 2023-10-14T12:34:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.915+0000 7faf6cff9700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5c06af00 0x7faf5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.915+0000 7faf6cff9700 1 -- 172.21.15.72:0/1719198038 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6049+0+0 (secure 0 0 0) 0x7faf64088b80 con 0x7faf700cf7d0 2023-10-14T12:34:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.915+0000 7faf6ffff700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5c06af00 0x7faf5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:44.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.915+0000 7faf6ffff700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5c06af00 0x7faf5c06d3c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf600011e0 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:44.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:44.919+0000 7faf6cff9700 1 -- 172.21.15.72:0/1719198038 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf7014baf0 con 0x7faf700cf7d0 2023-10-14T12:34:45.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.110+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf7014baf0 con 0x7faf700cf7d0 2023-10-14T12:34:45.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.111+0000 7faf6cff9700 1 -- 172.21.15.72:0/1719198038 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16807 (secure 0 0 0) 0x7faf7014baf0 con 0x7faf700cf7d0 2023-10-14T12:34:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:45.113 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":37,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:44.115986+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:34:42.048622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:34:43.090751+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5c06af00 msgr2=0x7faf5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5c06af00 0x7faf5c06d3c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faf600011e0 tx=0x7faf60009040 comp rx=0 tx=0).stop 2023-10-14T12:34:45.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf700cf7d0 msgr2=0x7faf700b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf700cf7d0 0x7faf700b0120 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faf6400c700 tx=0x7faf6400ca10 comp rx=0 tx=0).stop 2023-10-14T12:34:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 shutdown_connections 2023-10-14T12:34:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7faf5c06af00 0x7faf5c06d3c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faf7015e7f0 0x7faf700b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf7006a820 0x7faf700afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 --2- 172.21.15.72:0/1719198038 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf700cf7d0 0x7faf700b0120 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.113+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 >> 172.21.15.72:0/1719198038 conn(0x7faf700d0180 msgr2=0x7faf70071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.114+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 shutdown_connections 2023-10-14T12:34:45.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.114+0000 7faf76543700 1 -- 172.21.15.72:0/1719198038 wait complete. 2023-10-14T12:34:45.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:45.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.245+0000 7fcf70301700 1 Processor -- start 2023-10-14T12:34:45.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.246+0000 7fcf70301700 1 -- start start 2023-10-14T12:34:45.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.246+0000 7fcf70301700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcf6815e7f0 0x7fcf68071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.246+0000 7fcf70301700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf680cfeb0 con 0x7fcf680cf7d0 2023-10-14T12:34:45.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.246+0000 7fcf70301700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf680cfc30 con 0x7fcf6806a820 2023-10-14T12:34:45.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.246+0000 7fcf70301700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf680ce410 con 0x7fcf6815e7f0 2023-10-14T12:34:45.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d89c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcf680cf7d0 0x7fcf680ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54920/0 (socket says 172.21.15.72:54920) 2023-10-14T12:34:45.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d89c700 1 -- 172.21.15.72:0/3699688141 learned_addr learned my addr 172.21.15.72:0/3699688141 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:45.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361698666 0 0) 0x7fcf680cfeb0 con 0x7fcf680cf7d0 2023-10-14T12:34:45.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf540035b0 con 0x7fcf680cf7d0 2023-10-14T12:34:45.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6e89e700 1 --2- 172.21.15.72:0/3699688141 >> v2:172.21.15.123:3300/0 conn(0x7fcf6815e7f0 0x7fcf68071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1246370236 0 0) 0x7fcf540035b0 con 0x7fcf680cf7d0 2023-10-14T12:34:45.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 >> v2:172.21.15.123:3300/0 conn(0x7fcf6815e7f0 msgr2=0x7fcf68071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:45.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 --2- 172.21.15.72:0/3699688141 >> v2:172.21.15.123:3300/0 conn(0x7fcf6815e7f0 0x7fcf68071ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 >> v1:172.21.15.123:6789/0 conn(0x7fcf6806a820 legacy=0x7fcf6806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:45.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf680af9d0 con 0x7fcf680cf7d0 2023-10-14T12:34:45.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7fcf64001670 con 0x7fcf680cf7d0 2023-10-14T12:34:45.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 >> v1:172.21.15.72:6789/0 conn(0x7fcf680cf7d0 legacy=0x7fcf680ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf54003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf54004850 0x7fcf54004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf54005330 0x7fcf5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680ce410 con 0x7fcf54003a00 2023-10-14T12:34:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5400c200 con 0x7fcf54004850 2023-10-14T12:34:45.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5400c3c0 con 0x7fcf54005330 2023-10-14T12:34:45.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6e89e700 1 --2- 172.21.15.72:0/3699688141 >> v2:172.21.15.123:3300/0 conn(0x7fcf6815e7f0 0x7fcf68071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:45.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6e09d700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf54003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6d89c700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf54004850 0x7fcf54004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.247+0000 7fcf6e89e700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf54005330 0x7fcf5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6e09d700 1 -- 172.21.15.72:0/3699688141 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf54005330 msgr2=0x7fcf5400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6e09d700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf54005330 0x7fcf5400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6e09d700 1 -- 172.21.15.72:0/3699688141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf54004850 msgr2=0x7fcf54004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6e09d700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf54004850 0x7fcf54004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6e09d700 1 -- 172.21.15.72:0/3699688141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf540035b0 con 0x7fcf54003a00 2023-10-14T12:34:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6e89e700 1 -- 172.21.15.72:0/3699688141 reap_dead start 2023-10-14T12:34:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6d89c700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf54004850 0x7fcf54004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6e09d700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf54003e20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcf58007fd0 tx=0x7fcf54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25f4409af5e4195 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580012f0 con 0x7fcf54003a00 2023-10-14T12:34:45.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf58005310 con 0x7fcf54003a00 2023-10-14T12:34:45.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf6d09b700 1 -- 172.21.15.72:0/3699688141 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58006860 con 0x7fcf54003a00 2023-10-14T12:34:45.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf70301700 1 -- 172.21.15.72:0/3699688141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 msgr2=0x7fcf54003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf70301700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf54003e20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcf58007fd0 tx=0x7fcf54005880 comp rx=0 tx=0).stop 2023-10-14T12:34:45.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf70301700 1 -- 172.21.15.72:0/3699688141 shutdown_connections 2023-10-14T12:34:45.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf70301700 1 --2- 172.21.15.72:0/3699688141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf54003e20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf70301700 1 -- 172.21.15.72:0/3699688141 >> 172.21.15.72:0/3699688141 conn(0x7fcf680d0180 msgr2=0x7fcf680d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:45.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf70301700 1 -- 172.21.15.72:0/3699688141 shutdown_connections 2023-10-14T12:34:45.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.248+0000 7fcf70301700 1 -- 172.21.15.72:0/3699688141 wait complete. 2023-10-14T12:34:45.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.250+0000 7fcf70301700 1 Processor -- start 2023-10-14T12:34:45.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.250+0000 7fcf70301700 1 -- start start 2023-10-14T12:34:45.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.250+0000 7fcf70301700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf6815ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.250+0000 7fcf70301700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf68157ab0 0x7fcf680b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.250+0000 7fcf70301700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf680ade40 0x7fcf680ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.250+0000 7fcf70301700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680b5030 con 0x7fcf54003a00 2023-10-14T12:34:45.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.250+0000 7fcf70301700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68157f30 con 0x7fcf680ade40 2023-10-14T12:34:45.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.250+0000 7fcf70301700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680ae800 con 0x7fcf68157ab0 2023-10-14T12:34:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e09d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf6815ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e09d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf6815ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48632/0 (socket says 172.21.15.72:48632) 2023-10-14T12:34:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e09d700 1 -- 172.21.15.72:0/1528500192 learned_addr learned my addr 172.21.15.72:0/1528500192 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6d89c700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf68157ab0 0x7fcf680b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e89e700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf680ade40 0x7fcf680ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e09d700 1 -- 172.21.15.72:0/1528500192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf68157ab0 msgr2=0x7fcf680b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e09d700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf68157ab0 0x7fcf680b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e09d700 1 -- 172.21.15.72:0/1528500192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf680ade40 msgr2=0x7fcf680ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e09d700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf680ade40 0x7fcf680ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e09d700 1 -- 172.21.15.72:0/1528500192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf680b3900 con 0x7fcf54003a00 2023-10-14T12:34:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf6e09d700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf6815ccd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000c00 tx=0x7fcf58001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf5effd700 1 -- 172.21.15.72:0/1528500192 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58001290 con 0x7fcf54003a00 2023-10-14T12:34:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf5effd700 1 -- 172.21.15.72:0/1528500192 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf58006e30 con 0x7fcf54003a00 2023-10-14T12:34:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf680c3d30 con 0x7fcf54003a00 2023-10-14T12:34:45.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf5effd700 1 -- 172.21.15.72:0/1528500192 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58007250 con 0x7fcf54003a00 2023-10-14T12:34:45.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.251+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf680c42f0 con 0x7fcf54003a00 2023-10-14T12:34:45.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.252+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6804ebb0 con 0x7fcf54003a00 2023-10-14T12:34:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.253+0000 7fcf5effd700 1 -- 172.21.15.72:0/1528500192 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf580073d0 con 0x7fcf54003a00 2023-10-14T12:34:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.253+0000 7fcf5effd700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcf4c06af00 0x7fcf4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.253+0000 7fcf5effd700 1 -- 172.21.15.72:0/1528500192 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fcf5808a710 con 0x7fcf54003a00 2023-10-14T12:34:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.253+0000 7fcf6d89c700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcf4c06af00 0x7fcf4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.253+0000 7fcf6d89c700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcf4c06af00 0x7fcf4c06d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b4550 tx=0x7fcf64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:45.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.257+0000 7fcf5effd700 1 -- 172.21.15.72:0/1528500192 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf58055810 con 0x7fcf54003a00 2023-10-14T12:34:45.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.451+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf680b6100 con 0x7fcf54003a00 2023-10-14T12:34:45.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.452+0000 7fcf5effd700 1 -- 172.21.15.72:0/1528500192 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16807 (secure 0 0 0) 0x7fcf58058e30 con 0x7fcf54003a00 2023-10-14T12:34:45.454 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:45.454 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":37,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:44.115986+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:34:42.048622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:34:43.090751+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:45.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcf4c06af00 msgr2=0x7fcf4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcf4c06af00 0x7fcf4c06d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b4550 tx=0x7fcf64009040 comp rx=0 tx=0).stop 2023-10-14T12:34:45.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 msgr2=0x7fcf6815ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf6815ccd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000c00 tx=0x7fcf58001120 comp rx=0 tx=0).stop 2023-10-14T12:34:45.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 shutdown_connections 2023-10-14T12:34:45.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fcf4c06af00 0x7fcf4c06d3c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf680ade40 0x7fcf680ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf54003a00 0x7fcf6815ccd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 --2- 172.21.15.72:0/1528500192 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fcf68157ab0 0x7fcf680b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.454+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 >> 172.21.15.72:0/1528500192 conn(0x7fcf680d0180 msgr2=0x7fcf6815dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:45.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.455+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 shutdown_connections 2023-10-14T12:34:45.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.455+0000 7fcf70301700 1 -- 172.21.15.72:0/1528500192 wait complete. 2023-10-14T12:34:45.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-14T12:34:45.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.590+0000 7f6638a1f700 1 Processor -- start 2023-10-14T12:34:45.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.590+0000 7f6638a1f700 1 -- start start 2023-10-14T12:34:45.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.591+0000 7f6638a1f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f663415b4e0 0x7f663406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.591+0000 7f6638a1f700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66340cd770 0x7f66340b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.591+0000 7f6638a1f700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6634070620 con 0x7f66340b3220 2023-10-14T12:34:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.591+0000 7f6638a1f700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66340b36b0 con 0x7f66340cd770 2023-10-14T12:34:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.591+0000 7f6638a1f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6634070900 con 0x7f663415b4e0 2023-10-14T12:34:45.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.591+0000 7f663259c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f663415b4e0 0x7f663406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.591+0000 7f6631d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66340cd770 0x7f66340b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.591+0000 7f663259c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f663415b4e0 0x7f663406f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:44292/0 (socket says 172.21.15.72:44292) 2023-10-14T12:34:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.591+0000 7f663259c700 1 -- 172.21.15.72:0/1696769603 learned_addr learned my addr 172.21.15.72:0/1696769603 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f663259c700 1 -- 172.21.15.72:0/1696769603 >> v2:172.21.15.123:3300/0 conn(0x7f66340cd770 msgr2=0x7f66340b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:45.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f663259c700 1 --2- 172.21.15.72:0/1696769603 >> v2:172.21.15.123:3300/0 conn(0x7f66340cd770 0x7f66340b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f663259c700 1 -- 172.21.15.72:0/1696769603 >> v1:172.21.15.123:6789/0 conn(0x7f66340b3220 legacy=0x7f66340cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f663259c700 1 -- 172.21.15.72:0/1696769603 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634070be0 con 0x7f663415b4e0 2023-10-14T12:34:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f6631d9b700 1 --2- 172.21.15.72:0/1696769603 >> v2:172.21.15.123:3300/0 conn(0x7f66340cd770 0x7f66340b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f663259c700 1 --2- 172.21.15.72:0/1696769603 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f663415b4e0 0x7f663406f280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f66280098f0 tx=0x7f6628009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f92b46bb2ef170 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:45.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f663159a700 1 -- 172.21.15.72:0/1696769603 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628011830 con 0x7f663415b4e0 2023-10-14T12:34:45.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f663159a700 1 -- 172.21.15.72:0/1696769603 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6628011990 con 0x7f663415b4e0 2023-10-14T12:34:45.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f663159a700 1 -- 172.21.15.72:0/1696769603 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628011d20 con 0x7f663415b4e0 2023-10-14T12:34:45.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f6638a1f700 1 -- 172.21.15.72:0/1696769603 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f663415b4e0 msgr2=0x7f663406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.592+0000 7f6638a1f700 1 --2- 172.21.15.72:0/1696769603 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f663415b4e0 0x7f663406f280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f66280098f0 tx=0x7f6628009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:45.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.593+0000 7f6638a1f700 1 -- 172.21.15.72:0/1696769603 shutdown_connections 2023-10-14T12:34:45.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.593+0000 7f6638a1f700 1 --2- 172.21.15.72:0/1696769603 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f663415b4e0 0x7f663406f280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.593+0000 7f6638a1f700 1 --2- 172.21.15.72:0/1696769603 >> v2:172.21.15.123:3300/0 conn(0x7f66340cd770 0x7f66340b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.593+0000 7f6638a1f700 1 -- 172.21.15.72:0/1696769603 >> 172.21.15.72:0/1696769603 conn(0x7f66340cdce0 msgr2=0x7f66340ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:45.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.593+0000 7f6638a1f700 1 -- 172.21.15.72:0/1696769603 shutdown_connections 2023-10-14T12:34:45.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.593+0000 7f6638a1f700 1 -- 172.21.15.72:0/1696769603 wait complete. 2023-10-14T12:34:45.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.594+0000 7f6638a1f700 1 Processor -- start 2023-10-14T12:34:45.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.594+0000 7f6638a1f700 1 -- start start 2023-10-14T12:34:45.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6638a1f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66340b3220 0x7f66340ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6638a1f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66340cd770 0x7f66341f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6638a1f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663415b4e0 0x7f66341f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6638a1f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340a8830 con 0x7f663415b4e0 2023-10-14T12:34:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6638a1f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340a8b10 con 0x7f66340cd770 2023-10-14T12:34:45.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6638a1f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340a8df0 con 0x7f66340b3220 2023-10-14T12:34:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6632d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663415b4e0 0x7f66341f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6632d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663415b4e0 0x7f66341f19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48650/0 (socket says 172.21.15.72:48650) 2023-10-14T12:34:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6632d9d700 1 -- 172.21.15.72:0/2740868532 learned_addr learned my addr 172.21.15.72:0/2740868532 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f663259c700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66340b3220 0x7f66340ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.595+0000 7f6631d9b700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66340cd770 0x7f66341f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6632d9d700 1 -- 172.21.15.72:0/2740868532 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66340b3220 msgr2=0x7f66340ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6632d9d700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66340b3220 0x7f66340ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6632d9d700 1 -- 172.21.15.72:0/2740868532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66340cd770 msgr2=0x7f66341f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:45.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6632d9d700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66340cd770 0x7f66341f45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:45.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6632d9d700 1 -- 172.21.15.72:0/2740868532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66240094a0 con 0x7f663415b4e0 2023-10-14T12:34:45.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6632d9d700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663415b4e0 0x7f66341f19d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f662c00cc50 tx=0x7f662c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:45.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6622ffd700 1 -- 172.21.15.72:0/2740868532 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c003c00 con 0x7f663415b4e0 2023-10-14T12:34:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6622ffd700 1 -- 172.21.15.72:0/2740868532 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c003d60 con 0x7f663415b4e0 2023-10-14T12:34:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6628009550 con 0x7f663415b4e0 2023-10-14T12:34:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6622ffd700 1 -- 172.21.15.72:0/2740868532 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00aab0 con 0x7f663415b4e0 2023-10-14T12:34:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.596+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66340a93b0 con 0x7f663415b4e0 2023-10-14T12:34:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.597+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663404ebb0 con 0x7f663415b4e0 2023-10-14T12:34:45.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.597+0000 7f6622ffd700 1 -- 172.21.15.72:0/2740868532 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f662c00ac10 con 0x7f663415b4e0 2023-10-14T12:34:45.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.598+0000 7f6622ffd700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f661406af00 0x7f661406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:45.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.598+0000 7f6622ffd700 1 -- 172.21.15.72:0/2740868532 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f662c089710 con 0x7f663415b4e0 2023-10-14T12:34:45.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.598+0000 7f663259c700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f661406af00 0x7f661406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:45.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.598+0000 7f663259c700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f661406af00 0x7f661406d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6628009c40 tx=0x7f6628008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:45.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.602+0000 7f6622ffd700 1 -- 172.21.15.72:0/2740868532 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f662c054660 con 0x7f663415b4e0 2023-10-14T12:34:45.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:45.840+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f66340d0bf0 con 0x7f663415b4e0 2023-10-14T12:34:46.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.769+0000 7f6622ffd700 1 -- 172.21.15.72:0/2740868532 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 123+0+0 (secure 0 0 0) 0x7f662c057c80 con 0x7f663415b4e0 2023-10-14T12:34:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f661406af00 msgr2=0x7f661406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f661406af00 0x7f661406d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6628009c40 tx=0x7f6628008030 comp rx=0 tx=0).stop 2023-10-14T12:34:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663415b4e0 msgr2=0x7f66341f19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663415b4e0 0x7f66341f19d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f662c00cc50 tx=0x7f662c00cf60 comp rx=0 tx=0).stop 2023-10-14T12:34:46.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 shutdown_connections 2023-10-14T12:34:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f661406af00 0x7f661406d3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f663415b4e0 0x7f66341f19d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66340b3220 0x7f66340ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:46.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 --2- 172.21.15.72:0/2740868532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66340cd770 0x7f66341f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:46.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 >> 172.21.15.72:0/2740868532 conn(0x7f66340cdce0 msgr2=0x7f66340d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:46.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 shutdown_connections 2023-10-14T12:34:46.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.772+0000 7f6638a1f700 1 -- 172.21.15.72:0/2740868532 wait complete. 2023-10-14T12:34:46.788 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T12:34:46.788 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-14T12:34:46.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.916+0000 7fa4bcd99700 1 Processor -- start 2023-10-14T12:34:46.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.916+0000 7fa4bcd99700 1 -- start start 2023-10-14T12:34:46.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.917+0000 7fa4bcd99700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806f450 0x7fa4b80cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:46.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.917+0000 7fa4bcd99700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4b806ff60 0x7fa4b80b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:46.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.917+0000 7fa4bcd99700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4b815b9f0 con 0x7fa4b815b610 2023-10-14T12:34:46.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.917+0000 7fa4bcd99700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4b80cdb50 con 0x7fa4b806ff60 2023-10-14T12:34:46.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.917+0000 7fa4bcd99700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b806b710 con 0x7fa4b806f450 2023-10-14T12:34:46.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4b806ff60 0x7fa4b80b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:46.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa4b806ff60 0x7fa4b80b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48654/0 (socket says 172.21.15.72:48654) 2023-10-14T12:34:46.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b6d9d700 1 -- 172.21.15.72:0/2495726407 learned_addr learned my addr 172.21.15.72:0/2495726407 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:46.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b5d9b700 1 --2- 172.21.15.72:0/2495726407 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806f450 0x7fa4b80cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:46.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b6d9d700 1 -- 172.21.15.72:0/2495726407 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806f450 msgr2=0x7fa4b80cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:46.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b6d9d700 1 --2- 172.21.15.72:0/2495726407 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806f450 0x7fa4b80cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:46.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b6d9d700 1 -- 172.21.15.72:0/2495726407 >> v1:172.21.15.123:6789/0 conn(0x7fa4b815b610 legacy=0x7fa4b806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:46.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b6d9d700 1 -- 172.21.15.72:0/2495726407 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b806a950 con 0x7fa4b806ff60 2023-10-14T12:34:46.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b5d9b700 1 --2- 172.21.15.72:0/2495726407 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806f450 0x7fa4b80cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:46.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b6d9d700 1 --2- 172.21.15.72:0/2495726407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b806ff60 0x7fa4b80b30b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009e50 tx=0x7fa4b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497fa0e08e38b462 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:46.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b559a700 1 -- 172.21.15.72:0/2495726407 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b000e070 con 0x7fa4b806ff60 2023-10-14T12:34:46.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b559a700 1 -- 172.21.15.72:0/2495726407 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b0003a70 con 0x7fa4b806ff60 2023-10-14T12:34:46.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.918+0000 7fa4b559a700 1 -- 172.21.15.72:0/2495726407 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0003e20 con 0x7fa4b806ff60 2023-10-14T12:34:46.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.919+0000 7fa4bcd99700 1 -- 172.21.15.72:0/2495726407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b806ff60 msgr2=0x7fa4b80b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:46.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.919+0000 7fa4bcd99700 1 --2- 172.21.15.72:0/2495726407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b806ff60 0x7fa4b80b30b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009e50 tx=0x7fa4b000b330 comp rx=0 tx=0).stop 2023-10-14T12:34:46.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.919+0000 7fa4bcd99700 1 -- 172.21.15.72:0/2495726407 shutdown_connections 2023-10-14T12:34:46.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.919+0000 7fa4bcd99700 1 --2- 172.21.15.72:0/2495726407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b806ff60 0x7fa4b80b30b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:46.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.919+0000 7fa4bcd99700 1 --2- 172.21.15.72:0/2495726407 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806f450 0x7fa4b80cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:46.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.919+0000 7fa4bcd99700 1 -- 172.21.15.72:0/2495726407 >> 172.21.15.72:0/2495726407 conn(0x7fa4b80ccce0 msgr2=0x7fa4b80cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:46.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.919+0000 7fa4bcd99700 1 -- 172.21.15.72:0/2495726407 shutdown_connections 2023-10-14T12:34:46.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.919+0000 7fa4bcd99700 1 -- 172.21.15.72:0/2495726407 wait complete. 2023-10-14T12:34:46.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.920+0000 7fa4bcd99700 1 Processor -- start 2023-10-14T12:34:46.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.920+0000 7fa4bcd99700 1 -- start start 2023-10-14T12:34:46.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4bcd99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b806f450 0x7fa4b8157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:46.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4bcd99700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806ff60 0x7fa4b80c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:46.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4bcd99700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b815b610 0x7fa4b80afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:46.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4bcd99700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c3d50 con 0x7fa4b815b610 2023-10-14T12:34:46.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4bcd99700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c8520 con 0x7fa4b806f450 2023-10-14T12:34:46.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4bcd99700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b80c3ff0 con 0x7fa4b806ff60 2023-10-14T12:34:46.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b815b610 0x7fa4b80afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b815b610 0x7fa4b80afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48662/0 (socket says 172.21.15.72:48662) 2023-10-14T12:34:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b6d9d700 1 -- 172.21.15.72:0/3426712504 learned_addr learned my addr 172.21.15.72:0/3426712504 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b806f450 0x7fa4b8157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b5d9b700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806ff60 0x7fa4b80c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:46.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b6d9d700 1 -- 172.21.15.72:0/3426712504 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806ff60 msgr2=0x7fa4b80c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:46.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b6d9d700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806ff60 0x7fa4b80c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:46.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b6d9d700 1 -- 172.21.15.72:0/3426712504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b806f450 msgr2=0x7fa4b8157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:46.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b6d9d700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b806f450 0x7fa4b8157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:46.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b6d9d700 1 -- 172.21.15.72:0/3426712504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b0009b30 con 0x7fa4b815b610 2023-10-14T12:34:46.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4b6d9d700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b815b610 0x7fa4b80afd20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa4b806d260 tx=0x7fa4b0004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.921+0000 7fa4a6ffd700 1 -- 172.21.15.72:0/3426712504 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0004440 con 0x7fa4b815b610 2023-10-14T12:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.922+0000 7fa4a6ffd700 1 -- 172.21.15.72:0/3426712504 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b00045e0 con 0x7fa4b815b610 2023-10-14T12:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.922+0000 7fa4a6ffd700 1 -- 172.21.15.72:0/3426712504 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0004990 con 0x7fa4b815b610 2023-10-14T12:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.922+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b80c42d0 con 0x7fa4b815b610 2023-10-14T12:34:46.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.922+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b80c4890 con 0x7fa4b815b610 2023-10-14T12:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.923+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b804ebb0 con 0x7fa4b815b610 2023-10-14T12:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.923+0000 7fa4a6ffd700 1 -- 172.21.15.72:0/3426712504 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa4b0019030 con 0x7fa4b815b610 2023-10-14T12:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.923+0000 7fa4a6ffd700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa49806af00 0x7fa49806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.924+0000 7fa4a6ffd700 1 -- 172.21.15.72:0/3426712504 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fa4b008a780 con 0x7fa4b815b610 2023-10-14T12:34:46.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.924+0000 7fa4b659c700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa49806af00 0x7fa49806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.924+0000 7fa4b659c700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa49806af00 0x7fa49806d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009960 tx=0x7fa4ac0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:46.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:46.928+0000 7fa4a6ffd700 1 -- 172.21.15.72:0/3426712504 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa4b00556e0 con 0x7fa4b815b610 2023-10-14T12:34:47.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.160+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa4b815b9f0 con 0x7fa4b815b610 2023-10-14T12:34:47.708 INFO:tasks.ceph.mds.a.smithi072.stderr:2023-10-14T12:34:47.707+0000 7f3b55ab3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T12:34:47.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.775+0000 7fa4a6ffd700 1 -- 172.21.15.72:0/3426712504 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 127+0+0 (secure 0 0 0) 0x7fa4b815b9f0 con 0x7fa4b815b610 2023-10-14T12:34:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.777+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa49806af00 msgr2=0x7fa49806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.777+0000 7fa4bcd99700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa49806af00 0x7fa49806d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac009960 tx=0x7fa4ac0090e0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.777+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b815b610 msgr2=0x7fa4b80afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:47.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.777+0000 7fa4bcd99700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b815b610 0x7fa4b80afd20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa4b806d260 tx=0x7fa4b0004b20 comp rx=0 tx=0).stop 2023-10-14T12:34:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.778+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 shutdown_connections 2023-10-14T12:34:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.778+0000 7fa4bcd99700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa49806af00 0x7fa49806d3c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.778+0000 7fa4bcd99700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4b815b610 0x7fa4b80afd20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.778+0000 7fa4bcd99700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b806f450 0x7fa4b8157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.778+0000 7fa4bcd99700 1 --2- 172.21.15.72:0/3426712504 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa4b806ff60 0x7fa4b80c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.778+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 >> 172.21.15.72:0/3426712504 conn(0x7fa4b80ccce0 msgr2=0x7fa4b80b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.778+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 shutdown_connections 2023-10-14T12:34:47.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.778+0000 7fa4bcd99700 1 -- 172.21.15.72:0/3426712504 wait complete. 2023-10-14T12:34:47.792 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-14T12:34:47.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:34:47.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.913+0000 7f77ca303700 1 Processor -- start 2023-10-14T12:34:47.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.913+0000 7f77ca303700 1 -- start start 2023-10-14T12:34:47.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.914+0000 7f77ca303700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f77c406e370 0x7f77c40b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:47.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.914+0000 7f77ca303700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40ce6b0 con 0x7f77c40b3810 2023-10-14T12:34:47.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.914+0000 7f77ca303700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40ce990 con 0x7f77c40b4890 2023-10-14T12:34:47.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.914+0000 7f77ca303700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c40cec70 con 0x7f77c406e370 2023-10-14T12:34:47.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.914+0000 7f77c3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f77c40b3810 0x7f77c40cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54966/0 (socket says 172.21.15.72:54966) 2023-10-14T12:34:47.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.914+0000 7f77c3fff700 1 -- 172.21.15.72:0/2266054483 learned_addr learned my addr 172.21.15.72:0/2266054483 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:47.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593096175 0 0) 0x7f77c40ce6b0 con 0x7f77c40b3810 2023-10-14T12:34:47.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c37fe700 1 --2- 172.21.15.72:0/2266054483 >> v2:172.21.15.123:3300/0 conn(0x7f77c406e370 0x7f77c40b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:47.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b00035b0 con 0x7f77c40b3810 2023-10-14T12:34:47.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3276350981 0 0) 0x7f77b00035b0 con 0x7f77c40b3810 2023-10-14T12:34:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 >> v2:172.21.15.123:3300/0 conn(0x7f77c406e370 msgr2=0x7f77c40b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 --2- 172.21.15.72:0/2266054483 >> v2:172.21.15.123:3300/0 conn(0x7f77c406e370 0x7f77c40b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 >> v1:172.21.15.123:6789/0 conn(0x7f77c40b4890 legacy=0x7f77c4163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c40cef50 con 0x7f77c40b3810 2023-10-14T12:34:47.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f77ac001670 con 0x7f77c40b3810 2023-10-14T12:34:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 >> v1:172.21.15.72:6789/0 conn(0x7f77c40b3810 legacy=0x7f77c40cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77b0003a00 0x7f77b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77b0004850 0x7f77b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:47.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77b0005210 0x7f77b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40cec70 con 0x7f77b0003a00 2023-10-14T12:34:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b000e2c0 con 0x7f77b0005210 2023-10-14T12:34:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b000e480 con 0x7f77b0004850 2023-10-14T12:34:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c3fff700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77b0003a00 0x7f77b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:47.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c88a0700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77b0005210 0x7f77b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c37fe700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77b0004850 0x7f77b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c3fff700 1 -- 172.21.15.72:0/2266054483 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77b0004850 msgr2=0x7f77b0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c3fff700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77b0004850 0x7f77b0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c3fff700 1 -- 172.21.15.72:0/2266054483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77b0005210 msgr2=0x7f77b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:47.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c3fff700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77b0005210 0x7f77b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c88a0700 1 -- 172.21.15.72:0/2266054483 reap_dead start 2023-10-14T12:34:47.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c3fff700 1 -- 172.21.15.72:0/2266054483 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00035b0 con 0x7f77b0003a00 2023-10-14T12:34:47.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c37fe700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77b0004850 0x7f77b0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:47.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.915+0000 7f77c3fff700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77b0003a00 0x7f77b0003e20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c240 tx=0x7f77b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790371a43e27cb6d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac007c10 con 0x7f77b0003a00 2023-10-14T12:34:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac00cde0 con 0x7f77b0003a00 2023-10-14T12:34:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77c2ffd700 1 -- 172.21.15.72:0/2266054483 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac005ba0 con 0x7f77b0003a00 2023-10-14T12:34:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77ca303700 1 -- 172.21.15.72:0/2266054483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77b0003a00 msgr2=0x7f77b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:47.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77ca303700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77b0003a00 0x7f77b0003e20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c240 tx=0x7f77b0005880 comp rx=0 tx=0).stop 2023-10-14T12:34:47.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77ca303700 1 -- 172.21.15.72:0/2266054483 shutdown_connections 2023-10-14T12:34:47.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77ca303700 1 --2- 172.21.15.72:0/2266054483 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77b0003a00 0x7f77b0003e20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77ca303700 1 -- 172.21.15.72:0/2266054483 >> 172.21.15.72:0/2266054483 conn(0x7f77c40b1620 msgr2=0x7f77c40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:47.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77ca303700 1 -- 172.21.15.72:0/2266054483 shutdown_connections 2023-10-14T12:34:47.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.916+0000 7f77ca303700 1 -- 172.21.15.72:0/2266054483 wait complete. 2023-10-14T12:34:47.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.917+0000 7f77ca303700 1 Processor -- start 2023-10-14T12:34:47.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77ca303700 1 -- start start 2023-10-14T12:34:47.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77ca303700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77b0003a00 0x7f77c41f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:47.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77ca303700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77c4156ed0 0x7f77c4158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:47.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77ca303700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77c4159470 0x7f77c40a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:47.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77ca303700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4157f70 con 0x7f77c4156ed0 2023-10-14T12:34:47.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77ca303700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4157360 con 0x7f77b0003a00 2023-10-14T12:34:47.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77ca303700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4157640 con 0x7f77c4159470 2023-10-14T12:34:47.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77c4156ed0 0x7f77c4158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:47.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77c4156ed0 0x7f77c4158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48680/0 (socket says 172.21.15.72:48680) 2023-10-14T12:34:47.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.918+0000 7f77c37fe700 1 -- 172.21.15.72:0/868946227 learned_addr learned my addr 172.21.15.72:0/868946227 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:47.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c3fff700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77b0003a00 0x7f77c41f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:47.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c88a0700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77c4159470 0x7f77c40a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:47.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c37fe700 1 -- 172.21.15.72:0/868946227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77c4159470 msgr2=0x7f77c40a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:47.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c37fe700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77c4159470 0x7f77c40a9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c37fe700 1 -- 172.21.15.72:0/868946227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77b0003a00 msgr2=0x7f77c41f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:47.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c37fe700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77b0003a00 0x7f77c41f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:47.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c37fe700 1 -- 172.21.15.72:0/868946227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4157920 con 0x7f77c4156ed0 2023-10-14T12:34:47.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c88a0700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77c4159470 0x7f77c40a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:47.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c37fe700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77c4156ed0 0x7f77c4158f30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f77b4011590 tx=0x7f77b40118a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:47.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c0ff9700 1 -- 172.21.15.72:0/868946227 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4004220 con 0x7f77c4156ed0 2023-10-14T12:34:47.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c0ff9700 1 -- 172.21.15.72:0/868946227 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b4004380 con 0x7f77c4156ed0 2023-10-14T12:34:47.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c4157c00 con 0x7f77c4156ed0 2023-10-14T12:34:47.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77c0ff9700 1 -- 172.21.15.72:0/868946227 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40036a0 con 0x7f77c4156ed0 2023-10-14T12:34:47.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.919+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c40a9c40 con 0x7f77c4156ed0 2023-10-14T12:34:47.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.920+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c404ebb0 con 0x7f77c4156ed0 2023-10-14T12:34:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.920+0000 7f77c0ff9700 1 -- 172.21.15.72:0/868946227 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f77b4003800 con 0x7f77c4156ed0 2023-10-14T12:34:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.921+0000 7f77c0ff9700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77a406aed0 0x7f77a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.921+0000 7f77c0ff9700 1 -- 172.21.15.72:0/868946227 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f77b4089960 con 0x7f77c4156ed0 2023-10-14T12:34:47.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.921+0000 7f77c3fff700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77a406aed0 0x7f77a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.921+0000 7f77c3fff700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77a406aed0 0x7f77a406d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:47.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:47.925+0000 7f77c0ff9700 1 -- 172.21.15.72:0/868946227 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f77b40548b0 con 0x7f77c4156ed0 2023-10-14T12:34:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.160+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77c406f640 con 0x7f77c4156ed0 2023-10-14T12:34:48.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.160+0000 7f77c0ff9700 1 -- 172.21.15.72:0/868946227 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f77b4022020 con 0x7f77c4156ed0 2023-10-14T12:34:48.162 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:48.162 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4258036152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4258036152},{"type":"v1","addr":"172.21.15.123:6834","nonce":4258036152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1898946436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1898946436},{"type":"v1","addr":"172.21.15.123:6835","nonce":1898946436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5256,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3912655583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3912655583},{"type":"v1","addr":"172.21.15.72:6837","nonce":3912655583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:34:44.116303+0000","modified":"2023-10-14T12:34:47.161994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5259":{"gid":5259,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/1876334136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1876334136},{"type":"v1","addr":"172.21.15.72:6836","nonce":1876334136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T12:34:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77a406aed0 msgr2=0x7f77a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77a406aed0 0x7f77a406d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac007000 comp rx=0 tx=0).stop 2023-10-14T12:34:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77c4156ed0 msgr2=0x7f77c4158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77c4156ed0 0x7f77c4158f30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f77b4011590 tx=0x7f77b40118a0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 shutdown_connections 2023-10-14T12:34:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77a406aed0 0x7f77a406d390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f77c4159470 0x7f77c40a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77b0003a00 0x7f77c41f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 --2- 172.21.15.72:0/868946227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77c4156ed0 0x7f77c4158f30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 >> 172.21.15.72:0/868946227 conn(0x7f77c40b1620 msgr2=0x7f77c40b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:48.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 shutdown_connections 2023-10-14T12:34:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.162+0000 7f77ca303700 1 -- 172.21.15.72:0/868946227 wait complete. 2023-10-14T12:34:48.166 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2023-10-14T12:34:48.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:48.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.294+0000 7fede3f4f700 1 Processor -- start 2023-10-14T12:34:48.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.294+0000 7fede3f4f700 1 -- start start 2023-10-14T12:34:48.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede3f4f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feddc15b300 0x7feddc0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede3f4f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feddc0b3240 0x7feddc0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede3f4f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc161180 con 0x7feddc0cf4e0 2023-10-14T12:34:48.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede3f4f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc0b36c0 con 0x7feddc0b3240 2023-10-14T12:34:48.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede3f4f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0cf970 con 0x7feddc15b300 2023-10-14T12:34:48.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede14ea700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feddc0b3240 0x7feddc0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede24ec700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feddc0cf4e0 0x7feddc070310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:54988/0 (socket says 172.21.15.72:54988) 2023-10-14T12:34:48.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede24ec700 1 -- 172.21.15.72:0/356658684 learned_addr learned my addr 172.21.15.72:0/356658684 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:48.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede14ea700 1 -- 172.21.15.72:0/356658684 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feddc15b300 msgr2=0x7feddc0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:48.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede14ea700 1 --2- 172.21.15.72:0/356658684 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feddc15b300 0x7feddc0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede14ea700 1 -- 172.21.15.72:0/356658684 >> v1:172.21.15.72:6789/0 conn(0x7feddc0cf4e0 legacy=0x7feddc070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede14ea700 1 -- 172.21.15.72:0/356658684 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc161460 con 0x7feddc0b3240 2023-10-14T12:34:48.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede0ce9700 1 -- 172.21.15.72:0/356658684 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204177443 0 0) 0x7feddc161180 con 0x7feddc0cf4e0 2023-10-14T12:34:48.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede14ea700 1 --2- 172.21.15.72:0/356658684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc0b3240 0x7feddc0cefa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009840 tx=0x7fedd8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c195e439a947752 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:48.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede0ce9700 1 -- 172.21.15.72:0/356658684 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8011830 con 0x7feddc0b3240 2023-10-14T12:34:48.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede0ce9700 1 -- 172.21.15.72:0/356658684 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd8011990 con 0x7feddc0b3240 2023-10-14T12:34:48.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.295+0000 7fede0ce9700 1 -- 172.21.15.72:0/356658684 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8011d20 con 0x7feddc0b3240 2023-10-14T12:34:48.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.296+0000 7fede3f4f700 1 -- 172.21.15.72:0/356658684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc0b3240 msgr2=0x7feddc0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.296+0000 7fede3f4f700 1 --2- 172.21.15.72:0/356658684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc0b3240 0x7feddc0cefa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009840 tx=0x7fedd8009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:48.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.296+0000 7fede3f4f700 1 -- 172.21.15.72:0/356658684 shutdown_connections 2023-10-14T12:34:48.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.296+0000 7fede3f4f700 1 --2- 172.21.15.72:0/356658684 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feddc15b300 0x7feddc0b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.296+0000 7fede3f4f700 1 --2- 172.21.15.72:0/356658684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc0b3240 0x7feddc0cefa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.296+0000 7fede3f4f700 1 -- 172.21.15.72:0/356658684 >> 172.21.15.72:0/356658684 conn(0x7feddc0cdd00 msgr2=0x7feddc0ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:48.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.296+0000 7fede3f4f700 1 -- 172.21.15.72:0/356658684 shutdown_connections 2023-10-14T12:34:48.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.296+0000 7fede3f4f700 1 -- 172.21.15.72:0/356658684 wait complete. 2023-10-14T12:34:48.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.297+0000 7fede3f4f700 1 Processor -- start 2023-10-14T12:34:48.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.297+0000 7fede3f4f700 1 -- start start 2023-10-14T12:34:48.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede3f4f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feddc0b3240 0x7feddc1607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede3f4f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feddc0cf4e0 0x7feddc157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede3f4f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc15b300 0x7feddc15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede3f4f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc160d10 con 0x7feddc15b300 2023-10-14T12:34:48.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede3f4f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc1583e0 con 0x7feddc0b3240 2023-10-14T12:34:48.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede3f4f700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc1f3f20 con 0x7feddc0cf4e0 2023-10-14T12:34:48.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede24ec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc15b300 0x7feddc15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede24ec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc15b300 0x7feddc15c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48696/0 (socket says 172.21.15.72:48696) 2023-10-14T12:34:48.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede24ec700 1 -- 172.21.15.72:0/700650689 learned_addr learned my addr 172.21.15.72:0/700650689 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:48.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede1ceb700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feddc0b3240 0x7feddc1607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede14ea700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feddc0cf4e0 0x7feddc157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede24ec700 1 -- 172.21.15.72:0/700650689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feddc0cf4e0 msgr2=0x7feddc157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede24ec700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feddc0cf4e0 0x7feddc157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede24ec700 1 -- 172.21.15.72:0/700650689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feddc0b3240 msgr2=0x7feddc1607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede24ec700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feddc0b3240 0x7feddc1607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede24ec700 1 -- 172.21.15.72:0/700650689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd80094a0 con 0x7feddc15b300 2023-10-14T12:34:48.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.298+0000 7fede1ceb700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feddc0b3240 0x7feddc1607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:48.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.299+0000 7fede24ec700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc15b300 0x7feddc15c730 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fedd4002230 tx=0x7fedd400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:48.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.299+0000 7fedd27fc700 1 -- 172.21.15.72:0/700650689 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400ac20 con 0x7feddc15b300 2023-10-14T12:34:48.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.299+0000 7fedd27fc700 1 -- 172.21.15.72:0/700650689 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd400ada0 con 0x7feddc15b300 2023-10-14T12:34:48.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.299+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc1f3310 con 0x7feddc15b300 2023-10-14T12:34:48.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.299+0000 7fedd27fc700 1 -- 172.21.15.72:0/700650689 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4007310 con 0x7feddc15b300 2023-10-14T12:34:48.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.299+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc1f38d0 con 0x7feddc15b300 2023-10-14T12:34:48.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.300+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc0b53e0 con 0x7feddc15b300 2023-10-14T12:34:48.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.300+0000 7fedd27fc700 1 -- 172.21.15.72:0/700650689 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fedd4007470 con 0x7feddc15b300 2023-10-14T12:34:48.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.300+0000 7fedd27fc700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedc006af00 0x7fedc006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.301+0000 7fedd27fc700 1 -- 172.21.15.72:0/700650689 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fedd4089600 con 0x7feddc15b300 2023-10-14T12:34:48.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.301+0000 7fede1ceb700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedc006af00 0x7fedc006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.301+0000 7fede1ceb700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedc006af00 0x7fedc006d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feddc0b2180 tx=0x7fedcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:48.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.305+0000 7fedd27fc700 1 -- 172.21.15.72:0/700650689 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feddc0b53e0 con 0x7feddc15b300 2023-10-14T12:34:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.495+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feddc0b53e0 con 0x7feddc15b300 2023-10-14T12:34:48.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.496+0000 7fedd27fc700 1 -- 172.21.15.72:0/700650689 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16794 (secure 0 0 0) 0x7feddc0b53e0 con 0x7feddc15b300 2023-10-14T12:34:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:48.498 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":38,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:45.755666+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:34:42.048622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:34:43.090751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:48.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedc006af00 msgr2=0x7fedc006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedc006af00 0x7fedc006d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7feddc0b2180 tx=0x7fedcc008040 comp rx=0 tx=0).stop 2023-10-14T12:34:48.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc15b300 msgr2=0x7feddc15c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc15b300 0x7feddc15c730 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fedd4002230 tx=0x7fedd400a060 comp rx=0 tx=0).stop 2023-10-14T12:34:48.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 shutdown_connections 2023-10-14T12:34:48.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fedc006af00 0x7fedc006d3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feddc15b300 0x7feddc15c730 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feddc0b3240 0x7feddc1607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 --2- 172.21.15.72:0/700650689 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7feddc0cf4e0 0x7feddc157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 >> 172.21.15.72:0/700650689 conn(0x7feddc0cdd00 msgr2=0x7feddc0cb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:48.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 shutdown_connections 2023-10-14T12:34:48.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.498+0000 7fede3f4f700 1 -- 172.21.15.72:0/700650689 wait complete. 2023-10-14T12:34:48.512 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T12:34:48.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:34:48.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.631+0000 7ff52b5f6700 1 Processor -- start 2023-10-14T12:34:48.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.631+0000 7ff52b5f6700 1 -- start start 2023-10-14T12:34:48.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff52b5f6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff524160b50 0x7ff5240cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff52b5f6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 0x7ff5240b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff52b5f6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5240d0010 con 0x7ff5240b5530 2023-10-14T12:34:48.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff52b5f6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5240b59c0 con 0x7ff524160b50 2023-10-14T12:34:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff52b5f6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240d02f0 con 0x7ff5240b9000 2023-10-14T12:34:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff529392700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff524160b50 0x7ff5240cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff529b93700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff5240b5530 0x7ff5241611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55004/0 (socket says 172.21.15.72:55004) 2023-10-14T12:34:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff529b93700 1 -- 172.21.15.72:0/3539361220 learned_addr learned my addr 172.21.15.72:0/3539361220 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff529392700 1 -- 172.21.15.72:0/3539361220 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 msgr2=0x7ff5240b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff528b91700 1 --2- 172.21.15.72:0/3539361220 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 0x7ff5240b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff51bfff700 1 -- 172.21.15.72:0/3539361220 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847553764 0 0) 0x7ff5240d0010 con 0x7ff5240b5530 2023-10-14T12:34:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff529392700 1 --2- 172.21.15.72:0/3539361220 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 0x7ff5240b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff529392700 1 -- 172.21.15.72:0/3539361220 >> v1:172.21.15.72:6789/0 conn(0x7ff5240b5530 legacy=0x7ff5241611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff529392700 1 -- 172.21.15.72:0/3539361220 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240d05d0 con 0x7ff524160b50 2023-10-14T12:34:48.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff529392700 1 --2- 172.21.15.72:0/3539361220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 0x7ff5240cf980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff520009840 tx=0x7ff520009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb96d1c66718b04 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:48.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff51bfff700 1 -- 172.21.15.72:0/3539361220 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520011830 con 0x7ff524160b50 2023-10-14T12:34:48.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff51bfff700 1 -- 172.21.15.72:0/3539361220 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff520011990 con 0x7ff524160b50 2023-10-14T12:34:48.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.632+0000 7ff51bfff700 1 -- 172.21.15.72:0/3539361220 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520011d20 con 0x7ff524160b50 2023-10-14T12:34:48.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.633+0000 7ff52b5f6700 1 -- 172.21.15.72:0/3539361220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 msgr2=0x7ff5240cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.633+0000 7ff52b5f6700 1 --2- 172.21.15.72:0/3539361220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 0x7ff5240cf980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff520009840 tx=0x7ff520009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.633+0000 7ff52b5f6700 1 -- 172.21.15.72:0/3539361220 shutdown_connections 2023-10-14T12:34:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.633+0000 7ff52b5f6700 1 --2- 172.21.15.72:0/3539361220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 0x7ff5240cf980 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.633+0000 7ff52b5f6700 1 --2- 172.21.15.72:0/3539361220 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 0x7ff5240b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.633+0000 7ff52b5f6700 1 -- 172.21.15.72:0/3539361220 >> 172.21.15.72:0/3539361220 conn(0x7ff52406bc70 msgr2=0x7ff52406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:48.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.633+0000 7ff52b5f6700 1 -- 172.21.15.72:0/3539361220 shutdown_connections 2023-10-14T12:34:48.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.633+0000 7ff52b5f6700 1 -- 172.21.15.72:0/3539361220 wait complete. 2023-10-14T12:34:48.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.634+0000 7ff52b5f6700 1 Processor -- start 2023-10-14T12:34:48.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.634+0000 7ff52b5f6700 1 -- start start 2023-10-14T12:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff52b5f6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5240b5530 0x7ff5240c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff52b5f6700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 0x7ff524157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff52b5f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 0x7ff5240b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff52b5f6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240c6330 con 0x7ff524160b50 2023-10-14T12:34:48.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff52b5f6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff524158070 con 0x7ff5240b5530 2023-10-14T12:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff52b5f6700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff524158350 con 0x7ff5240b9000 2023-10-14T12:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529b93700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 0x7ff5240b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529b93700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 0x7ff5240b6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48708/0 (socket says 172.21.15.72:48708) 2023-10-14T12:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529b93700 1 -- 172.21.15.72:0/2056995790 learned_addr learned my addr 172.21.15.72:0/2056995790 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:48.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff528b91700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 0x7ff524157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529392700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5240b5530 0x7ff5240c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529b93700 1 -- 172.21.15.72:0/2056995790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 msgr2=0x7ff524157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529b93700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 0x7ff524157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529b93700 1 -- 172.21.15.72:0/2056995790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5240b5530 msgr2=0x7ff5240c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529b93700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5240b5530 0x7ff5240c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529b93700 1 -- 172.21.15.72:0/2056995790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5200094a0 con 0x7ff524160b50 2023-10-14T12:34:48.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff528b91700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 0x7ff524157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:48.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff529b93700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 0x7ff5240b6e40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff51c002230 tx=0x7ff51c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:48.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.635+0000 7ff519ffb700 1 -- 172.21.15.72:0/2056995790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00ac20 con 0x7ff524160b50 2023-10-14T12:34:48.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.636+0000 7ff519ffb700 1 -- 172.21.15.72:0/2056995790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c00ada0 con 0x7ff524160b50 2023-10-14T12:34:48.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.636+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff524158630 con 0x7ff524160b50 2023-10-14T12:34:48.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.636+0000 7ff519ffb700 1 -- 172.21.15.72:0/2056995790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c007310 con 0x7ff524160b50 2023-10-14T12:34:48.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.636+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff524158bf0 con 0x7ff524160b50 2023-10-14T12:34:48.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.637+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff524158e10 con 0x7ff524160b50 2023-10-14T12:34:48.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.637+0000 7ff519ffb700 1 -- 172.21.15.72:0/2056995790 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff51c007470 con 0x7ff524160b50 2023-10-14T12:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.637+0000 7ff519ffb700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff50806af00 0x7ff50806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.637+0000 7ff519ffb700 1 -- 172.21.15.72:0/2056995790 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7ff51c089690 con 0x7ff524160b50 2023-10-14T12:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.637+0000 7ff529392700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff50806af00 0x7ff50806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.638+0000 7ff529392700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff50806af00 0x7ff50806d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff5200090b0 tx=0x7ff52001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:48.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.642+0000 7ff519ffb700 1 -- 172.21.15.72:0/2056995790 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff51c0545e0 con 0x7ff524160b50 2023-10-14T12:34:48.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.829+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5241584c0 con 0x7ff50806af00 2023-10-14T12:34:48.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.837+0000 7ff519ffb700 1 -- 172.21.15.72:0/2056995790 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283481 (secure 0 0 0) 0x7ff5241584c0 con 0x7ff50806af00 2023-10-14T12:34:48.842 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:48.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff50806af00 msgr2=0x7ff50806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff50806af00 0x7ff50806d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff5200090b0 tx=0x7ff52001c040 comp rx=0 tx=0).stop 2023-10-14T12:34:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 msgr2=0x7ff5240b6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 0x7ff5240b6e40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff51c002230 tx=0x7ff51c00a060 comp rx=0 tx=0).stop 2023-10-14T12:34:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 shutdown_connections 2023-10-14T12:34:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff50806af00 0x7ff50806d3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff524160b50 0x7ff5240b6e40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5240b5530 0x7ff5240c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 --2- 172.21.15.72:0/2056995790 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff5240b9000 0x7ff524157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 >> 172.21.15.72:0/2056995790 conn(0x7ff52406bc70 msgr2=0x7ff5241549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 shutdown_connections 2023-10-14T12:34:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:48.840+0000 7ff52b5f6700 1 -- 172.21.15.72:0/2056995790 wait complete. 2023-10-14T12:34:48.846 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:34:48.854 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-10-14T12:34:47.400533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220536,"kb_used_data":4368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754184,"statfs":{"total":773094113280,"available":772868284416,"internally_reserved":0,"allocated":4472832,"data_stored":2571404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.683928"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726871+0000","last_change":"2023-10-14T12:34:43.726871+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726871+0000","last_undegraded":"2023-10-14T12:34:43.726871+0000","last_fullsized":"2023-10-14T12:34:43.726871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724752+0000","last_change":"2023-10-14T12:34:43.724752+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724752+0000","last_undegraded":"2023-10-14T12:34:43.724752+0000","last_fullsized":"2023-10-14T12:34:43.724752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724202+0000","last_change":"2023-10-14T12:34:43.724202+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724202+0000","last_undegraded":"2023-10-14T12:34:43.724202+0000","last_fullsized":"2023-10-14T12:34:43.724202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723472+0000","last_change":"2023-10-14T12:34:43.723472+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723472+0000","last_undegraded":"2023-10-14T12:34:43.723472+0000","last_fullsized":"2023-10-14T12:34:43.723472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724099+0000","last_change":"2023-10-14T12:34:43.724099+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724099+0000","last_undegraded":"2023-10-14T12:34:43.724099+0000","last_fullsized":"2023-10-14T12:34:43.724099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726733+0000","last_change":"2023-10-14T12:34:43.726733+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726733+0000","last_undegraded":"2023-10-14T12:34:43.726733+0000","last_fullsized":"2023-10-14T12:34:43.726733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727120+0000","last_change":"2023-10-14T12:34:43.727120+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727120+0000","last_undegraded":"2023-10-14T12:34:43.727120+0000","last_fullsized":"2023-10-14T12:34:43.727120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725833+0000","last_change":"2023-10-14T12:34:43.725833+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725833+0000","last_undegraded":"2023-10-14T12:34:43.725833+0000","last_fullsized":"2023-10-14T12:34:43.725833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723760+0000","last_change":"2023-10-14T12:34:43.723760+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723760+0000","last_undegraded":"2023-10-14T12:34:43.723760+0000","last_fullsized":"2023-10-14T12:34:43.723760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727666+0000","last_change":"2023-10-14T12:34:43.727666+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727666+0000","last_undegraded":"2023-10-14T12:34:43.727666+0000","last_fullsized":"2023-10-14T12:34:43.727666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728346+0000","last_change":"2023-10-14T12:34:43.728346+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728346+0000","last_undegraded":"2023-10-14T12:34:43.728346+0000","last_fullsized":"2023-10-14T12:34:43.728346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723075+0000","last_change":"2023-10-14T12:34:43.723075+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723075+0000","last_undegraded":"2023-10-14T12:34:43.723075+0000","last_fullsized":"2023-10-14T12:34:43.723075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728011+0000","last_change":"2023-10-14T12:34:43.728011+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728011+0000","last_undegraded":"2023-10-14T12:34:43.728011+0000","last_fullsized":"2023-10-14T12:34:43.728011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731771+0000","last_change":"2023-10-14T12:34:43.731771+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731771+0000","last_undegraded":"2023-10-14T12:34:43.731771+0000","last_fullsized":"2023-10-14T12:34:43.731771+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.729162+0000","last_change":"2023-10-14T12:34:43.729162+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.729162+0000","last_undegraded":"2023-10-14T12:34:43.729162+0000","last_fullsized":"2023-10-14T12:34:43.729162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.734826+0000","last_change":"2023-10-14T12:34:43.734826+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.734826+0000","last_undegraded":"2023-10-14T12:34:43.734826+0000","last_fullsized":"2023-10-14T12:34:43.734826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.737373+0000","last_change":"2023-10-14T12:34:43.737373+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.737373+0000","last_undegraded":"2023-10-14T12:34:43.737373+0000","last_fullsized":"2023-10-14T12:34:43.737373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.732827+0000","last_change":"2023-10-14T12:34:43.732827+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.732827+0000","last_undegraded":"2023-10-14T12:34:43.732827+0000","last_fullsized":"2023-10-14T12:34:43.732827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722586+0000","last_change":"2023-10-14T12:34:43.722586+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722586+0000","last_undegraded":"2023-10-14T12:34:43.722586+0000","last_fullsized":"2023-10-14T12:34:43.722586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.732974+0000","last_change":"2023-10-14T12:34:43.732974+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.732974+0000","last_undegraded":"2023-10-14T12:34:43.732974+0000","last_fullsized":"2023-10-14T12:34:43.732974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727552+0000","last_change":"2023-10-14T12:34:43.727552+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727552+0000","last_undegraded":"2023-10-14T12:34:43.727552+0000","last_fullsized":"2023-10-14T12:34:43.727552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731090+0000","last_change":"2023-10-14T12:34:43.731090+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731090+0000","last_undegraded":"2023-10-14T12:34:43.731090+0000","last_fullsized":"2023-10-14T12:34:43.731090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733917+0000","last_change":"2023-10-14T12:34:43.733917+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733917+0000","last_undegraded":"2023-10-14T12:34:43.733917+0000","last_fullsized":"2023-10-14T12:34:43.733917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722559+0000","last_change":"2023-10-14T12:34:43.722559+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722559+0000","last_undegraded":"2023-10-14T12:34:43.722559+0000","last_fullsized":"2023-10-14T12:34:43.722559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730237+0000","last_change":"2023-10-14T12:34:43.730237+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730237+0000","last_undegraded":"2023-10-14T12:34:43.730237+0000","last_fullsized":"2023-10-14T12:34:43.730237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728919+0000","last_change":"2023-10-14T12:34:43.728919+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728919+0000","last_undegraded":"2023-10-14T12:34:43.728919+0000","last_fullsized":"2023-10-14T12:34:43.728919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730552+0000","last_change":"2023-10-14T12:34:43.730552+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730552+0000","last_undegraded":"2023-10-14T12:34:43.730552+0000","last_fullsized":"2023-10-14T12:34:43.730552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726622+0000","last_change":"2023-10-14T12:34:43.726622+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726622+0000","last_undegraded":"2023-10-14T12:34:43.726622+0000","last_fullsized":"2023-10-14T12:34:43.726622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731369+0000","last_change":"2023-10-14T12:34:43.731369+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731369+0000","last_undegraded":"2023-10-14T12:34:43.731369+0000","last_fullsized":"2023-10-14T12:34:43.731369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727714+0000","last_change":"2023-10-14T12:34:43.727714+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727714+0000","last_undegraded":"2023-10-14T12:34:43.727714+0000","last_fullsized":"2023-10-14T12:34:43.727714+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.738442+0000","last_change":"2023-10-14T12:34:43.738442+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.738442+0000","last_undegraded":"2023-10-14T12:34:43.738442+0000","last_fullsized":"2023-10-14T12:34:43.738442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725827+0000","last_change":"2023-10-14T12:34:43.725827+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725827+0000","last_undegraded":"2023-10-14T12:34:43.725827+0000","last_fullsized":"2023-10-14T12:34:43.725827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.736133+0000","last_change":"2023-10-14T12:34:43.736133+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.736133+0000","last_undegraded":"2023-10-14T12:34:43.736133+0000","last_fullsized":"2023-10-14T12:34:43.736133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.747085+0000","last_change":"2023-10-14T12:34:43.742439+0000","last_active":"2023-10-14T12:34:43.747085+0000","last_peered":"2023-10-14T12:34:43.747085+0000","last_clean":"2023-10-14T12:34:43.747085+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:34:43.747085+0000","last_undegraded":"2023-10-14T12:34:43.747085+0000","last_fullsized":"2023-10-14T12:34:43.747085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726722+0000","last_change":"2023-10-14T12:34:43.726722+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726722+0000","last_undegraded":"2023-10-14T12:34:43.726722+0000","last_fullsized":"2023-10-14T12:34:43.726722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.741767+0000","last_change":"2023-10-14T12:34:43.740875+0000","last_active":"2023-10-14T12:34:43.741767+0000","last_peered":"2023-10-14T12:34:43.741767+0000","last_clean":"2023-10-14T12:34:43.741767+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:34:43.741767+0000","last_undegraded":"2023-10-14T12:34:43.741767+0000","last_fullsized":"2023-10-14T12:34:43.741767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733603+0000","last_change":"2023-10-14T12:34:43.733603+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733603+0000","last_undegraded":"2023-10-14T12:34:43.733603+0000","last_fullsized":"2023-10-14T12:34:43.733603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740682+0000","last_change":"2023-10-14T12:34:43.737909+0000","last_active":"2023-10-14T12:34:43.740682+0000","last_peered":"2023-10-14T12:34:43.740682+0000","last_clean":"2023-10-14T12:34:43.740682+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:34:43.740682+0000","last_undegraded":"2023-10-14T12:34:43.740682+0000","last_fullsized":"2023-10-14T12:34:43.740682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:58.323321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724904+0000","last_change":"2023-10-14T12:34:43.724904+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724904+0000","last_undegraded":"2023-10-14T12:34:43.724904+0000","last_fullsized":"2023-10-14T12:34:43.724904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742667+0000","last_change":"2023-10-14T12:34:43.738060+0000","last_active":"2023-10-14T12:34:43.742667+0000","last_peered":"2023-10-14T12:34:43.742667+0000","last_clean":"2023-10-14T12:34:43.742667+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:34:43.742667+0000","last_undegraded":"2023-10-14T12:34:43.742667+0000","last_fullsized":"2023-10-14T12:34:43.742667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:05.797624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724345+0000","last_change":"2023-10-14T12:34:43.724345+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724345+0000","last_undegraded":"2023-10-14T12:34:43.724345+0000","last_fullsized":"2023-10-14T12:34:43.724345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.745697+0000","last_change":"2023-10-14T12:34:43.738857+0000","last_active":"2023-10-14T12:34:43.745697+0000","last_peered":"2023-10-14T12:34:43.745697+0000","last_clean":"2023-10-14T12:34:43.745697+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:34:43.745697+0000","last_undegraded":"2023-10-14T12:34:43.745697+0000","last_fullsized":"2023-10-14T12:34:43.745697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727761+0000","last_change":"2023-10-14T12:34:43.727761+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727761+0000","last_undegraded":"2023-10-14T12:34:43.727761+0000","last_fullsized":"2023-10-14T12:34:43.727761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753769+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:43.753769+0000","last_peered":"2023-10-14T12:34:43.753769+0000","last_clean":"2023-10-14T12:34:43.753769+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:43.753769+0000","last_undegraded":"2023-10-14T12:34:43.753769+0000","last_fullsized":"2023-10-14T12:34:43.753769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730609+0000","last_change":"2023-10-14T12:34:43.730609+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730609+0000","last_undegraded":"2023-10-14T12:34:43.730609+0000","last_fullsized":"2023-10-14T12:34:43.730609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740755+0000","last_change":"2023-10-14T12:34:43.738248+0000","last_active":"2023-10-14T12:34:43.740755+0000","last_peered":"2023-10-14T12:34:43.740755+0000","last_clean":"2023-10-14T12:34:43.740755+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:34:43.740755+0000","last_undegraded":"2023-10-14T12:34:43.740755+0000","last_fullsized":"2023-10-14T12:34:43.740755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725594+0000","last_change":"2023-10-14T12:34:43.725594+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725594+0000","last_undegraded":"2023-10-14T12:34:43.725594+0000","last_fullsized":"2023-10-14T12:34:43.725594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742475+0000","last_change":"2023-10-14T12:34:43.737450+0000","last_active":"2023-10-14T12:34:43.742475+0000","last_peered":"2023-10-14T12:34:43.742475+0000","last_clean":"2023-10-14T12:34:43.742475+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:34:43.742475+0000","last_undegraded":"2023-10-14T12:34:43.742475+0000","last_fullsized":"2023-10-14T12:34:43.742475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722903+0000","last_change":"2023-10-14T12:34:43.722903+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722903+0000","last_undegraded":"2023-10-14T12:34:43.722903+0000","last_fullsized":"2023-10-14T12:34:43.722903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.735239+0000","last_change":"2023-10-14T12:34:43.733989+0000","last_active":"2023-10-14T12:34:43.735239+0000","last_peered":"2023-10-14T12:34:43.735239+0000","last_clean":"2023-10-14T12:34:43.735239+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:34:43.735239+0000","last_undegraded":"2023-10-14T12:34:43.735239+0000","last_fullsized":"2023-10-14T12:34:43.735239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:55.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.738155+0000","last_change":"2023-10-14T12:34:43.738155+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.738155+0000","last_undegraded":"2023-10-14T12:34:43.738155+0000","last_fullsized":"2023-10-14T12:34:43.738155+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740478+0000","last_change":"2023-10-14T12:34:43.734905+0000","last_active":"2023-10-14T12:34:43.740478+0000","last_peered":"2023-10-14T12:34:43.740478+0000","last_clean":"2023-10-14T12:34:43.740478+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:34:43.740478+0000","last_undegraded":"2023-10-14T12:34:43.740478+0000","last_fullsized":"2023-10-14T12:34:43.740478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723631+0000","last_change":"2023-10-14T12:34:43.723631+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723631+0000","last_undegraded":"2023-10-14T12:34:43.723631+0000","last_fullsized":"2023-10-14T12:34:43.723631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.743478+0000","last_change":"2023-10-14T12:34:43.735967+0000","last_active":"2023-10-14T12:34:43.743478+0000","last_peered":"2023-10-14T12:34:43.743478+0000","last_clean":"2023-10-14T12:34:43.743478+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:34:43.743478+0000","last_undegraded":"2023-10-14T12:34:43.743478+0000","last_fullsized":"2023-10-14T12:34:43.743478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.729931+0000","last_change":"2023-10-14T12:34:43.729931+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.729931+0000","last_undegraded":"2023-10-14T12:34:43.729931+0000","last_fullsized":"2023-10-14T12:34:43.729931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.741962+0000","last_change":"2023-10-14T12:34:43.741443+0000","last_active":"2023-10-14T12:34:43.741962+0000","last_peered":"2023-10-14T12:34:43.741962+0000","last_clean":"2023-10-14T12:34:43.741962+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:34:43.741962+0000","last_undegraded":"2023-10-14T12:34:43.741962+0000","last_fullsized":"2023-10-14T12:34:43.741962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725130+0000","last_change":"2023-10-14T12:34:43.725130+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725130+0000","last_undegraded":"2023-10-14T12:34:43.725130+0000","last_fullsized":"2023-10-14T12:34:43.725130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740147+0000","last_change":"2023-10-14T12:34:43.738642+0000","last_active":"2023-10-14T12:34:43.740147+0000","last_peered":"2023-10-14T12:34:43.740147+0000","last_clean":"2023-10-14T12:34:43.740147+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:34:43.740147+0000","last_undegraded":"2023-10-14T12:34:43.740147+0000","last_fullsized":"2023-10-14T12:34:43.740147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:21.861042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724284+0000","last_change":"2023-10-14T12:34:43.724284+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724284+0000","last_undegraded":"2023-10-14T12:34:43.724284+0000","last_fullsized":"2023-10-14T12:34:43.724284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740594+0000","last_change":"2023-10-14T12:34:43.738291+0000","last_active":"2023-10-14T12:34:43.740594+0000","last_peered":"2023-10-14T12:34:43.740594+0000","last_clean":"2023-10-14T12:34:43.740594+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:34:43.740594+0000","last_undegraded":"2023-10-14T12:34:43.740594+0000","last_fullsized":"2023-10-14T12:34:43.740594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:27.820010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.736704+0000","last_change":"2023-10-14T12:34:43.736704+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.736704+0000","last_undegraded":"2023-10-14T12:34:43.736704+0000","last_fullsized":"2023-10-14T12:34:43.736704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.746993+0000","last_change":"2023-10-14T12:34:43.742416+0000","last_active":"2023-10-14T12:34:43.746993+0000","last_peered":"2023-10-14T12:34:43.746993+0000","last_clean":"2023-10-14T12:34:43.746993+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:34:43.746993+0000","last_undegraded":"2023-10-14T12:34:43.746993+0000","last_fullsized":"2023-10-14T12:34:43.746993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726426+0000","last_change":"2023-10-14T12:34:43.726426+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726426+0000","last_undegraded":"2023-10-14T12:34:43.726426+0000","last_fullsized":"2023-10-14T12:34:43.726426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753719+0000","last_change":"2023-10-14T12:34:43.745867+0000","last_active":"2023-10-14T12:34:43.753719+0000","last_peered":"2023-10-14T12:34:43.753719+0000","last_clean":"2023-10-14T12:34:43.753719+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:34:43.753719+0000","last_undegraded":"2023-10-14T12:34:43.753719+0000","last_fullsized":"2023-10-14T12:34:43.753719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:58.323321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724608+0000","last_change":"2023-10-14T12:34:43.724608+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724608+0000","last_undegraded":"2023-10-14T12:34:43.724608+0000","last_fullsized":"2023-10-14T12:34:43.724608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.748271+0000","last_change":"2023-10-14T12:34:43.743560+0000","last_active":"2023-10-14T12:34:43.748271+0000","last_peered":"2023-10-14T12:34:43.748271+0000","last_clean":"2023-10-14T12:34:43.748271+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:34:43.748271+0000","last_undegraded":"2023-10-14T12:34:43.748271+0000","last_fullsized":"2023-10-14T12:34:43.748271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:55.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728831+0000","last_change":"2023-10-14T12:34:43.728831+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728831+0000","last_undegraded":"2023-10-14T12:34:43.728831+0000","last_fullsized":"2023-10-14T12:34:43.728831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742565+0000","last_change":"2023-10-14T12:34:43.738033+0000","last_active":"2023-10-14T12:34:43.742565+0000","last_peered":"2023-10-14T12:34:43.742565+0000","last_clean":"2023-10-14T12:34:43.742565+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:34:43.742565+0000","last_undegraded":"2023-10-14T12:34:43.742565+0000","last_fullsized":"2023-10-14T12:34:43.742565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731148+0000","last_change":"2023-10-14T12:34:43.731148+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731148+0000","last_undegraded":"2023-10-14T12:34:43.731148+0000","last_fullsized":"2023-10-14T12:34:43.731148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.745282+0000","last_change":"2023-10-14T12:34:43.744197+0000","last_active":"2023-10-14T12:34:43.745282+0000","last_peered":"2023-10-14T12:34:43.745282+0000","last_clean":"2023-10-14T12:34:43.745282+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:34:43.745282+0000","last_undegraded":"2023-10-14T12:34:43.745282+0000","last_fullsized":"2023-10-14T12:34:43.745282+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:41.521231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723520+0000","last_change":"2023-10-14T12:34:43.723520+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723520+0000","last_undegraded":"2023-10-14T12:34:43.723520+0000","last_fullsized":"2023-10-14T12:34:43.723520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740574+0000","last_change":"2023-10-14T12:34:43.739053+0000","last_active":"2023-10-14T12:34:43.740574+0000","last_peered":"2023-10-14T12:34:43.740574+0000","last_clean":"2023-10-14T12:34:43.740574+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:34:43.740574+0000","last_undegraded":"2023-10-14T12:34:43.740574+0000","last_fullsized":"2023-10-14T12:34:43.740574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:03.125663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733799+0000","last_change":"2023-10-14T12:34:43.733799+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733799+0000","last_undegraded":"2023-10-14T12:34:43.733799+0000","last_fullsized":"2023-10-14T12:34:43.733799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740751+0000","last_change":"2023-10-14T12:34:43.739027+0000","last_active":"2023-10-14T12:34:43.740751+0000","last_peered":"2023-10-14T12:34:43.740751+0000","last_clean":"2023-10-14T12:34:43.740751+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:34:43.740751+0000","last_undegraded":"2023-10-14T12:34:43.740751+0000","last_fullsized":"2023-10-14T12:34:43.740751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:51:35.469703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723958+0000","last_change":"2023-10-14T12:34:43.723958+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723958+0000","last_undegraded":"2023-10-14T12:34:43.723958+0000","last_fullsized":"2023-10-14T12:34:43.723958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740535+0000","last_change":"2023-10-14T12:34:43.739164+0000","last_active":"2023-10-14T12:34:43.740535+0000","last_peered":"2023-10-14T12:34:43.740535+0000","last_clean":"2023-10-14T12:34:43.740535+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:34:43.740535+0000","last_undegraded":"2023-10-14T12:34:43.740535+0000","last_fullsized":"2023-10-14T12:34:43.740535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:03.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726453+0000","last_change":"2023-10-14T12:34:43.726453+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726453+0000","last_undegraded":"2023-10-14T12:34:43.726453+0000","last_fullsized":"2023-10-14T12:34:43.726453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753767+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:43.753767+0000","last_peered":"2023-10-14T12:34:43.753767+0000","last_clean":"2023-10-14T12:34:43.753767+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:43.753767+0000","last_undegraded":"2023-10-14T12:34:43.753767+0000","last_fullsized":"2023-10-14T12:34:43.753767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726031+0000","last_change":"2023-10-14T12:34:43.726031+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726031+0000","last_undegraded":"2023-10-14T12:34:43.726031+0000","last_fullsized":"2023-10-14T12:34:43.726031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740525+0000","last_change":"2023-10-14T12:34:43.737529+0000","last_active":"2023-10-14T12:34:43.740525+0000","last_peered":"2023-10-14T12:34:43.740525+0000","last_clean":"2023-10-14T12:34:43.740525+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:34:43.740525+0000","last_undegraded":"2023-10-14T12:34:43.740525+0000","last_fullsized":"2023-10-14T12:34:43.740525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:22.993010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726282+0000","last_change":"2023-10-14T12:34:43.726282+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726282+0000","last_undegraded":"2023-10-14T12:34:43.726282+0000","last_fullsized":"2023-10-14T12:34:43.726282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740607+0000","last_change":"2023-10-14T12:34:43.735693+0000","last_active":"2023-10-14T12:34:43.740607+0000","last_peered":"2023-10-14T12:34:43.740607+0000","last_clean":"2023-10-14T12:34:43.740607+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:34:43.740607+0000","last_undegraded":"2023-10-14T12:34:43.740607+0000","last_fullsized":"2023-10-14T12:34:43.740607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.737750+0000","last_change":"2023-10-14T12:34:43.737750+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.737750+0000","last_undegraded":"2023-10-14T12:34:43.737750+0000","last_fullsized":"2023-10-14T12:34:43.737750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740007+0000","last_change":"2023-10-14T12:34:43.735820+0000","last_active":"2023-10-14T12:34:43.740007+0000","last_peered":"2023-10-14T12:34:43.740007+0000","last_clean":"2023-10-14T12:34:43.740007+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:34:43.740007+0000","last_undegraded":"2023-10-14T12:34:43.740007+0000","last_fullsized":"2023-10-14T12:34:43.740007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:27.870090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724257+0000","last_change":"2023-10-14T12:34:43.724257+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724257+0000","last_undegraded":"2023-10-14T12:34:43.724257+0000","last_fullsized":"2023-10-14T12:34:43.724257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.739633+0000","last_change":"2023-10-14T12:34:43.736834+0000","last_active":"2023-10-14T12:34:43.739633+0000","last_peered":"2023-10-14T12:34:43.739633+0000","last_clean":"2023-10-14T12:34:43.739633+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:34:43.739633+0000","last_undegraded":"2023-10-14T12:34:43.739633+0000","last_fullsized":"2023-10-14T12:34:43.739633+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:03.125663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724745+0000","last_change":"2023-10-14T12:34:43.724745+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724745+0000","last_undegraded":"2023-10-14T12:34:43.724745+0000","last_fullsized":"2023-10-14T12:34:43.724745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740502+0000","last_change":"2023-10-14T12:34:43.737030+0000","last_active":"2023-10-14T12:34:43.740502+0000","last_peered":"2023-10-14T12:34:43.740502+0000","last_clean":"2023-10-14T12:34:43.740502+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:34:43.740502+0000","last_undegraded":"2023-10-14T12:34:43.740502+0000","last_fullsized":"2023-10-14T12:34:43.740502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728018+0000","last_change":"2023-10-14T12:34:43.728018+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728018+0000","last_undegraded":"2023-10-14T12:34:43.728018+0000","last_fullsized":"2023-10-14T12:34:43.728018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.744699+0000","last_change":"2023-10-14T12:34:43.740716+0000","last_active":"2023-10-14T12:34:43.744699+0000","last_peered":"2023-10-14T12:34:43.744699+0000","last_clean":"2023-10-14T12:34:43.744699+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:34:43.744699+0000","last_undegraded":"2023-10-14T12:34:43.744699+0000","last_fullsized":"2023-10-14T12:34:43.744699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:05.797624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728840+0000","last_change":"2023-10-14T12:34:43.728840+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728840+0000","last_undegraded":"2023-10-14T12:34:43.728840+0000","last_fullsized":"2023-10-14T12:34:43.728840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742661+0000","last_change":"2023-10-14T12:34:43.738818+0000","last_active":"2023-10-14T12:34:43.742661+0000","last_peered":"2023-10-14T12:34:43.742661+0000","last_clean":"2023-10-14T12:34:43.742661+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:34:43.742661+0000","last_undegraded":"2023-10-14T12:34:43.742661+0000","last_fullsized":"2023-10-14T12:34:43.742661+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:09.474609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.735443+0000","last_change":"2023-10-14T12:34:43.735443+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.735443+0000","last_undegraded":"2023-10-14T12:34:43.735443+0000","last_fullsized":"2023-10-14T12:34:43.735443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.734046+0000","last_change":"2023-10-14T12:34:43.733187+0000","last_active":"2023-10-14T12:34:43.734046+0000","last_peered":"2023-10-14T12:34:43.734046+0000","last_clean":"2023-10-14T12:34:43.734046+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:34:43.734046+0000","last_undegraded":"2023-10-14T12:34:43.734046+0000","last_fullsized":"2023-10-14T12:34:43.734046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728733+0000","last_change":"2023-10-14T12:34:43.728733+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728733+0000","last_undegraded":"2023-10-14T12:34:43.728733+0000","last_fullsized":"2023-10-14T12:34:43.728733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.748395+0000","last_change":"2023-10-14T12:34:43.744939+0000","last_active":"2023-10-14T12:34:43.748395+0000","last_peered":"2023-10-14T12:34:43.748395+0000","last_clean":"2023-10-14T12:34:43.748395+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:34:43.748395+0000","last_undegraded":"2023-10-14T12:34:43.748395+0000","last_fullsized":"2023-10-14T12:34:43.748395+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T12:34:42.726034+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:34:42.726034+0000","last_peered":"2023-10-14T12:34:42.726034+0000","last_clean":"2023-10-14T12:34:42.726034+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:34:42.726034+0000","last_undegraded":"2023-10-14T12:34:42.726034+0000","last_fullsized":"2023-10-14T12:34:42.726034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":765854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.63200000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.432},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.66400000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.623}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.441},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.35899999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.376},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39200000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.501}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":168876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.371},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":765854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.26100000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.315},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.438}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.30099999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.32300000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.377},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.626}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.52300000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":168876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.629}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.379}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:34:48.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:34:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.013+0000 7fc92c976700 1 Processor -- start 2023-10-14T12:34:49.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.014+0000 7fc92c976700 1 -- start start 2023-10-14T12:34:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc92c976700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc92815e7f0 0x7fc928071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc92c976700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9280cfeb0 con 0x7fc9280cf7d0 2023-10-14T12:34:49.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc92c976700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9280cfc30 con 0x7fc92806a820 2023-10-14T12:34:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc92c976700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9280ce410 con 0x7fc92815e7f0 2023-10-14T12:34:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc926d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc92815e7f0 0x7fc928071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc925d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc9280cf7d0 0x7fc9280ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55016/0 (socket says 172.21.15.72:55016) 2023-10-14T12:34:49.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc925d9b700 1 -- 172.21.15.72:0/3013652457 learned_addr learned my addr 172.21.15.72:0/3013652457 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc926d9d700 1 -- 172.21.15.72:0/3013652457 >> v1:172.21.15.123:6789/0 conn(0x7fc92806a820 legacy=0x7fc92806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc926d9d700 1 -- 172.21.15.72:0/3013652457 >> v1:172.21.15.72:6789/0 conn(0x7fc9280cf7d0 legacy=0x7fc9280ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc92559a700 1 -- 172.21.15.72:0/3013652457 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175408215 0 0) 0x7fc9280cfeb0 con 0x7fc9280cf7d0 2023-10-14T12:34:49.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc926d9d700 1 -- 172.21.15.72:0/3013652457 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9280af9d0 con 0x7fc92815e7f0 2023-10-14T12:34:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc926d9d700 1 --2- 172.21.15.72:0/3013652457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92815e7f0 0x7fc928071ea0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc920009d90 tx=0x7fc92000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8453c904a017bc14 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc92559a700 1 -- 172.21.15.72:0/3013652457 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92000e070 con 0x7fc92815e7f0 2023-10-14T12:34:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc92559a700 1 -- 172.21.15.72:0/3013652457 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92000bbd0 con 0x7fc92815e7f0 2023-10-14T12:34:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.015+0000 7fc92559a700 1 -- 172.21.15.72:0/3013652457 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920003a70 con 0x7fc92815e7f0 2023-10-14T12:34:49.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.016+0000 7fc92c976700 1 -- 172.21.15.72:0/3013652457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92815e7f0 msgr2=0x7fc928071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.016+0000 7fc92c976700 1 --2- 172.21.15.72:0/3013652457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92815e7f0 0x7fc928071ea0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc920009d90 tx=0x7fc92000b330 comp rx=0 tx=0).stop 2023-10-14T12:34:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.016+0000 7fc92c976700 1 -- 172.21.15.72:0/3013652457 shutdown_connections 2023-10-14T12:34:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.016+0000 7fc92c976700 1 --2- 172.21.15.72:0/3013652457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92815e7f0 0x7fc928071ea0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.016+0000 7fc92c976700 1 -- 172.21.15.72:0/3013652457 >> 172.21.15.72:0/3013652457 conn(0x7fc9280d0180 msgr2=0x7fc9280d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:49.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.016+0000 7fc92c976700 1 -- 172.21.15.72:0/3013652457 shutdown_connections 2023-10-14T12:34:49.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.016+0000 7fc92c976700 1 -- 172.21.15.72:0/3013652457 wait complete. 2023-10-14T12:34:49.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.017+0000 7fc92c976700 1 Processor -- start 2023-10-14T12:34:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.017+0000 7fc92c976700 1 -- start start 2023-10-14T12:34:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92c976700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92806a820 0x7fc92814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92c976700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9280cf7d0 0x7fc928161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92c976700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc92815e7f0 0x7fc9280afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92c976700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280b2b00 con 0x7fc92806a820 2023-10-14T12:34:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92c976700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc928160dd0 con 0x7fc92815e7f0 2023-10-14T12:34:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92c976700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9280b2540 con 0x7fc9280cf7d0 2023-10-14T12:34:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92806a820 0x7fc92814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92806a820 0x7fc92814a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48720/0 (socket says 172.21.15.72:48720) 2023-10-14T12:34:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92659c700 1 -- 172.21.15.72:0/1525778416 learned_addr learned my addr 172.21.15.72:0/1525778416 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc926d9d700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc92815e7f0 0x7fc9280afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc925d9b700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9280cf7d0 0x7fc928161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92659c700 1 -- 172.21.15.72:0/1525778416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9280cf7d0 msgr2=0x7fc928161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92659c700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9280cf7d0 0x7fc928161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92659c700 1 -- 172.21.15.72:0/1525778416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc92815e7f0 msgr2=0x7fc9280afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.018+0000 7fc92659c700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc92815e7f0 0x7fc9280afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.019+0000 7fc92659c700 1 -- 172.21.15.72:0/1525778416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc920009a70 con 0x7fc92806a820 2023-10-14T12:34:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.019+0000 7fc925d9b700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9280cf7d0 0x7fc928161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:49.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.019+0000 7fc92659c700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92806a820 0x7fc92814a170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00c500 tx=0x7fc91c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.019+0000 7fc916ffd700 1 -- 172.21.15.72:0/1525778416 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011790 con 0x7fc92806a820 2023-10-14T12:34:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.019+0000 7fc916ffd700 1 -- 172.21.15.72:0/1525778416 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c0118f0 con 0x7fc92806a820 2023-10-14T12:34:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.019+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9280b2820 con 0x7fc92806a820 2023-10-14T12:34:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.019+0000 7fc916ffd700 1 -- 172.21.15.72:0/1525778416 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c011ca0 con 0x7fc92806a820 2023-10-14T12:34:49.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.019+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9281617a0 con 0x7fc92806a820 2023-10-14T12:34:49.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.020+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc928161930 con 0x7fc92806a820 2023-10-14T12:34:49.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.020+0000 7fc916ffd700 1 -- 172.21.15.72:0/1525778416 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc91c01c460 con 0x7fc92806a820 2023-10-14T12:34:49.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.021+0000 7fc916ffd700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc90806af00 0x7fc90806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.021+0000 7fc916ffd700 1 -- 172.21.15.72:0/1525778416 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fc91c0894e0 con 0x7fc92806a820 2023-10-14T12:34:49.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.021+0000 7fc925d9b700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc90806af00 0x7fc90806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.021+0000 7fc925d9b700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc90806af00 0x7fc90806d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc9280c3c00 tx=0x7fc918009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:49.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.025+0000 7fc916ffd700 1 -- 172.21.15.72:0/1525778416 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc91c0544c0 con 0x7fc92806a820 2023-10-14T12:34:49.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.210+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc92815ec40 con 0x7fc90806af00 2023-10-14T12:34:49.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.217+0000 7fc916ffd700 1 -- 172.21.15.72:0/1525778416 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283481 (secure 0 0 0) 0x7fc918001cc0 con 0x7fc90806af00 2023-10-14T12:34:49.222 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:49.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc90806af00 msgr2=0x7fc90806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc90806af00 0x7fc90806d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc9280c3c00 tx=0x7fc918009040 comp rx=0 tx=0).stop 2023-10-14T12:34:49.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92806a820 msgr2=0x7fc92814a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92806a820 0x7fc92814a170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00c500 tx=0x7fc91c00c8c0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 shutdown_connections 2023-10-14T12:34:49.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc90806af00 0x7fc90806d3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc92815e7f0 0x7fc9280afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc92806a820 0x7fc92814a170 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 --2- 172.21.15.72:0/1525778416 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc9280cf7d0 0x7fc928161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.220+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 >> 172.21.15.72:0/1525778416 conn(0x7fc9280d0180 msgr2=0x7fc92806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:49.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.221+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 shutdown_connections 2023-10-14T12:34:49.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.221+0000 7fc92c976700 1 -- 172.21.15.72:0/1525778416 wait complete. 2023-10-14T12:34:49.230 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:34:49.234 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-10-14T12:34:47.400533+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220536,"kb_used_data":4368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754184,"statfs":{"total":773094113280,"available":772868284416,"internally_reserved":0,"allocated":4472832,"data_stored":2571404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.683928"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726871+0000","last_change":"2023-10-14T12:34:43.726871+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726871+0000","last_undegraded":"2023-10-14T12:34:43.726871+0000","last_fullsized":"2023-10-14T12:34:43.726871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724752+0000","last_change":"2023-10-14T12:34:43.724752+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724752+0000","last_undegraded":"2023-10-14T12:34:43.724752+0000","last_fullsized":"2023-10-14T12:34:43.724752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724202+0000","last_change":"2023-10-14T12:34:43.724202+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724202+0000","last_undegraded":"2023-10-14T12:34:43.724202+0000","last_fullsized":"2023-10-14T12:34:43.724202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723472+0000","last_change":"2023-10-14T12:34:43.723472+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723472+0000","last_undegraded":"2023-10-14T12:34:43.723472+0000","last_fullsized":"2023-10-14T12:34:43.723472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724099+0000","last_change":"2023-10-14T12:34:43.724099+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724099+0000","last_undegraded":"2023-10-14T12:34:43.724099+0000","last_fullsized":"2023-10-14T12:34:43.724099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726733+0000","last_change":"2023-10-14T12:34:43.726733+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726733+0000","last_undegraded":"2023-10-14T12:34:43.726733+0000","last_fullsized":"2023-10-14T12:34:43.726733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727120+0000","last_change":"2023-10-14T12:34:43.727120+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727120+0000","last_undegraded":"2023-10-14T12:34:43.727120+0000","last_fullsized":"2023-10-14T12:34:43.727120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725833+0000","last_change":"2023-10-14T12:34:43.725833+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725833+0000","last_undegraded":"2023-10-14T12:34:43.725833+0000","last_fullsized":"2023-10-14T12:34:43.725833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723760+0000","last_change":"2023-10-14T12:34:43.723760+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723760+0000","last_undegraded":"2023-10-14T12:34:43.723760+0000","last_fullsized":"2023-10-14T12:34:43.723760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727666+0000","last_change":"2023-10-14T12:34:43.727666+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727666+0000","last_undegraded":"2023-10-14T12:34:43.727666+0000","last_fullsized":"2023-10-14T12:34:43.727666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728346+0000","last_change":"2023-10-14T12:34:43.728346+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728346+0000","last_undegraded":"2023-10-14T12:34:43.728346+0000","last_fullsized":"2023-10-14T12:34:43.728346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723075+0000","last_change":"2023-10-14T12:34:43.723075+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723075+0000","last_undegraded":"2023-10-14T12:34:43.723075+0000","last_fullsized":"2023-10-14T12:34:43.723075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728011+0000","last_change":"2023-10-14T12:34:43.728011+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728011+0000","last_undegraded":"2023-10-14T12:34:43.728011+0000","last_fullsized":"2023-10-14T12:34:43.728011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731771+0000","last_change":"2023-10-14T12:34:43.731771+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731771+0000","last_undegraded":"2023-10-14T12:34:43.731771+0000","last_fullsized":"2023-10-14T12:34:43.731771+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.729162+0000","last_change":"2023-10-14T12:34:43.729162+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.729162+0000","last_undegraded":"2023-10-14T12:34:43.729162+0000","last_fullsized":"2023-10-14T12:34:43.729162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.734826+0000","last_change":"2023-10-14T12:34:43.734826+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.734826+0000","last_undegraded":"2023-10-14T12:34:43.734826+0000","last_fullsized":"2023-10-14T12:34:43.734826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.737373+0000","last_change":"2023-10-14T12:34:43.737373+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.737373+0000","last_undegraded":"2023-10-14T12:34:43.737373+0000","last_fullsized":"2023-10-14T12:34:43.737373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.732827+0000","last_change":"2023-10-14T12:34:43.732827+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.732827+0000","last_undegraded":"2023-10-14T12:34:43.732827+0000","last_fullsized":"2023-10-14T12:34:43.732827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722586+0000","last_change":"2023-10-14T12:34:43.722586+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722586+0000","last_undegraded":"2023-10-14T12:34:43.722586+0000","last_fullsized":"2023-10-14T12:34:43.722586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.732974+0000","last_change":"2023-10-14T12:34:43.732974+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.732974+0000","last_undegraded":"2023-10-14T12:34:43.732974+0000","last_fullsized":"2023-10-14T12:34:43.732974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727552+0000","last_change":"2023-10-14T12:34:43.727552+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727552+0000","last_undegraded":"2023-10-14T12:34:43.727552+0000","last_fullsized":"2023-10-14T12:34:43.727552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731090+0000","last_change":"2023-10-14T12:34:43.731090+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731090+0000","last_undegraded":"2023-10-14T12:34:43.731090+0000","last_fullsized":"2023-10-14T12:34:43.731090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733917+0000","last_change":"2023-10-14T12:34:43.733917+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733917+0000","last_undegraded":"2023-10-14T12:34:43.733917+0000","last_fullsized":"2023-10-14T12:34:43.733917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722559+0000","last_change":"2023-10-14T12:34:43.722559+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722559+0000","last_undegraded":"2023-10-14T12:34:43.722559+0000","last_fullsized":"2023-10-14T12:34:43.722559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730237+0000","last_change":"2023-10-14T12:34:43.730237+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730237+0000","last_undegraded":"2023-10-14T12:34:43.730237+0000","last_fullsized":"2023-10-14T12:34:43.730237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728919+0000","last_change":"2023-10-14T12:34:43.728919+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728919+0000","last_undegraded":"2023-10-14T12:34:43.728919+0000","last_fullsized":"2023-10-14T12:34:43.728919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730552+0000","last_change":"2023-10-14T12:34:43.730552+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730552+0000","last_undegraded":"2023-10-14T12:34:43.730552+0000","last_fullsized":"2023-10-14T12:34:43.730552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726622+0000","last_change":"2023-10-14T12:34:43.726622+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726622+0000","last_undegraded":"2023-10-14T12:34:43.726622+0000","last_fullsized":"2023-10-14T12:34:43.726622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731369+0000","last_change":"2023-10-14T12:34:43.731369+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731369+0000","last_undegraded":"2023-10-14T12:34:43.731369+0000","last_fullsized":"2023-10-14T12:34:43.731369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727714+0000","last_change":"2023-10-14T12:34:43.727714+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727714+0000","last_undegraded":"2023-10-14T12:34:43.727714+0000","last_fullsized":"2023-10-14T12:34:43.727714+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.738442+0000","last_change":"2023-10-14T12:34:43.738442+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.738442+0000","last_undegraded":"2023-10-14T12:34:43.738442+0000","last_fullsized":"2023-10-14T12:34:43.738442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725827+0000","last_change":"2023-10-14T12:34:43.725827+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725827+0000","last_undegraded":"2023-10-14T12:34:43.725827+0000","last_fullsized":"2023-10-14T12:34:43.725827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.736133+0000","last_change":"2023-10-14T12:34:43.736133+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.736133+0000","last_undegraded":"2023-10-14T12:34:43.736133+0000","last_fullsized":"2023-10-14T12:34:43.736133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.747085+0000","last_change":"2023-10-14T12:34:43.742439+0000","last_active":"2023-10-14T12:34:43.747085+0000","last_peered":"2023-10-14T12:34:43.747085+0000","last_clean":"2023-10-14T12:34:43.747085+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:34:43.747085+0000","last_undegraded":"2023-10-14T12:34:43.747085+0000","last_fullsized":"2023-10-14T12:34:43.747085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726722+0000","last_change":"2023-10-14T12:34:43.726722+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726722+0000","last_undegraded":"2023-10-14T12:34:43.726722+0000","last_fullsized":"2023-10-14T12:34:43.726722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.741767+0000","last_change":"2023-10-14T12:34:43.740875+0000","last_active":"2023-10-14T12:34:43.741767+0000","last_peered":"2023-10-14T12:34:43.741767+0000","last_clean":"2023-10-14T12:34:43.741767+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:34:43.741767+0000","last_undegraded":"2023-10-14T12:34:43.741767+0000","last_fullsized":"2023-10-14T12:34:43.741767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733603+0000","last_change":"2023-10-14T12:34:43.733603+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733603+0000","last_undegraded":"2023-10-14T12:34:43.733603+0000","last_fullsized":"2023-10-14T12:34:43.733603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740682+0000","last_change":"2023-10-14T12:34:43.737909+0000","last_active":"2023-10-14T12:34:43.740682+0000","last_peered":"2023-10-14T12:34:43.740682+0000","last_clean":"2023-10-14T12:34:43.740682+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:34:43.740682+0000","last_undegraded":"2023-10-14T12:34:43.740682+0000","last_fullsized":"2023-10-14T12:34:43.740682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:58.323321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724904+0000","last_change":"2023-10-14T12:34:43.724904+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724904+0000","last_undegraded":"2023-10-14T12:34:43.724904+0000","last_fullsized":"2023-10-14T12:34:43.724904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742667+0000","last_change":"2023-10-14T12:34:43.738060+0000","last_active":"2023-10-14T12:34:43.742667+0000","last_peered":"2023-10-14T12:34:43.742667+0000","last_clean":"2023-10-14T12:34:43.742667+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:34:43.742667+0000","last_undegraded":"2023-10-14T12:34:43.742667+0000","last_fullsized":"2023-10-14T12:34:43.742667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:05.797624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724345+0000","last_change":"2023-10-14T12:34:43.724345+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724345+0000","last_undegraded":"2023-10-14T12:34:43.724345+0000","last_fullsized":"2023-10-14T12:34:43.724345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.745697+0000","last_change":"2023-10-14T12:34:43.738857+0000","last_active":"2023-10-14T12:34:43.745697+0000","last_peered":"2023-10-14T12:34:43.745697+0000","last_clean":"2023-10-14T12:34:43.745697+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:34:43.745697+0000","last_undegraded":"2023-10-14T12:34:43.745697+0000","last_fullsized":"2023-10-14T12:34:43.745697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727761+0000","last_change":"2023-10-14T12:34:43.727761+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727761+0000","last_undegraded":"2023-10-14T12:34:43.727761+0000","last_fullsized":"2023-10-14T12:34:43.727761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753769+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:43.753769+0000","last_peered":"2023-10-14T12:34:43.753769+0000","last_clean":"2023-10-14T12:34:43.753769+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:43.753769+0000","last_undegraded":"2023-10-14T12:34:43.753769+0000","last_fullsized":"2023-10-14T12:34:43.753769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730609+0000","last_change":"2023-10-14T12:34:43.730609+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730609+0000","last_undegraded":"2023-10-14T12:34:43.730609+0000","last_fullsized":"2023-10-14T12:34:43.730609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740755+0000","last_change":"2023-10-14T12:34:43.738248+0000","last_active":"2023-10-14T12:34:43.740755+0000","last_peered":"2023-10-14T12:34:43.740755+0000","last_clean":"2023-10-14T12:34:43.740755+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:34:43.740755+0000","last_undegraded":"2023-10-14T12:34:43.740755+0000","last_fullsized":"2023-10-14T12:34:43.740755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725594+0000","last_change":"2023-10-14T12:34:43.725594+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725594+0000","last_undegraded":"2023-10-14T12:34:43.725594+0000","last_fullsized":"2023-10-14T12:34:43.725594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742475+0000","last_change":"2023-10-14T12:34:43.737450+0000","last_active":"2023-10-14T12:34:43.742475+0000","last_peered":"2023-10-14T12:34:43.742475+0000","last_clean":"2023-10-14T12:34:43.742475+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:34:43.742475+0000","last_undegraded":"2023-10-14T12:34:43.742475+0000","last_fullsized":"2023-10-14T12:34:43.742475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722903+0000","last_change":"2023-10-14T12:34:43.722903+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722903+0000","last_undegraded":"2023-10-14T12:34:43.722903+0000","last_fullsized":"2023-10-14T12:34:43.722903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.735239+0000","last_change":"2023-10-14T12:34:43.733989+0000","last_active":"2023-10-14T12:34:43.735239+0000","last_peered":"2023-10-14T12:34:43.735239+0000","last_clean":"2023-10-14T12:34:43.735239+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:34:43.735239+0000","last_undegraded":"2023-10-14T12:34:43.735239+0000","last_fullsized":"2023-10-14T12:34:43.735239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:55.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.738155+0000","last_change":"2023-10-14T12:34:43.738155+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.738155+0000","last_undegraded":"2023-10-14T12:34:43.738155+0000","last_fullsized":"2023-10-14T12:34:43.738155+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740478+0000","last_change":"2023-10-14T12:34:43.734905+0000","last_active":"2023-10-14T12:34:43.740478+0000","last_peered":"2023-10-14T12:34:43.740478+0000","last_clean":"2023-10-14T12:34:43.740478+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:34:43.740478+0000","last_undegraded":"2023-10-14T12:34:43.740478+0000","last_fullsized":"2023-10-14T12:34:43.740478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723631+0000","last_change":"2023-10-14T12:34:43.723631+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723631+0000","last_undegraded":"2023-10-14T12:34:43.723631+0000","last_fullsized":"2023-10-14T12:34:43.723631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.743478+0000","last_change":"2023-10-14T12:34:43.735967+0000","last_active":"2023-10-14T12:34:43.743478+0000","last_peered":"2023-10-14T12:34:43.743478+0000","last_clean":"2023-10-14T12:34:43.743478+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:34:43.743478+0000","last_undegraded":"2023-10-14T12:34:43.743478+0000","last_fullsized":"2023-10-14T12:34:43.743478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.729931+0000","last_change":"2023-10-14T12:34:43.729931+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.729931+0000","last_undegraded":"2023-10-14T12:34:43.729931+0000","last_fullsized":"2023-10-14T12:34:43.729931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.741962+0000","last_change":"2023-10-14T12:34:43.741443+0000","last_active":"2023-10-14T12:34:43.741962+0000","last_peered":"2023-10-14T12:34:43.741962+0000","last_clean":"2023-10-14T12:34:43.741962+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:34:43.741962+0000","last_undegraded":"2023-10-14T12:34:43.741962+0000","last_fullsized":"2023-10-14T12:34:43.741962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725130+0000","last_change":"2023-10-14T12:34:43.725130+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725130+0000","last_undegraded":"2023-10-14T12:34:43.725130+0000","last_fullsized":"2023-10-14T12:34:43.725130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740147+0000","last_change":"2023-10-14T12:34:43.738642+0000","last_active":"2023-10-14T12:34:43.740147+0000","last_peered":"2023-10-14T12:34:43.740147+0000","last_clean":"2023-10-14T12:34:43.740147+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:34:43.740147+0000","last_undegraded":"2023-10-14T12:34:43.740147+0000","last_fullsized":"2023-10-14T12:34:43.740147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:21.861042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724284+0000","last_change":"2023-10-14T12:34:43.724284+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724284+0000","last_undegraded":"2023-10-14T12:34:43.724284+0000","last_fullsized":"2023-10-14T12:34:43.724284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740594+0000","last_change":"2023-10-14T12:34:43.738291+0000","last_active":"2023-10-14T12:34:43.740594+0000","last_peered":"2023-10-14T12:34:43.740594+0000","last_clean":"2023-10-14T12:34:43.740594+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:34:43.740594+0000","last_undegraded":"2023-10-14T12:34:43.740594+0000","last_fullsized":"2023-10-14T12:34:43.740594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:27.820010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.736704+0000","last_change":"2023-10-14T12:34:43.736704+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.736704+0000","last_undegraded":"2023-10-14T12:34:43.736704+0000","last_fullsized":"2023-10-14T12:34:43.736704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.746993+0000","last_change":"2023-10-14T12:34:43.742416+0000","last_active":"2023-10-14T12:34:43.746993+0000","last_peered":"2023-10-14T12:34:43.746993+0000","last_clean":"2023-10-14T12:34:43.746993+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:34:43.746993+0000","last_undegraded":"2023-10-14T12:34:43.746993+0000","last_fullsized":"2023-10-14T12:34:43.746993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726426+0000","last_change":"2023-10-14T12:34:43.726426+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726426+0000","last_undegraded":"2023-10-14T12:34:43.726426+0000","last_fullsized":"2023-10-14T12:34:43.726426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753719+0000","last_change":"2023-10-14T12:34:43.745867+0000","last_active":"2023-10-14T12:34:43.753719+0000","last_peered":"2023-10-14T12:34:43.753719+0000","last_clean":"2023-10-14T12:34:43.753719+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:34:43.753719+0000","last_undegraded":"2023-10-14T12:34:43.753719+0000","last_fullsized":"2023-10-14T12:34:43.753719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:58.323321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724608+0000","last_change":"2023-10-14T12:34:43.724608+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724608+0000","last_undegraded":"2023-10-14T12:34:43.724608+0000","last_fullsized":"2023-10-14T12:34:43.724608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.748271+0000","last_change":"2023-10-14T12:34:43.743560+0000","last_active":"2023-10-14T12:34:43.748271+0000","last_peered":"2023-10-14T12:34:43.748271+0000","last_clean":"2023-10-14T12:34:43.748271+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:34:43.748271+0000","last_undegraded":"2023-10-14T12:34:43.748271+0000","last_fullsized":"2023-10-14T12:34:43.748271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:55.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728831+0000","last_change":"2023-10-14T12:34:43.728831+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728831+0000","last_undegraded":"2023-10-14T12:34:43.728831+0000","last_fullsized":"2023-10-14T12:34:43.728831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742565+0000","last_change":"2023-10-14T12:34:43.738033+0000","last_active":"2023-10-14T12:34:43.742565+0000","last_peered":"2023-10-14T12:34:43.742565+0000","last_clean":"2023-10-14T12:34:43.742565+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:34:43.742565+0000","last_undegraded":"2023-10-14T12:34:43.742565+0000","last_fullsized":"2023-10-14T12:34:43.742565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731148+0000","last_change":"2023-10-14T12:34:43.731148+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731148+0000","last_undegraded":"2023-10-14T12:34:43.731148+0000","last_fullsized":"2023-10-14T12:34:43.731148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.745282+0000","last_change":"2023-10-14T12:34:43.744197+0000","last_active":"2023-10-14T12:34:43.745282+0000","last_peered":"2023-10-14T12:34:43.745282+0000","last_clean":"2023-10-14T12:34:43.745282+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:34:43.745282+0000","last_undegraded":"2023-10-14T12:34:43.745282+0000","last_fullsized":"2023-10-14T12:34:43.745282+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:41.521231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723520+0000","last_change":"2023-10-14T12:34:43.723520+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723520+0000","last_undegraded":"2023-10-14T12:34:43.723520+0000","last_fullsized":"2023-10-14T12:34:43.723520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740574+0000","last_change":"2023-10-14T12:34:43.739053+0000","last_active":"2023-10-14T12:34:43.740574+0000","last_peered":"2023-10-14T12:34:43.740574+0000","last_clean":"2023-10-14T12:34:43.740574+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:34:43.740574+0000","last_undegraded":"2023-10-14T12:34:43.740574+0000","last_fullsized":"2023-10-14T12:34:43.740574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:03.125663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733799+0000","last_change":"2023-10-14T12:34:43.733799+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733799+0000","last_undegraded":"2023-10-14T12:34:43.733799+0000","last_fullsized":"2023-10-14T12:34:43.733799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740751+0000","last_change":"2023-10-14T12:34:43.739027+0000","last_active":"2023-10-14T12:34:43.740751+0000","last_peered":"2023-10-14T12:34:43.740751+0000","last_clean":"2023-10-14T12:34:43.740751+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:34:43.740751+0000","last_undegraded":"2023-10-14T12:34:43.740751+0000","last_fullsized":"2023-10-14T12:34:43.740751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:51:35.469703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723958+0000","last_change":"2023-10-14T12:34:43.723958+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723958+0000","last_undegraded":"2023-10-14T12:34:43.723958+0000","last_fullsized":"2023-10-14T12:34:43.723958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740535+0000","last_change":"2023-10-14T12:34:43.739164+0000","last_active":"2023-10-14T12:34:43.740535+0000","last_peered":"2023-10-14T12:34:43.740535+0000","last_clean":"2023-10-14T12:34:43.740535+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:34:43.740535+0000","last_undegraded":"2023-10-14T12:34:43.740535+0000","last_fullsized":"2023-10-14T12:34:43.740535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:03.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726453+0000","last_change":"2023-10-14T12:34:43.726453+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726453+0000","last_undegraded":"2023-10-14T12:34:43.726453+0000","last_fullsized":"2023-10-14T12:34:43.726453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753767+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:43.753767+0000","last_peered":"2023-10-14T12:34:43.753767+0000","last_clean":"2023-10-14T12:34:43.753767+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:43.753767+0000","last_undegraded":"2023-10-14T12:34:43.753767+0000","last_fullsized":"2023-10-14T12:34:43.753767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726031+0000","last_change":"2023-10-14T12:34:43.726031+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726031+0000","last_undegraded":"2023-10-14T12:34:43.726031+0000","last_fullsized":"2023-10-14T12:34:43.726031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740525+0000","last_change":"2023-10-14T12:34:43.737529+0000","last_active":"2023-10-14T12:34:43.740525+0000","last_peered":"2023-10-14T12:34:43.740525+0000","last_clean":"2023-10-14T12:34:43.740525+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:34:43.740525+0000","last_undegraded":"2023-10-14T12:34:43.740525+0000","last_fullsized":"2023-10-14T12:34:43.740525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:22.993010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726282+0000","last_change":"2023-10-14T12:34:43.726282+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726282+0000","last_undegraded":"2023-10-14T12:34:43.726282+0000","last_fullsized":"2023-10-14T12:34:43.726282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740607+0000","last_change":"2023-10-14T12:34:43.735693+0000","last_active":"2023-10-14T12:34:43.740607+0000","last_peered":"2023-10-14T12:34:43.740607+0000","last_clean":"2023-10-14T12:34:43.740607+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:34:43.740607+0000","last_undegraded":"2023-10-14T12:34:43.740607+0000","last_fullsized":"2023-10-14T12:34:43.740607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.737750+0000","last_change":"2023-10-14T12:34:43.737750+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.737750+0000","last_undegraded":"2023-10-14T12:34:43.737750+0000","last_fullsized":"2023-10-14T12:34:43.737750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740007+0000","last_change":"2023-10-14T12:34:43.735820+0000","last_active":"2023-10-14T12:34:43.740007+0000","last_peered":"2023-10-14T12:34:43.740007+0000","last_clean":"2023-10-14T12:34:43.740007+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:34:43.740007+0000","last_undegraded":"2023-10-14T12:34:43.740007+0000","last_fullsized":"2023-10-14T12:34:43.740007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:27.870090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724257+0000","last_change":"2023-10-14T12:34:43.724257+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724257+0000","last_undegraded":"2023-10-14T12:34:43.724257+0000","last_fullsized":"2023-10-14T12:34:43.724257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.739633+0000","last_change":"2023-10-14T12:34:43.736834+0000","last_active":"2023-10-14T12:34:43.739633+0000","last_peered":"2023-10-14T12:34:43.739633+0000","last_clean":"2023-10-14T12:34:43.739633+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:34:43.739633+0000","last_undegraded":"2023-10-14T12:34:43.739633+0000","last_fullsized":"2023-10-14T12:34:43.739633+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:03.125663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724745+0000","last_change":"2023-10-14T12:34:43.724745+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724745+0000","last_undegraded":"2023-10-14T12:34:43.724745+0000","last_fullsized":"2023-10-14T12:34:43.724745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740502+0000","last_change":"2023-10-14T12:34:43.737030+0000","last_active":"2023-10-14T12:34:43.740502+0000","last_peered":"2023-10-14T12:34:43.740502+0000","last_clean":"2023-10-14T12:34:43.740502+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:34:43.740502+0000","last_undegraded":"2023-10-14T12:34:43.740502+0000","last_fullsized":"2023-10-14T12:34:43.740502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728018+0000","last_change":"2023-10-14T12:34:43.728018+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728018+0000","last_undegraded":"2023-10-14T12:34:43.728018+0000","last_fullsized":"2023-10-14T12:34:43.728018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.744699+0000","last_change":"2023-10-14T12:34:43.740716+0000","last_active":"2023-10-14T12:34:43.744699+0000","last_peered":"2023-10-14T12:34:43.744699+0000","last_clean":"2023-10-14T12:34:43.744699+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:34:43.744699+0000","last_undegraded":"2023-10-14T12:34:43.744699+0000","last_fullsized":"2023-10-14T12:34:43.744699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:05.797624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728840+0000","last_change":"2023-10-14T12:34:43.728840+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728840+0000","last_undegraded":"2023-10-14T12:34:43.728840+0000","last_fullsized":"2023-10-14T12:34:43.728840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742661+0000","last_change":"2023-10-14T12:34:43.738818+0000","last_active":"2023-10-14T12:34:43.742661+0000","last_peered":"2023-10-14T12:34:43.742661+0000","last_clean":"2023-10-14T12:34:43.742661+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:34:43.742661+0000","last_undegraded":"2023-10-14T12:34:43.742661+0000","last_fullsized":"2023-10-14T12:34:43.742661+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:09.474609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.735443+0000","last_change":"2023-10-14T12:34:43.735443+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.735443+0000","last_undegraded":"2023-10-14T12:34:43.735443+0000","last_fullsized":"2023-10-14T12:34:43.735443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.734046+0000","last_change":"2023-10-14T12:34:43.733187+0000","last_active":"2023-10-14T12:34:43.734046+0000","last_peered":"2023-10-14T12:34:43.734046+0000","last_clean":"2023-10-14T12:34:43.734046+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:34:43.734046+0000","last_undegraded":"2023-10-14T12:34:43.734046+0000","last_fullsized":"2023-10-14T12:34:43.734046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728733+0000","last_change":"2023-10-14T12:34:43.728733+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728733+0000","last_undegraded":"2023-10-14T12:34:43.728733+0000","last_fullsized":"2023-10-14T12:34:43.728733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.748395+0000","last_change":"2023-10-14T12:34:43.744939+0000","last_active":"2023-10-14T12:34:43.748395+0000","last_peered":"2023-10-14T12:34:43.748395+0000","last_clean":"2023-10-14T12:34:43.748395+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:34:43.748395+0000","last_undegraded":"2023-10-14T12:34:43.748395+0000","last_fullsized":"2023-10-14T12:34:43.748395+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T12:34:42.726034+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:34:42.726034+0000","last_peered":"2023-10-14T12:34:42.726034+0000","last_clean":"2023-10-14T12:34:42.726034+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:34:42.726034+0000","last_undegraded":"2023-10-14T12:34:42.726034+0000","last_fullsized":"2023-10-14T12:34:42.726034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":765854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.63200000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.432},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.66400000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.623}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.441},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.35899999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.376},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39200000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.501}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":168876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.371},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":765854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.26100000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.315},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.438}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.30099999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.32300000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.377},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.626}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.52300000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":168876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.629}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.379}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:34:49.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:34:49.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.393+0000 7f8e353b5700 1 Processor -- start 2023-10-14T12:34:49.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.393+0000 7f8e353b5700 1 -- start start 2023-10-14T12:34:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.393+0000 7f8e353b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e300cf630 0x7f8e300d1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.393+0000 7f8e353b5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e300d1780 0x7f8e3006c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.393+0000 7f8e353b5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3006b930 con 0x7f8e300ce1d0 2023-10-14T12:34:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.393+0000 7f8e353b5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3006c1d0 con 0x7f8e300cf630 2023-10-14T12:34:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.393+0000 7f8e353b5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e300d1fe0 con 0x7f8e300d1780 2023-10-14T12:34:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e300cf630 0x7f8e300d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e300cf630 0x7f8e300d1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48730/0 (socket says 172.21.15.72:48730) 2023-10-14T12:34:49.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2e7fc700 1 -- 172.21.15.72:0/2644156720 learned_addr learned my addr 172.21.15.72:0/2644156720 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:49.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2f7fe700 1 --2- 172.21.15.72:0/2644156720 >> v2:172.21.15.123:3300/0 conn(0x7f8e300d1780 0x7f8e3006c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2e7fc700 1 -- 172.21.15.72:0/2644156720 >> v2:172.21.15.123:3300/0 conn(0x7f8e300d1780 msgr2=0x7f8e3006c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:49.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2e7fc700 1 --2- 172.21.15.72:0/2644156720 >> v2:172.21.15.123:3300/0 conn(0x7f8e300d1780 0x7f8e3006c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2e7fc700 1 -- 172.21.15.72:0/2644156720 >> v1:172.21.15.123:6789/0 conn(0x7f8e300ce1d0 legacy=0x7f8e300cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:49.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2e7fc700 1 -- 172.21.15.72:0/2644156720 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3006bb80 con 0x7f8e300cf630 2023-10-14T12:34:49.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2f7fe700 1 --2- 172.21.15.72:0/2644156720 >> v2:172.21.15.123:3300/0 conn(0x7f8e300d1780 0x7f8e3006c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:49.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2e7fc700 1 --2- 172.21.15.72:0/2644156720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300cf630 0x7f8e300d1240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8e300ceed0 tx=0x7f8e24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1c3a932625dd75 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:49.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2dffb700 1 -- 172.21.15.72:0/2644156720 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24004230 con 0x7f8e300cf630 2023-10-14T12:34:49.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2dffb700 1 -- 172.21.15.72:0/2644156720 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e24004390 con 0x7f8e300cf630 2023-10-14T12:34:49.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.394+0000 7f8e2dffb700 1 -- 172.21.15.72:0/2644156720 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240036a0 con 0x7f8e300cf630 2023-10-14T12:34:49.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.395+0000 7f8e353b5700 1 -- 172.21.15.72:0/2644156720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300cf630 msgr2=0x7f8e300d1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.395+0000 7f8e353b5700 1 --2- 172.21.15.72:0/2644156720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300cf630 0x7f8e300d1240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8e300ceed0 tx=0x7f8e24009bd0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.395+0000 7f8e353b5700 1 -- 172.21.15.72:0/2644156720 shutdown_connections 2023-10-14T12:34:49.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.395+0000 7f8e353b5700 1 --2- 172.21.15.72:0/2644156720 >> v2:172.21.15.123:3300/0 conn(0x7f8e300d1780 0x7f8e3006c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.395+0000 7f8e353b5700 1 --2- 172.21.15.72:0/2644156720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300cf630 0x7f8e300d1240 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.395+0000 7f8e353b5700 1 -- 172.21.15.72:0/2644156720 >> 172.21.15.72:0/2644156720 conn(0x7f8e30070460 msgr2=0x7f8e30070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:49.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.395+0000 7f8e353b5700 1 -- 172.21.15.72:0/2644156720 shutdown_connections 2023-10-14T12:34:49.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.395+0000 7f8e353b5700 1 -- 172.21.15.72:0/2644156720 wait complete. 2023-10-14T12:34:49.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.396+0000 7f8e353b5700 1 Processor -- start 2023-10-14T12:34:49.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.397+0000 7f8e353b5700 1 -- start start 2023-10-14T12:34:49.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.397+0000 7f8e353b5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e300ce1d0 0x7f8e30152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.397+0000 7f8e353b5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e300cf630 0x7f8e300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.397+0000 7f8e353b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300d1780 0x7f8e301571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.397+0000 7f8e353b5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30153460 con 0x7f8e300d1780 2023-10-14T12:34:49.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.397+0000 7f8e353b5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300b5590 con 0x7f8e300ce1d0 2023-10-14T12:34:49.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.397+0000 7f8e353b5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300b5870 con 0x7f8e300cf630 2023-10-14T12:34:49.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300d1780 0x7f8e301571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300d1780 0x7f8e301571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48738/0 (socket says 172.21.15.72:48738) 2023-10-14T12:34:49.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2f7fe700 1 -- 172.21.15.72:0/2850443028 learned_addr learned my addr 172.21.15.72:0/2850443028 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:49.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2effd700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e300ce1d0 0x7f8e30152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2e7fc700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e300cf630 0x7f8e300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2f7fe700 1 -- 172.21.15.72:0/2850443028 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e300cf630 msgr2=0x7f8e300b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2f7fe700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e300cf630 0x7f8e300b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2f7fe700 1 -- 172.21.15.72:0/2850443028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e300ce1d0 msgr2=0x7f8e30152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2f7fe700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e300ce1d0 0x7f8e30152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2f7fe700 1 -- 172.21.15.72:0/2850443028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e24009550 con 0x7f8e300d1780 2023-10-14T12:34:49.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2effd700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e300ce1d0 0x7f8e30152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:49.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e2f7fe700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300d1780 0x7f8e301571d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009fa0 tx=0x7f8e2800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:49.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e177fe700 1 -- 172.21.15.72:0/2850443028 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28003a70 con 0x7f8e300d1780 2023-10-14T12:34:49.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e177fe700 1 -- 172.21.15.72:0/2850443028 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2800f040 con 0x7f8e300d1780 2023-10-14T12:34:49.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e300b5b50 con 0x7f8e300d1780 2023-10-14T12:34:49.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e177fe700 1 -- 172.21.15.72:0/2850443028 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28003e30 con 0x7f8e300d1780 2023-10-14T12:34:49.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.398+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e300b5280 con 0x7f8e300d1780 2023-10-14T12:34:49.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.399+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e300b6350 con 0x7f8e300d1780 2023-10-14T12:34:49.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.399+0000 7f8e177fe700 1 -- 172.21.15.72:0/2850443028 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8e28004030 con 0x7f8e300d1780 2023-10-14T12:34:49.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.400+0000 7f8e177fe700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8e1c06af00 0x7f8e1c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.400+0000 7f8e2effd700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8e1c06af00 0x7f8e1c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.400+0000 7f8e177fe700 1 -- 172.21.15.72:0/2850443028 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f8e28089860 con 0x7f8e300d1780 2023-10-14T12:34:49.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.400+0000 7f8e2effd700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8e1c06af00 0x7f8e1c06d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8e20006fd0 tx=0x7f8e20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:49.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.405+0000 7f8e177fe700 1 -- 172.21.15.72:0/2850443028 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8e28054840 con 0x7f8e300d1780 2023-10-14T12:34:49.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.596+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e3006be60 con 0x7f8e1c06af00 2023-10-14T12:34:49.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.604+0000 7f8e177fe700 1 -- 172.21.15.72:0/2850443028 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283481 (secure 0 0 0) 0x7f8e2000ad30 con 0x7f8e1c06af00 2023-10-14T12:34:49.608 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:49.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8e1c06af00 msgr2=0x7f8e1c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8e1c06af00 0x7f8e1c06d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8e20006fd0 tx=0x7f8e20008040 comp rx=0 tx=0).stop 2023-10-14T12:34:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300d1780 msgr2=0x7f8e301571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300d1780 0x7f8e301571d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009fa0 tx=0x7f8e2800d460 comp rx=0 tx=0).stop 2023-10-14T12:34:49.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 shutdown_connections 2023-10-14T12:34:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8e1c06af00 0x7f8e1c06d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e300d1780 0x7f8e301571d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e300ce1d0 0x7f8e30152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 --2- 172.21.15.72:0/2850443028 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8e300cf630 0x7f8e300b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 >> 172.21.15.72:0/2850443028 conn(0x7f8e30070460 msgr2=0x7f8e30070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:49.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 shutdown_connections 2023-10-14T12:34:49.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.607+0000 7f8e353b5700 1 -- 172.21.15.72:0/2850443028 wait complete. 2023-10-14T12:34:49.613 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:34:49.621 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-10-14T12:34:49.400836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220536,"kb_used_data":4368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754184,"statfs":{"total":773094113280,"available":772868284416,"internally_reserved":0,"allocated":4472832,"data_stored":2571404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000935"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726871+0000","last_change":"2023-10-14T12:34:43.726871+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726871+0000","last_undegraded":"2023-10-14T12:34:43.726871+0000","last_fullsized":"2023-10-14T12:34:43.726871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724752+0000","last_change":"2023-10-14T12:34:43.724752+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724752+0000","last_undegraded":"2023-10-14T12:34:43.724752+0000","last_fullsized":"2023-10-14T12:34:43.724752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724202+0000","last_change":"2023-10-14T12:34:43.724202+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724202+0000","last_undegraded":"2023-10-14T12:34:43.724202+0000","last_fullsized":"2023-10-14T12:34:43.724202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723472+0000","last_change":"2023-10-14T12:34:43.723472+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723472+0000","last_undegraded":"2023-10-14T12:34:43.723472+0000","last_fullsized":"2023-10-14T12:34:43.723472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724099+0000","last_change":"2023-10-14T12:34:43.724099+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724099+0000","last_undegraded":"2023-10-14T12:34:43.724099+0000","last_fullsized":"2023-10-14T12:34:43.724099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726733+0000","last_change":"2023-10-14T12:34:43.726733+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726733+0000","last_undegraded":"2023-10-14T12:34:43.726733+0000","last_fullsized":"2023-10-14T12:34:43.726733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727120+0000","last_change":"2023-10-14T12:34:43.727120+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727120+0000","last_undegraded":"2023-10-14T12:34:43.727120+0000","last_fullsized":"2023-10-14T12:34:43.727120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725833+0000","last_change":"2023-10-14T12:34:43.725833+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725833+0000","last_undegraded":"2023-10-14T12:34:43.725833+0000","last_fullsized":"2023-10-14T12:34:43.725833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723760+0000","last_change":"2023-10-14T12:34:43.723760+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723760+0000","last_undegraded":"2023-10-14T12:34:43.723760+0000","last_fullsized":"2023-10-14T12:34:43.723760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727666+0000","last_change":"2023-10-14T12:34:43.727666+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727666+0000","last_undegraded":"2023-10-14T12:34:43.727666+0000","last_fullsized":"2023-10-14T12:34:43.727666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728346+0000","last_change":"2023-10-14T12:34:43.728346+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728346+0000","last_undegraded":"2023-10-14T12:34:43.728346+0000","last_fullsized":"2023-10-14T12:34:43.728346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723075+0000","last_change":"2023-10-14T12:34:43.723075+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723075+0000","last_undegraded":"2023-10-14T12:34:43.723075+0000","last_fullsized":"2023-10-14T12:34:43.723075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728011+0000","last_change":"2023-10-14T12:34:43.728011+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728011+0000","last_undegraded":"2023-10-14T12:34:43.728011+0000","last_fullsized":"2023-10-14T12:34:43.728011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731771+0000","last_change":"2023-10-14T12:34:43.731771+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731771+0000","last_undegraded":"2023-10-14T12:34:43.731771+0000","last_fullsized":"2023-10-14T12:34:43.731771+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.729162+0000","last_change":"2023-10-14T12:34:43.729162+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.729162+0000","last_undegraded":"2023-10-14T12:34:43.729162+0000","last_fullsized":"2023-10-14T12:34:43.729162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.734826+0000","last_change":"2023-10-14T12:34:43.734826+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.734826+0000","last_undegraded":"2023-10-14T12:34:43.734826+0000","last_fullsized":"2023-10-14T12:34:43.734826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.737373+0000","last_change":"2023-10-14T12:34:43.737373+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.737373+0000","last_undegraded":"2023-10-14T12:34:43.737373+0000","last_fullsized":"2023-10-14T12:34:43.737373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.732827+0000","last_change":"2023-10-14T12:34:43.732827+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.732827+0000","last_undegraded":"2023-10-14T12:34:43.732827+0000","last_fullsized":"2023-10-14T12:34:43.732827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722586+0000","last_change":"2023-10-14T12:34:43.722586+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722586+0000","last_undegraded":"2023-10-14T12:34:43.722586+0000","last_fullsized":"2023-10-14T12:34:43.722586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.732974+0000","last_change":"2023-10-14T12:34:43.732974+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.732974+0000","last_undegraded":"2023-10-14T12:34:43.732974+0000","last_fullsized":"2023-10-14T12:34:43.732974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727552+0000","last_change":"2023-10-14T12:34:43.727552+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727552+0000","last_undegraded":"2023-10-14T12:34:43.727552+0000","last_fullsized":"2023-10-14T12:34:43.727552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731090+0000","last_change":"2023-10-14T12:34:43.731090+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731090+0000","last_undegraded":"2023-10-14T12:34:43.731090+0000","last_fullsized":"2023-10-14T12:34:43.731090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733917+0000","last_change":"2023-10-14T12:34:43.733917+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733917+0000","last_undegraded":"2023-10-14T12:34:43.733917+0000","last_fullsized":"2023-10-14T12:34:43.733917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722559+0000","last_change":"2023-10-14T12:34:43.722559+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722559+0000","last_undegraded":"2023-10-14T12:34:43.722559+0000","last_fullsized":"2023-10-14T12:34:43.722559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730237+0000","last_change":"2023-10-14T12:34:43.730237+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730237+0000","last_undegraded":"2023-10-14T12:34:43.730237+0000","last_fullsized":"2023-10-14T12:34:43.730237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728919+0000","last_change":"2023-10-14T12:34:43.728919+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728919+0000","last_undegraded":"2023-10-14T12:34:43.728919+0000","last_fullsized":"2023-10-14T12:34:43.728919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730552+0000","last_change":"2023-10-14T12:34:43.730552+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730552+0000","last_undegraded":"2023-10-14T12:34:43.730552+0000","last_fullsized":"2023-10-14T12:34:43.730552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726622+0000","last_change":"2023-10-14T12:34:43.726622+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726622+0000","last_undegraded":"2023-10-14T12:34:43.726622+0000","last_fullsized":"2023-10-14T12:34:43.726622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731369+0000","last_change":"2023-10-14T12:34:43.731369+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731369+0000","last_undegraded":"2023-10-14T12:34:43.731369+0000","last_fullsized":"2023-10-14T12:34:43.731369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727714+0000","last_change":"2023-10-14T12:34:43.727714+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727714+0000","last_undegraded":"2023-10-14T12:34:43.727714+0000","last_fullsized":"2023-10-14T12:34:43.727714+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.738442+0000","last_change":"2023-10-14T12:34:43.738442+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.738442+0000","last_undegraded":"2023-10-14T12:34:43.738442+0000","last_fullsized":"2023-10-14T12:34:43.738442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725827+0000","last_change":"2023-10-14T12:34:43.725827+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725827+0000","last_undegraded":"2023-10-14T12:34:43.725827+0000","last_fullsized":"2023-10-14T12:34:43.725827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.736133+0000","last_change":"2023-10-14T12:34:43.736133+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.736133+0000","last_undegraded":"2023-10-14T12:34:43.736133+0000","last_fullsized":"2023-10-14T12:34:43.736133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.747085+0000","last_change":"2023-10-14T12:34:43.742439+0000","last_active":"2023-10-14T12:34:43.747085+0000","last_peered":"2023-10-14T12:34:43.747085+0000","last_clean":"2023-10-14T12:34:43.747085+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:34:43.747085+0000","last_undegraded":"2023-10-14T12:34:43.747085+0000","last_fullsized":"2023-10-14T12:34:43.747085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726722+0000","last_change":"2023-10-14T12:34:43.726722+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726722+0000","last_undegraded":"2023-10-14T12:34:43.726722+0000","last_fullsized":"2023-10-14T12:34:43.726722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.741767+0000","last_change":"2023-10-14T12:34:43.740875+0000","last_active":"2023-10-14T12:34:43.741767+0000","last_peered":"2023-10-14T12:34:43.741767+0000","last_clean":"2023-10-14T12:34:43.741767+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:34:43.741767+0000","last_undegraded":"2023-10-14T12:34:43.741767+0000","last_fullsized":"2023-10-14T12:34:43.741767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733603+0000","last_change":"2023-10-14T12:34:43.733603+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733603+0000","last_undegraded":"2023-10-14T12:34:43.733603+0000","last_fullsized":"2023-10-14T12:34:43.733603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740682+0000","last_change":"2023-10-14T12:34:43.737909+0000","last_active":"2023-10-14T12:34:43.740682+0000","last_peered":"2023-10-14T12:34:43.740682+0000","last_clean":"2023-10-14T12:34:43.740682+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:34:43.740682+0000","last_undegraded":"2023-10-14T12:34:43.740682+0000","last_fullsized":"2023-10-14T12:34:43.740682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:58.323321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724904+0000","last_change":"2023-10-14T12:34:43.724904+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724904+0000","last_undegraded":"2023-10-14T12:34:43.724904+0000","last_fullsized":"2023-10-14T12:34:43.724904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742667+0000","last_change":"2023-10-14T12:34:43.738060+0000","last_active":"2023-10-14T12:34:43.742667+0000","last_peered":"2023-10-14T12:34:43.742667+0000","last_clean":"2023-10-14T12:34:43.742667+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:34:43.742667+0000","last_undegraded":"2023-10-14T12:34:43.742667+0000","last_fullsized":"2023-10-14T12:34:43.742667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:05.797624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724345+0000","last_change":"2023-10-14T12:34:43.724345+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724345+0000","last_undegraded":"2023-10-14T12:34:43.724345+0000","last_fullsized":"2023-10-14T12:34:43.724345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.745697+0000","last_change":"2023-10-14T12:34:43.738857+0000","last_active":"2023-10-14T12:34:43.745697+0000","last_peered":"2023-10-14T12:34:43.745697+0000","last_clean":"2023-10-14T12:34:43.745697+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:34:43.745697+0000","last_undegraded":"2023-10-14T12:34:43.745697+0000","last_fullsized":"2023-10-14T12:34:43.745697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727761+0000","last_change":"2023-10-14T12:34:43.727761+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727761+0000","last_undegraded":"2023-10-14T12:34:43.727761+0000","last_fullsized":"2023-10-14T12:34:43.727761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753769+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:43.753769+0000","last_peered":"2023-10-14T12:34:43.753769+0000","last_clean":"2023-10-14T12:34:43.753769+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:43.753769+0000","last_undegraded":"2023-10-14T12:34:43.753769+0000","last_fullsized":"2023-10-14T12:34:43.753769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730609+0000","last_change":"2023-10-14T12:34:43.730609+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730609+0000","last_undegraded":"2023-10-14T12:34:43.730609+0000","last_fullsized":"2023-10-14T12:34:43.730609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740755+0000","last_change":"2023-10-14T12:34:43.738248+0000","last_active":"2023-10-14T12:34:43.740755+0000","last_peered":"2023-10-14T12:34:43.740755+0000","last_clean":"2023-10-14T12:34:43.740755+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:34:43.740755+0000","last_undegraded":"2023-10-14T12:34:43.740755+0000","last_fullsized":"2023-10-14T12:34:43.740755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725594+0000","last_change":"2023-10-14T12:34:43.725594+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725594+0000","last_undegraded":"2023-10-14T12:34:43.725594+0000","last_fullsized":"2023-10-14T12:34:43.725594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742475+0000","last_change":"2023-10-14T12:34:43.737450+0000","last_active":"2023-10-14T12:34:43.742475+0000","last_peered":"2023-10-14T12:34:43.742475+0000","last_clean":"2023-10-14T12:34:43.742475+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:34:43.742475+0000","last_undegraded":"2023-10-14T12:34:43.742475+0000","last_fullsized":"2023-10-14T12:34:43.742475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722903+0000","last_change":"2023-10-14T12:34:43.722903+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722903+0000","last_undegraded":"2023-10-14T12:34:43.722903+0000","last_fullsized":"2023-10-14T12:34:43.722903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.735239+0000","last_change":"2023-10-14T12:34:43.733989+0000","last_active":"2023-10-14T12:34:43.735239+0000","last_peered":"2023-10-14T12:34:43.735239+0000","last_clean":"2023-10-14T12:34:43.735239+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:34:43.735239+0000","last_undegraded":"2023-10-14T12:34:43.735239+0000","last_fullsized":"2023-10-14T12:34:43.735239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:55.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.738155+0000","last_change":"2023-10-14T12:34:43.738155+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.738155+0000","last_undegraded":"2023-10-14T12:34:43.738155+0000","last_fullsized":"2023-10-14T12:34:43.738155+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740478+0000","last_change":"2023-10-14T12:34:43.734905+0000","last_active":"2023-10-14T12:34:43.740478+0000","last_peered":"2023-10-14T12:34:43.740478+0000","last_clean":"2023-10-14T12:34:43.740478+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:34:43.740478+0000","last_undegraded":"2023-10-14T12:34:43.740478+0000","last_fullsized":"2023-10-14T12:34:43.740478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723631+0000","last_change":"2023-10-14T12:34:43.723631+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723631+0000","last_undegraded":"2023-10-14T12:34:43.723631+0000","last_fullsized":"2023-10-14T12:34:43.723631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.743478+0000","last_change":"2023-10-14T12:34:43.735967+0000","last_active":"2023-10-14T12:34:43.743478+0000","last_peered":"2023-10-14T12:34:43.743478+0000","last_clean":"2023-10-14T12:34:43.743478+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:34:43.743478+0000","last_undegraded":"2023-10-14T12:34:43.743478+0000","last_fullsized":"2023-10-14T12:34:43.743478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.729931+0000","last_change":"2023-10-14T12:34:43.729931+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.729931+0000","last_undegraded":"2023-10-14T12:34:43.729931+0000","last_fullsized":"2023-10-14T12:34:43.729931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.741962+0000","last_change":"2023-10-14T12:34:43.741443+0000","last_active":"2023-10-14T12:34:43.741962+0000","last_peered":"2023-10-14T12:34:43.741962+0000","last_clean":"2023-10-14T12:34:43.741962+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:34:43.741962+0000","last_undegraded":"2023-10-14T12:34:43.741962+0000","last_fullsized":"2023-10-14T12:34:43.741962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725130+0000","last_change":"2023-10-14T12:34:43.725130+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725130+0000","last_undegraded":"2023-10-14T12:34:43.725130+0000","last_fullsized":"2023-10-14T12:34:43.725130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740147+0000","last_change":"2023-10-14T12:34:43.738642+0000","last_active":"2023-10-14T12:34:43.740147+0000","last_peered":"2023-10-14T12:34:43.740147+0000","last_clean":"2023-10-14T12:34:43.740147+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:34:43.740147+0000","last_undegraded":"2023-10-14T12:34:43.740147+0000","last_fullsized":"2023-10-14T12:34:43.740147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:21.861042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724284+0000","last_change":"2023-10-14T12:34:43.724284+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724284+0000","last_undegraded":"2023-10-14T12:34:43.724284+0000","last_fullsized":"2023-10-14T12:34:43.724284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740594+0000","last_change":"2023-10-14T12:34:43.738291+0000","last_active":"2023-10-14T12:34:43.740594+0000","last_peered":"2023-10-14T12:34:43.740594+0000","last_clean":"2023-10-14T12:34:43.740594+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:34:43.740594+0000","last_undegraded":"2023-10-14T12:34:43.740594+0000","last_fullsized":"2023-10-14T12:34:43.740594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:27.820010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.736704+0000","last_change":"2023-10-14T12:34:43.736704+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.736704+0000","last_undegraded":"2023-10-14T12:34:43.736704+0000","last_fullsized":"2023-10-14T12:34:43.736704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.746993+0000","last_change":"2023-10-14T12:34:43.742416+0000","last_active":"2023-10-14T12:34:43.746993+0000","last_peered":"2023-10-14T12:34:43.746993+0000","last_clean":"2023-10-14T12:34:43.746993+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:34:43.746993+0000","last_undegraded":"2023-10-14T12:34:43.746993+0000","last_fullsized":"2023-10-14T12:34:43.746993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726426+0000","last_change":"2023-10-14T12:34:43.726426+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726426+0000","last_undegraded":"2023-10-14T12:34:43.726426+0000","last_fullsized":"2023-10-14T12:34:43.726426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753719+0000","last_change":"2023-10-14T12:34:43.745867+0000","last_active":"2023-10-14T12:34:43.753719+0000","last_peered":"2023-10-14T12:34:43.753719+0000","last_clean":"2023-10-14T12:34:43.753719+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:34:43.753719+0000","last_undegraded":"2023-10-14T12:34:43.753719+0000","last_fullsized":"2023-10-14T12:34:43.753719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:58.323321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724608+0000","last_change":"2023-10-14T12:34:43.724608+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724608+0000","last_undegraded":"2023-10-14T12:34:43.724608+0000","last_fullsized":"2023-10-14T12:34:43.724608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.748271+0000","last_change":"2023-10-14T12:34:43.743560+0000","last_active":"2023-10-14T12:34:43.748271+0000","last_peered":"2023-10-14T12:34:43.748271+0000","last_clean":"2023-10-14T12:34:43.748271+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:34:43.748271+0000","last_undegraded":"2023-10-14T12:34:43.748271+0000","last_fullsized":"2023-10-14T12:34:43.748271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:55.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728831+0000","last_change":"2023-10-14T12:34:43.728831+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728831+0000","last_undegraded":"2023-10-14T12:34:43.728831+0000","last_fullsized":"2023-10-14T12:34:43.728831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742565+0000","last_change":"2023-10-14T12:34:43.738033+0000","last_active":"2023-10-14T12:34:43.742565+0000","last_peered":"2023-10-14T12:34:43.742565+0000","last_clean":"2023-10-14T12:34:43.742565+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:34:43.742565+0000","last_undegraded":"2023-10-14T12:34:43.742565+0000","last_fullsized":"2023-10-14T12:34:43.742565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731148+0000","last_change":"2023-10-14T12:34:43.731148+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731148+0000","last_undegraded":"2023-10-14T12:34:43.731148+0000","last_fullsized":"2023-10-14T12:34:43.731148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.745282+0000","last_change":"2023-10-14T12:34:43.744197+0000","last_active":"2023-10-14T12:34:43.745282+0000","last_peered":"2023-10-14T12:34:43.745282+0000","last_clean":"2023-10-14T12:34:43.745282+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:34:43.745282+0000","last_undegraded":"2023-10-14T12:34:43.745282+0000","last_fullsized":"2023-10-14T12:34:43.745282+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:41.521231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723520+0000","last_change":"2023-10-14T12:34:43.723520+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723520+0000","last_undegraded":"2023-10-14T12:34:43.723520+0000","last_fullsized":"2023-10-14T12:34:43.723520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740574+0000","last_change":"2023-10-14T12:34:43.739053+0000","last_active":"2023-10-14T12:34:43.740574+0000","last_peered":"2023-10-14T12:34:43.740574+0000","last_clean":"2023-10-14T12:34:43.740574+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:34:43.740574+0000","last_undegraded":"2023-10-14T12:34:43.740574+0000","last_fullsized":"2023-10-14T12:34:43.740574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:03.125663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733799+0000","last_change":"2023-10-14T12:34:43.733799+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733799+0000","last_undegraded":"2023-10-14T12:34:43.733799+0000","last_fullsized":"2023-10-14T12:34:43.733799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740751+0000","last_change":"2023-10-14T12:34:43.739027+0000","last_active":"2023-10-14T12:34:43.740751+0000","last_peered":"2023-10-14T12:34:43.740751+0000","last_clean":"2023-10-14T12:34:43.740751+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:34:43.740751+0000","last_undegraded":"2023-10-14T12:34:43.740751+0000","last_fullsized":"2023-10-14T12:34:43.740751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:51:35.469703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723958+0000","last_change":"2023-10-14T12:34:43.723958+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723958+0000","last_undegraded":"2023-10-14T12:34:43.723958+0000","last_fullsized":"2023-10-14T12:34:43.723958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740535+0000","last_change":"2023-10-14T12:34:43.739164+0000","last_active":"2023-10-14T12:34:43.740535+0000","last_peered":"2023-10-14T12:34:43.740535+0000","last_clean":"2023-10-14T12:34:43.740535+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:34:43.740535+0000","last_undegraded":"2023-10-14T12:34:43.740535+0000","last_fullsized":"2023-10-14T12:34:43.740535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:03.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726453+0000","last_change":"2023-10-14T12:34:43.726453+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726453+0000","last_undegraded":"2023-10-14T12:34:43.726453+0000","last_fullsized":"2023-10-14T12:34:43.726453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753767+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:43.753767+0000","last_peered":"2023-10-14T12:34:43.753767+0000","last_clean":"2023-10-14T12:34:43.753767+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:43.753767+0000","last_undegraded":"2023-10-14T12:34:43.753767+0000","last_fullsized":"2023-10-14T12:34:43.753767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726031+0000","last_change":"2023-10-14T12:34:43.726031+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726031+0000","last_undegraded":"2023-10-14T12:34:43.726031+0000","last_fullsized":"2023-10-14T12:34:43.726031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740525+0000","last_change":"2023-10-14T12:34:43.737529+0000","last_active":"2023-10-14T12:34:43.740525+0000","last_peered":"2023-10-14T12:34:43.740525+0000","last_clean":"2023-10-14T12:34:43.740525+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:34:43.740525+0000","last_undegraded":"2023-10-14T12:34:43.740525+0000","last_fullsized":"2023-10-14T12:34:43.740525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:22.993010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726282+0000","last_change":"2023-10-14T12:34:43.726282+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726282+0000","last_undegraded":"2023-10-14T12:34:43.726282+0000","last_fullsized":"2023-10-14T12:34:43.726282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740607+0000","last_change":"2023-10-14T12:34:43.735693+0000","last_active":"2023-10-14T12:34:43.740607+0000","last_peered":"2023-10-14T12:34:43.740607+0000","last_clean":"2023-10-14T12:34:43.740607+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:34:43.740607+0000","last_undegraded":"2023-10-14T12:34:43.740607+0000","last_fullsized":"2023-10-14T12:34:43.740607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.737750+0000","last_change":"2023-10-14T12:34:43.737750+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.737750+0000","last_undegraded":"2023-10-14T12:34:43.737750+0000","last_fullsized":"2023-10-14T12:34:43.737750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740007+0000","last_change":"2023-10-14T12:34:43.735820+0000","last_active":"2023-10-14T12:34:43.740007+0000","last_peered":"2023-10-14T12:34:43.740007+0000","last_clean":"2023-10-14T12:34:43.740007+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:34:43.740007+0000","last_undegraded":"2023-10-14T12:34:43.740007+0000","last_fullsized":"2023-10-14T12:34:43.740007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:27.870090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724257+0000","last_change":"2023-10-14T12:34:43.724257+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724257+0000","last_undegraded":"2023-10-14T12:34:43.724257+0000","last_fullsized":"2023-10-14T12:34:43.724257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.739633+0000","last_change":"2023-10-14T12:34:43.736834+0000","last_active":"2023-10-14T12:34:43.739633+0000","last_peered":"2023-10-14T12:34:43.739633+0000","last_clean":"2023-10-14T12:34:43.739633+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:34:43.739633+0000","last_undegraded":"2023-10-14T12:34:43.739633+0000","last_fullsized":"2023-10-14T12:34:43.739633+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:03.125663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724745+0000","last_change":"2023-10-14T12:34:43.724745+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724745+0000","last_undegraded":"2023-10-14T12:34:43.724745+0000","last_fullsized":"2023-10-14T12:34:43.724745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740502+0000","last_change":"2023-10-14T12:34:43.737030+0000","last_active":"2023-10-14T12:34:43.740502+0000","last_peered":"2023-10-14T12:34:43.740502+0000","last_clean":"2023-10-14T12:34:43.740502+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:34:43.740502+0000","last_undegraded":"2023-10-14T12:34:43.740502+0000","last_fullsized":"2023-10-14T12:34:43.740502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728018+0000","last_change":"2023-10-14T12:34:43.728018+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728018+0000","last_undegraded":"2023-10-14T12:34:43.728018+0000","last_fullsized":"2023-10-14T12:34:43.728018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.744699+0000","last_change":"2023-10-14T12:34:43.740716+0000","last_active":"2023-10-14T12:34:43.744699+0000","last_peered":"2023-10-14T12:34:43.744699+0000","last_clean":"2023-10-14T12:34:43.744699+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:34:43.744699+0000","last_undegraded":"2023-10-14T12:34:43.744699+0000","last_fullsized":"2023-10-14T12:34:43.744699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:05.797624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728840+0000","last_change":"2023-10-14T12:34:43.728840+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728840+0000","last_undegraded":"2023-10-14T12:34:43.728840+0000","last_fullsized":"2023-10-14T12:34:43.728840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742661+0000","last_change":"2023-10-14T12:34:43.738818+0000","last_active":"2023-10-14T12:34:43.742661+0000","last_peered":"2023-10-14T12:34:43.742661+0000","last_clean":"2023-10-14T12:34:43.742661+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:34:43.742661+0000","last_undegraded":"2023-10-14T12:34:43.742661+0000","last_fullsized":"2023-10-14T12:34:43.742661+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:09.474609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.735443+0000","last_change":"2023-10-14T12:34:43.735443+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.735443+0000","last_undegraded":"2023-10-14T12:34:43.735443+0000","last_fullsized":"2023-10-14T12:34:43.735443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.734046+0000","last_change":"2023-10-14T12:34:43.733187+0000","last_active":"2023-10-14T12:34:43.734046+0000","last_peered":"2023-10-14T12:34:43.734046+0000","last_clean":"2023-10-14T12:34:43.734046+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:34:43.734046+0000","last_undegraded":"2023-10-14T12:34:43.734046+0000","last_fullsized":"2023-10-14T12:34:43.734046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728733+0000","last_change":"2023-10-14T12:34:43.728733+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728733+0000","last_undegraded":"2023-10-14T12:34:43.728733+0000","last_fullsized":"2023-10-14T12:34:43.728733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.748395+0000","last_change":"2023-10-14T12:34:43.744939+0000","last_active":"2023-10-14T12:34:43.748395+0000","last_peered":"2023-10-14T12:34:43.748395+0000","last_clean":"2023-10-14T12:34:43.748395+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:34:43.748395+0000","last_undegraded":"2023-10-14T12:34:43.748395+0000","last_fullsized":"2023-10-14T12:34:43.748395+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T12:34:42.726034+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:34:42.726034+0000","last_peered":"2023-10-14T12:34:42.726034+0000","last_clean":"2023-10-14T12:34:42.726034+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:34:42.726034+0000","last_undegraded":"2023-10-14T12:34:42.726034+0000","last_fullsized":"2023-10-14T12:34:42.726034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":765854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.63200000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.432},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.66400000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.623}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.441},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.35899999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.376},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39200000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.501}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":168876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.371},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":765854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.26100000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.315},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.438}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.30099999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.32300000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.377},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.626}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.52300000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":168876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.629}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.379}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:34:49.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-10-14T12:34:49.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.726871+0000', 'last_change': '2023-10-14T12:34:43.726871+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.726871+0000', 'last_undegraded': '2023-10-14T12:34:43.726871+0000', 'last_fullsized': '2023-10-14T12:34:43.726871+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-10-14T12:34:49.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.724752+0000', 'last_change': '2023-10-14T12:34:43.724752+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.724752+0000', 'last_undegraded': '2023-10-14T12:34:43.724752+0000', 'last_fullsized': '2023-10-14T12:34:43.724752+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-10-14T12:34:49.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.724202+0000', 'last_change': '2023-10-14T12:34:43.724202+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.724202+0000', 'last_undegraded': '2023-10-14T12:34:43.724202+0000', 'last_fullsized': '2023-10-14T12:34:43.724202+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T12:34:49.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-10-14T12:34:49.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.723472+0000', 'last_change': '2023-10-14T12:34:43.723472+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.723472+0000', 'last_undegraded': '2023-10-14T12:34:43.723472+0000', 'last_fullsized': '2023-10-14T12:34:43.723472+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T12:34:49.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-10-14T12:34:49.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.724099+0000', 'last_change': '2023-10-14T12:34:43.724099+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.724099+0000', 'last_undegraded': '2023-10-14T12:34:43.724099+0000', 'last_fullsized': '2023-10-14T12:34:43.724099+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T12:34:49.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-10-14T12:34:49.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.726733+0000', 'last_change': '2023-10-14T12:34:43.726733+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.726733+0000', 'last_undegraded': '2023-10-14T12:34:43.726733+0000', 'last_fullsized': '2023-10-14T12:34:43.726733+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T12:34:49.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-10-14T12:34:49.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.727120+0000', 'last_change': '2023-10-14T12:34:43.727120+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.727120+0000', 'last_undegraded': '2023-10-14T12:34:43.727120+0000', 'last_fullsized': '2023-10-14T12:34:43.727120+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-10-14T12:34:49.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.725833+0000', 'last_change': '2023-10-14T12:34:43.725833+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.725833+0000', 'last_undegraded': '2023-10-14T12:34:43.725833+0000', 'last_fullsized': '2023-10-14T12:34:43.725833+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-10-14T12:34:49.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.723760+0000', 'last_change': '2023-10-14T12:34:43.723760+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.723760+0000', 'last_undegraded': '2023-10-14T12:34:43.723760+0000', 'last_fullsized': '2023-10-14T12:34:43.723760+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T12:34:49.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-10-14T12:34:49.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.727666+0000', 'last_change': '2023-10-14T12:34:43.727666+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.727666+0000', 'last_undegraded': '2023-10-14T12:34:43.727666+0000', 'last_fullsized': '2023-10-14T12:34:43.727666+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-10-14T12:34:49.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.728346+0000', 'last_change': '2023-10-14T12:34:43.728346+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.728346+0000', 'last_undegraded': '2023-10-14T12:34:43.728346+0000', 'last_fullsized': '2023-10-14T12:34:43.728346+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-10-14T12:34:49.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.723075+0000', 'last_change': '2023-10-14T12:34:43.723075+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.723075+0000', 'last_undegraded': '2023-10-14T12:34:43.723075+0000', 'last_fullsized': '2023-10-14T12:34:43.723075+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T12:34:49.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-10-14T12:34:49.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.728011+0000', 'last_change': '2023-10-14T12:34:43.728011+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.728011+0000', 'last_undegraded': '2023-10-14T12:34:43.728011+0000', 'last_fullsized': '2023-10-14T12:34:43.728011+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-10-14T12:34:49.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.731771+0000', 'last_change': '2023-10-14T12:34:43.731771+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.731771+0000', 'last_undegraded': '2023-10-14T12:34:43.731771+0000', 'last_fullsized': '2023-10-14T12:34:43.731771+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T12:34:49.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-10-14T12:34:49.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.729162+0000', 'last_change': '2023-10-14T12:34:43.729162+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.729162+0000', 'last_undegraded': '2023-10-14T12:34:43.729162+0000', 'last_fullsized': '2023-10-14T12:34:43.729162+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-10-14T12:34:49.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.734826+0000', 'last_change': '2023-10-14T12:34:43.734826+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.734826+0000', 'last_undegraded': '2023-10-14T12:34:43.734826+0000', 'last_fullsized': '2023-10-14T12:34:43.734826+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-10-14T12:34:49.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.737373+0000', 'last_change': '2023-10-14T12:34:43.737373+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.737373+0000', 'last_undegraded': '2023-10-14T12:34:43.737373+0000', 'last_fullsized': '2023-10-14T12:34:43.737373+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-10-14T12:34:49.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.732827+0000', 'last_change': '2023-10-14T12:34:43.732827+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.732827+0000', 'last_undegraded': '2023-10-14T12:34:43.732827+0000', 'last_fullsized': '2023-10-14T12:34:43.732827+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T12:34:49.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-10-14T12:34:49.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.722586+0000', 'last_change': '2023-10-14T12:34:43.722586+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.722586+0000', 'last_undegraded': '2023-10-14T12:34:43.722586+0000', 'last_fullsized': '2023-10-14T12:34:43.722586+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T12:34:49.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-10-14T12:34:49.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.732974+0000', 'last_change': '2023-10-14T12:34:43.732974+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.732974+0000', 'last_undegraded': '2023-10-14T12:34:43.732974+0000', 'last_fullsized': '2023-10-14T12:34:43.732974+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T12:34:49.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-10-14T12:34:49.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.727552+0000', 'last_change': '2023-10-14T12:34:43.727552+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.727552+0000', 'last_undegraded': '2023-10-14T12:34:43.727552+0000', 'last_fullsized': '2023-10-14T12:34:43.727552+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-10-14T12:34:49.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.731090+0000', 'last_change': '2023-10-14T12:34:43.731090+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.731090+0000', 'last_undegraded': '2023-10-14T12:34:43.731090+0000', 'last_fullsized': '2023-10-14T12:34:43.731090+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T12:34:49.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-10-14T12:34:49.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.733917+0000', 'last_change': '2023-10-14T12:34:43.733917+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.733917+0000', 'last_undegraded': '2023-10-14T12:34:43.733917+0000', 'last_fullsized': '2023-10-14T12:34:43.733917+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-10-14T12:34:49.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.722559+0000', 'last_change': '2023-10-14T12:34:43.722559+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.722559+0000', 'last_undegraded': '2023-10-14T12:34:43.722559+0000', 'last_fullsized': '2023-10-14T12:34:43.722559+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T12:34:49.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-10-14T12:34:49.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.730237+0000', 'last_change': '2023-10-14T12:34:43.730237+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.730237+0000', 'last_undegraded': '2023-10-14T12:34:43.730237+0000', 'last_fullsized': '2023-10-14T12:34:43.730237+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T12:34:49.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-10-14T12:34:49.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.728919+0000', 'last_change': '2023-10-14T12:34:43.728919+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.728919+0000', 'last_undegraded': '2023-10-14T12:34:43.728919+0000', 'last_fullsized': '2023-10-14T12:34:43.728919+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T12:34:49.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-10-14T12:34:49.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.730552+0000', 'last_change': '2023-10-14T12:34:43.730552+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.730552+0000', 'last_undegraded': '2023-10-14T12:34:43.730552+0000', 'last_fullsized': '2023-10-14T12:34:43.730552+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T12:34:49.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-10-14T12:34:49.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.726622+0000', 'last_change': '2023-10-14T12:34:43.726622+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.726622+0000', 'last_undegraded': '2023-10-14T12:34:43.726622+0000', 'last_fullsized': '2023-10-14T12:34:43.726622+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-10-14T12:34:49.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.731369+0000', 'last_change': '2023-10-14T12:34:43.731369+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.731369+0000', 'last_undegraded': '2023-10-14T12:34:43.731369+0000', 'last_fullsized': '2023-10-14T12:34:43.731369+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T12:34:49.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-10-14T12:34:49.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.727714+0000', 'last_change': '2023-10-14T12:34:43.727714+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.727714+0000', 'last_undegraded': '2023-10-14T12:34:43.727714+0000', 'last_fullsized': '2023-10-14T12:34:43.727714+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-14T12:34:49.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-10-14T12:34:49.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.738442+0000', 'last_change': '2023-10-14T12:34:43.738442+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.738442+0000', 'last_undegraded': '2023-10-14T12:34:43.738442+0000', 'last_fullsized': '2023-10-14T12:34:43.738442+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-10-14T12:34:49.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.725827+0000', 'last_change': '2023-10-14T12:34:43.725827+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.725827+0000', 'last_undegraded': '2023-10-14T12:34:43.725827+0000', 'last_fullsized': '2023-10-14T12:34:43.725827+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T12:34:49.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-10-14T12:34:49.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.736133+0000', 'last_change': '2023-10-14T12:34:43.736133+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.736133+0000', 'last_undegraded': '2023-10-14T12:34:43.736133+0000', 'last_fullsized': '2023-10-14T12:34:43.736133+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-10-14T12:34:49.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.726722+0000', 'last_change': '2023-10-14T12:34:43.726722+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.726722+0000', 'last_undegraded': '2023-10-14T12:34:43.726722+0000', 'last_fullsized': '2023-10-14T12:34:43.726722+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T12:34:49.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-10-14T12:34:49.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.733603+0000', 'last_change': '2023-10-14T12:34:43.733603+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.733603+0000', 'last_undegraded': '2023-10-14T12:34:43.733603+0000', 'last_fullsized': '2023-10-14T12:34:43.733603+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T12:34:49.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-10-14T12:34:49.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.724904+0000', 'last_change': '2023-10-14T12:34:43.724904+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.724904+0000', 'last_undegraded': '2023-10-14T12:34:43.724904+0000', 'last_fullsized': '2023-10-14T12:34:43.724904+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-10-14T12:34:49.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.724345+0000', 'last_change': '2023-10-14T12:34:43.724345+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.724345+0000', 'last_undegraded': '2023-10-14T12:34:43.724345+0000', 'last_fullsized': '2023-10-14T12:34:43.724345+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T12:34:49.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-10-14T12:34:49.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.727761+0000', 'last_change': '2023-10-14T12:34:43.727761+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.727761+0000', 'last_undegraded': '2023-10-14T12:34:43.727761+0000', 'last_fullsized': '2023-10-14T12:34:43.727761+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-10-14T12:34:49.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.730609+0000', 'last_change': '2023-10-14T12:34:43.730609+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.730609+0000', 'last_undegraded': '2023-10-14T12:34:43.730609+0000', 'last_fullsized': '2023-10-14T12:34:43.730609+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T12:34:49.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-10-14T12:34:49.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.725594+0000', 'last_change': '2023-10-14T12:34:43.725594+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.725594+0000', 'last_undegraded': '2023-10-14T12:34:43.725594+0000', 'last_fullsized': '2023-10-14T12:34:43.725594+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-10-14T12:34:49.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.722903+0000', 'last_change': '2023-10-14T12:34:43.722903+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.722903+0000', 'last_undegraded': '2023-10-14T12:34:43.722903+0000', 'last_fullsized': '2023-10-14T12:34:43.722903+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T12:34:49.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-10-14T12:34:49.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.738155+0000', 'last_change': '2023-10-14T12:34:43.738155+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.738155+0000', 'last_undegraded': '2023-10-14T12:34:43.738155+0000', 'last_fullsized': '2023-10-14T12:34:43.738155+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-10-14T12:34:49.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.723631+0000', 'last_change': '2023-10-14T12:34:43.723631+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.723631+0000', 'last_undegraded': '2023-10-14T12:34:43.723631+0000', 'last_fullsized': '2023-10-14T12:34:43.723631+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T12:34:49.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-10-14T12:34:49.663 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.729931+0000', 'last_change': '2023-10-14T12:34:43.729931+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.729931+0000', 'last_undegraded': '2023-10-14T12:34:43.729931+0000', 'last_fullsized': '2023-10-14T12:34:43.729931+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T12:34:49.663 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-10-14T12:34:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.725130+0000', 'last_change': '2023-10-14T12:34:43.725130+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.725130+0000', 'last_undegraded': '2023-10-14T12:34:43.725130+0000', 'last_fullsized': '2023-10-14T12:34:43.725130+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T12:34:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-10-14T12:34:49.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.724284+0000', 'last_change': '2023-10-14T12:34:43.724284+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.724284+0000', 'last_undegraded': '2023-10-14T12:34:43.724284+0000', 'last_fullsized': '2023-10-14T12:34:43.724284+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-10-14T12:34:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.736704+0000', 'last_change': '2023-10-14T12:34:43.736704+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.736704+0000', 'last_undegraded': '2023-10-14T12:34:43.736704+0000', 'last_fullsized': '2023-10-14T12:34:43.736704+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-10-14T12:34:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.726426+0000', 'last_change': '2023-10-14T12:34:43.726426+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.726426+0000', 'last_undegraded': '2023-10-14T12:34:43.726426+0000', 'last_fullsized': '2023-10-14T12:34:43.726426+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-10-14T12:34:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.724608+0000', 'last_change': '2023-10-14T12:34:43.724608+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.724608+0000', 'last_undegraded': '2023-10-14T12:34:43.724608+0000', 'last_fullsized': '2023-10-14T12:34:43.724608+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-10-14T12:34:49.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.728831+0000', 'last_change': '2023-10-14T12:34:43.728831+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.728831+0000', 'last_undegraded': '2023-10-14T12:34:43.728831+0000', 'last_fullsized': '2023-10-14T12:34:43.728831+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-10-14T12:34:49.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.731148+0000', 'last_change': '2023-10-14T12:34:43.731148+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.731148+0000', 'last_undegraded': '2023-10-14T12:34:43.731148+0000', 'last_fullsized': '2023-10-14T12:34:43.731148+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T12:34:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-10-14T12:34:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.723520+0000', 'last_change': '2023-10-14T12:34:43.723520+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.723520+0000', 'last_undegraded': '2023-10-14T12:34:43.723520+0000', 'last_fullsized': '2023-10-14T12:34:43.723520+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-14T12:34:49.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-10-14T12:34:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.733799+0000', 'last_change': '2023-10-14T12:34:43.733799+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.733799+0000', 'last_undegraded': '2023-10-14T12:34:43.733799+0000', 'last_fullsized': '2023-10-14T12:34:43.733799+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-10-14T12:34:49.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.723958+0000', 'last_change': '2023-10-14T12:34:43.723958+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.723958+0000', 'last_undegraded': '2023-10-14T12:34:43.723958+0000', 'last_fullsized': '2023-10-14T12:34:43.723958+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T12:34:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-10-14T12:34:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.726453+0000', 'last_change': '2023-10-14T12:34:43.726453+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.726453+0000', 'last_undegraded': '2023-10-14T12:34:43.726453+0000', 'last_fullsized': '2023-10-14T12:34:43.726453+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-10-14T12:34:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.726031+0000', 'last_change': '2023-10-14T12:34:43.726031+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.726031+0000', 'last_undegraded': '2023-10-14T12:34:43.726031+0000', 'last_fullsized': '2023-10-14T12:34:43.726031+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-10-14T12:34:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.726282+0000', 'last_change': '2023-10-14T12:34:43.726282+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.726282+0000', 'last_undegraded': '2023-10-14T12:34:43.726282+0000', 'last_fullsized': '2023-10-14T12:34:43.726282+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T12:34:49.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-10-14T12:34:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.737750+0000', 'last_change': '2023-10-14T12:34:43.737750+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.737750+0000', 'last_undegraded': '2023-10-14T12:34:43.737750+0000', 'last_fullsized': '2023-10-14T12:34:43.737750+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-10-14T12:34:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.724257+0000', 'last_change': '2023-10-14T12:34:43.724257+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.724257+0000', 'last_undegraded': '2023-10-14T12:34:43.724257+0000', 'last_fullsized': '2023-10-14T12:34:43.724257+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-14T12:34:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-10-14T12:34:49.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.724745+0000', 'last_change': '2023-10-14T12:34:43.724745+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.724745+0000', 'last_undegraded': '2023-10-14T12:34:43.724745+0000', 'last_fullsized': '2023-10-14T12:34:43.724745+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-14T12:34:49.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-10-14T12:34:49.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.728018+0000', 'last_change': '2023-10-14T12:34:43.728018+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.728018+0000', 'last_undegraded': '2023-10-14T12:34:43.728018+0000', 'last_fullsized': '2023-10-14T12:34:43.728018+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-14T12:34:49.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-10-14T12:34:49.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.728840+0000', 'last_change': '2023-10-14T12:34:43.728840+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.728840+0000', 'last_undegraded': '2023-10-14T12:34:43.728840+0000', 'last_fullsized': '2023-10-14T12:34:43.728840+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-14T12:34:49.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-10-14T12:34:49.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.735443+0000', 'last_change': '2023-10-14T12:34:43.735443+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.735443+0000', 'last_undegraded': '2023-10-14T12:34:43.735443+0000', 'last_fullsized': '2023-10-14T12:34:43.735443+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-14T12:34:49.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-10-14T12:34:49.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-10-14T12:34:43.728733+0000', 'last_change': '2023-10-14T12:34:43.728733+0000', 'last_active': '2023-10-14T12:34:43.715979+0000', 'last_peered': '2023-10-14T12:34:43.715979+0000', 'last_clean': '2023-10-14T12:34:43.715979+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-14T12:34:43.728733+0000', 'last_undegraded': '2023-10-14T12:34:43.728733+0000', 'last_fullsized': '2023-10-14T12:34:43.728733+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'last_clean_scrub_stamp': '2023-10-14T12:34:43.715979+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-14T12:34:49.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T12:34:49.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.798+0000 7faead63c700 1 Processor -- start 2023-10-14T12:34:49.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.798+0000 7faead63c700 1 -- start start 2023-10-14T12:34:49.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.799+0000 7faead63c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faea8152470 0x7faea80cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.799+0000 7faead63c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea8070d70 con 0x7faea80b3410 2023-10-14T12:34:49.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.799+0000 7faead63c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea815c990 con 0x7faea80cb8d0 2023-10-14T12:34:49.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.799+0000 7faead63c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea8071200 con 0x7faea8152470 2023-10-14T12:34:49.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.799+0000 7faea77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faea80b3410 0x7faea80b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55044/0 (socket says 172.21.15.72:55044) 2023-10-14T12:34:49.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.799+0000 7faea77fe700 1 -- 172.21.15.72:0/632827074 learned_addr learned my addr 172.21.15.72:0/632827074 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:49.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea6ffd700 1 --2- 172.21.15.72:0/632827074 >> v2:172.21.15.123:3300/0 conn(0x7faea8152470 0x7faea80cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012561169 0 0) 0x7faea8070d70 con 0x7faea80b3410 2023-10-14T12:34:49.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae900035b0 con 0x7faea80b3410 2023-10-14T12:34:49.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1193880417 0 0) 0x7fae900035b0 con 0x7faea80b3410 2023-10-14T12:34:49.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 >> v2:172.21.15.123:3300/0 conn(0x7faea8152470 msgr2=0x7faea80cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:49.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 --2- 172.21.15.72:0/632827074 >> v2:172.21.15.123:3300/0 conn(0x7faea8152470 0x7faea80cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 >> v1:172.21.15.123:6789/0 conn(0x7faea80cb8d0 legacy=0x7faea80b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea80cbd80 con 0x7faea80b3410 2023-10-14T12:34:49.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7faea00019f0 con 0x7faea80b3410 2023-10-14T12:34:49.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 >> v1:172.21.15.72:6789/0 conn(0x7faea80b3410 legacy=0x7faea80b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90003a00 0x7fae90003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae90004850 0x7fae90004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae90005330 0x7fae9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea8071200 con 0x7fae90004850 2023-10-14T12:34:49.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9000c200 con 0x7fae90003a00 2023-10-14T12:34:49.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9000c3c0 con 0x7fae90005330 2023-10-14T12:34:49.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea67fc700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae90004850 0x7fae90004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea6ffd700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90003a00 0x7fae90003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea77fe700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae90005330 0x7fae9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea67fc700 1 -- 172.21.15.72:0/632827074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae90005330 msgr2=0x7fae9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:49.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea67fc700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fae90005330 0x7fae9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea67fc700 1 -- 172.21.15.72:0/632827074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90003a00 msgr2=0x7fae90003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:49.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea67fc700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90003a00 0x7fae90003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea67fc700 1 -- 172.21.15.72:0/632827074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900035b0 con 0x7fae90004850 2023-10-14T12:34:49.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.800+0000 7faea77fe700 1 -- 172.21.15.72:0/632827074 reap_dead start 2023-10-14T12:34:49.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faea67fc700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae90004850 0x7fae90004cd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fae98007fd0 tx=0x7fae90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402fc3437ebb02cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:49.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae980052d0 con 0x7fae90004850 2023-10-14T12:34:49.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae98005430 con 0x7fae90004850 2023-10-14T12:34:49.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faea5ffb700 1 -- 172.21.15.72:0/632827074 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae980038c0 con 0x7fae90004850 2023-10-14T12:34:49.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faead63c700 1 -- 172.21.15.72:0/632827074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae90004850 msgr2=0x7fae90004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faead63c700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae90004850 0x7fae90004cd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fae98007fd0 tx=0x7fae90005880 comp rx=0 tx=0).stop 2023-10-14T12:34:49.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faead63c700 1 -- 172.21.15.72:0/632827074 shutdown_connections 2023-10-14T12:34:49.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faead63c700 1 --2- 172.21.15.72:0/632827074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae90004850 0x7fae90004cd0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faead63c700 1 -- 172.21.15.72:0/632827074 >> 172.21.15.72:0/632827074 conn(0x7faea80cdd00 msgr2=0x7faea80ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:49.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faead63c700 1 -- 172.21.15.72:0/632827074 shutdown_connections 2023-10-14T12:34:49.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.801+0000 7faead63c700 1 -- 172.21.15.72:0/632827074 wait complete. 2023-10-14T12:34:49.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faead63c700 1 Processor -- start 2023-10-14T12:34:49.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faead63c700 1 -- start start 2023-10-14T12:34:49.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faead63c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90004850 0x7faea8157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faead63c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faea80afbc0 0x7faea80c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faead63c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faea81f6490 0x7faea80b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faead63c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea806b930 con 0x7faea80afbc0 2023-10-14T12:34:49.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faead63c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea806cf40 con 0x7fae90004850 2023-10-14T12:34:49.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faead63c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea806d220 con 0x7faea81f6490 2023-10-14T12:34:49.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faea67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faea80afbc0 0x7faea80c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faea67fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faea80afbc0 0x7faea80c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48754/0 (socket says 172.21.15.72:48754) 2023-10-14T12:34:49.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faea67fc700 1 -- 172.21.15.72:0/2932353539 learned_addr learned my addr 172.21.15.72:0/2932353539 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:49.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.803+0000 7faea6ffd700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90004850 0x7faea8157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faea77fe700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faea81f6490 0x7faea80b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faea67fc700 1 -- 172.21.15.72:0/2932353539 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faea81f6490 msgr2=0x7faea80b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faea67fc700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faea81f6490 0x7faea80b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faea67fc700 1 -- 172.21.15.72:0/2932353539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90004850 msgr2=0x7faea8157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:49.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faea67fc700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90004850 0x7faea8157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:49.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faea67fc700 1 -- 172.21.15.72:0/2932353539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea806d500 con 0x7faea80afbc0 2023-10-14T12:34:49.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faea6ffd700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90004850 0x7faea8157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:49.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faea67fc700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faea80afbc0 0x7faea80c7850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fae98015040 tx=0x7fae98001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:49.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7fae8f7fe700 1 -- 172.21.15.72:0/2932353539 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98001290 con 0x7faea80afbc0 2023-10-14T12:34:49.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7fae8f7fe700 1 -- 172.21.15.72:0/2932353539 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae98000ed0 con 0x7faea80afbc0 2023-10-14T12:34:49.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea806d7e0 con 0x7faea80afbc0 2023-10-14T12:34:49.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7fae8f7fe700 1 -- 172.21.15.72:0/2932353539 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98006a80 con 0x7faea80afbc0 2023-10-14T12:34:49.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.804+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea806cba0 con 0x7faea80afbc0 2023-10-14T12:34:49.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.805+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea80d20f0 con 0x7faea80afbc0 2023-10-14T12:34:49.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.805+0000 7fae8f7fe700 1 -- 172.21.15.72:0/2932353539 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fae98019040 con 0x7faea80afbc0 2023-10-14T12:34:49.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.806+0000 7fae8f7fe700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fae9406af00 0x7fae9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:49.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.806+0000 7fae8f7fe700 1 -- 172.21.15.72:0/2932353539 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fae9808a140 con 0x7faea80afbc0 2023-10-14T12:34:49.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.806+0000 7faea6ffd700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fae9406af00 0x7fae9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:49.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.806+0000 7faea6ffd700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fae9406af00 0x7fae9406d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009ce0 tx=0x7fae9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:49.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:49.810+0000 7fae8f7fe700 1 -- 172.21.15.72:0/2932353539 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae98055120 con 0x7faea80afbc0 2023-10-14T12:34:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.081+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7faea804ebb0 con 0x7faea80afbc0 2023-10-14T12:34:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.082+0000 7fae8f7fe700 1 -- 172.21.15.72:0/2932353539 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1032 (secure 0 0 0) 0x7fae98058740 con 0x7faea80afbc0 2023-10-14T12:34:50.084 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:50.084 INFO:teuthology.orchestra.run.smithi072.stdout:{"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":96,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1697286804,"num_in_osds":8,"osd_in_since":1697286796,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225828864,"bytes_avail":772868284416,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5259}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-14T12:34:33.398009+0000","services":{}},"progress_events":{}} 2023-10-14T12:34:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fae9406af00 msgr2=0x7fae9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:50.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fae9406af00 0x7fae9406d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009ce0 tx=0x7fae9c008040 comp rx=0 tx=0).stop 2023-10-14T12:34:50.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faea80afbc0 msgr2=0x7faea80c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:50.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faea80afbc0 0x7faea80c7850 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fae98015040 tx=0x7fae98001120 comp rx=0 tx=0).stop 2023-10-14T12:34:50.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 shutdown_connections 2023-10-14T12:34:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fae9406af00 0x7fae9406d3c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7faea81f6490 0x7faea80b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae90004850 0x7faea8157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 --2- 172.21.15.72:0/2932353539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faea80afbc0 0x7faea80c7850 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 >> 172.21.15.72:0/2932353539 conn(0x7faea80cdd00 msgr2=0x7faea815d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 shutdown_connections 2023-10-14T12:34:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.084+0000 7faead63c700 1 -- 172.21.15.72:0/2932353539 wait complete. 2023-10-14T12:34:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T12:34:50.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:34:50.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.218+0000 7f393dce3700 1 Processor -- start 2023-10-14T12:34:50.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.218+0000 7f393dce3700 1 -- start start 2023-10-14T12:34:50.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f393dce3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3938071850 0x7f3938071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f393dce3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380721f0 con 0x7f393806d100 2023-10-14T12:34:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f393dce3700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393815ed10 con 0x7f393815daa0 2023-10-14T12:34:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f393dce3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393815de80 con 0x7f3938071850 2023-10-14T12:34:50.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f3937fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f393806d100 0x7f393806d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55064/0 (socket says 172.21.15.72:55064) 2023-10-14T12:34:50.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f3937fff700 1 -- 172.21.15.72:0/710073211 learned_addr learned my addr 172.21.15.72:0/710073211 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:50.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f3936ffd700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3938071850 0x7f3938071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:50.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699212660 0 0) 0x7f39380721f0 con 0x7f393806d100 2023-10-14T12:34:50.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39200035b0 con 0x7f393806d100 2023-10-14T12:34:50.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 <== mon.1 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690808723 0 0) 0x7f393815ed10 con 0x7f393815daa0 2023-10-14T12:34:50.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39380721f0 con 0x7f393815daa0 2023-10-14T12:34:50.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1971463190 0 0) 0x7f39200035b0 con 0x7f393806d100 2023-10-14T12:34:50.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3938071850 msgr2=0x7f3938071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:50.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3938071850 0x7f3938071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 >> v1:172.21.15.123:6789/0 conn(0x7f393815daa0 legacy=0x7f39380af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393815e100 con 0x7f393806d100 2023-10-14T12:34:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f3930001a40 con 0x7f393806d100 2023-10-14T12:34:50.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f3936ffd700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3938071850 0x7f3938071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:34:50.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.219+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 >> v1:172.21.15.72:6789/0 conn(0x7f393806d100 legacy=0x7f393806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:50.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39367fc700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3920003bc0 0x7f3920003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:50.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39367fc700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3938071850 0x7f3920004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:50.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39367fc700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920004d90 0x7f3920005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:50.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393815de80 con 0x7f3920004d90 2023-10-14T12:34:50.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392000bac0 con 0x7f3920003bc0 2023-10-14T12:34:50.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392000bc80 con 0x7f3938071850 2023-10-14T12:34:50.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f3937fff700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920004d90 0x7f3920005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:50.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39377fe700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3920003bc0 0x7f3920003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:50.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f3936ffd700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3938071850 0x7f3920004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:50.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f3937fff700 1 -- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3938071850 msgr2=0x7f3920004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:50.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f3937fff700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3938071850 0x7f3920004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f3937fff700 1 -- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3920003bc0 msgr2=0x7f3920003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:50.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f3937fff700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3920003bc0 0x7f3920003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f3937fff700 1 -- 172.21.15.72:0/710073211 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0094a0 con 0x7f3920004d90 2023-10-14T12:34:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f3937fff700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920004d90 0x7f3920005210 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f393000a6b0 tx=0x7f3920005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fabab39203e5dac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39300072d0 con 0x7f3920004d90 2023-10-14T12:34:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3930007430 con 0x7f3920004d90 2023-10-14T12:34:50.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.220+0000 7f39367fc700 1 -- 172.21.15.72:0/710073211 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39300077e0 con 0x7f3920004d90 2023-10-14T12:34:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.221+0000 7f393dce3700 1 -- 172.21.15.72:0/710073211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920004d90 msgr2=0x7f3920005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.221+0000 7f393dce3700 1 --2- 172.21.15.72:0/710073211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3920004d90 0x7f3920005210 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f393000a6b0 tx=0x7f3920005880 comp rx=0 tx=0).stop 2023-10-14T12:34:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.221+0000 7f3937fff700 1 -- 172.21.15.72:0/710073211 reap_dead start 2023-10-14T12:34:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.221+0000 7f393dce3700 1 -- 172.21.15.72:0/710073211 shutdown_connections 2023-10-14T12:34:50.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.221+0000 7f393dce3700 1 -- 172.21.15.72:0/710073211 >> 172.21.15.72:0/710073211 conn(0x7f39380d0180 msgr2=0x7f39380d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.221+0000 7f393dce3700 1 -- 172.21.15.72:0/710073211 shutdown_connections 2023-10-14T12:34:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.221+0000 7f393dce3700 1 -- 172.21.15.72:0/710073211 wait complete. 2023-10-14T12:34:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.222+0000 7f393dce3700 1 Processor -- start 2023-10-14T12:34:50.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.222+0000 7f393dce3700 1 -- start start 2023-10-14T12:34:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f393dce3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3938156b20 0x7f3938159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:50.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f393dce3700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f39380c9f10 0x7f39380b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f393dce3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393815a3a0 0x7f39380b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f393dce3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938156f00 con 0x7f393815a3a0 2023-10-14T12:34:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f393dce3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393815ade0 con 0x7f3938156b20 2023-10-14T12:34:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f393dce3700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393815a820 con 0x7f39380c9f10 2023-10-14T12:34:50.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3937fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393815a3a0 0x7f39380b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3937fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393815a3a0 0x7f39380b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48776/0 (socket says 172.21.15.72:48776) 2023-10-14T12:34:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3937fff700 1 -- 172.21.15.72:0/3487752871 learned_addr learned my addr 172.21.15.72:0/3487752871 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f39377fe700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3938156b20 0x7f3938159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:50.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3936ffd700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f39380c9f10 0x7f39380b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3937fff700 1 -- 172.21.15.72:0/3487752871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f39380c9f10 msgr2=0x7f39380b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3937fff700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f39380c9f10 0x7f39380b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3937fff700 1 -- 172.21.15.72:0/3487752871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3938156b20 msgr2=0x7f3938159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:50.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3937fff700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3938156b20 0x7f3938159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3937fff700 1 -- 172.21.15.72:0/3487752871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393815ab00 con 0x7f393815a3a0 2023-10-14T12:34:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f3937fff700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393815a3a0 0x7f39380b2350 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3920005810 tx=0x7f3930001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.223+0000 7f391ffff700 1 -- 172.21.15.72:0/3487752871 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39300079b0 con 0x7f393815a3a0 2023-10-14T12:34:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.224+0000 7f391ffff700 1 -- 172.21.15.72:0/3487752871 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3930007b50 con 0x7f393815a3a0 2023-10-14T12:34:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.224+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39380c8080 con 0x7f393815a3a0 2023-10-14T12:34:50.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.224+0000 7f391ffff700 1 -- 172.21.15.72:0/3487752871 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930012640 con 0x7f393815a3a0 2023-10-14T12:34:50.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.224+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393806a820 con 0x7f393815a3a0 2023-10-14T12:34:50.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.224+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39380c7ee0 con 0x7f393815a3a0 2023-10-14T12:34:50.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.225+0000 7f391ffff700 1 -- 172.21.15.72:0/3487752871 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f393001a070 con 0x7f393815a3a0 2023-10-14T12:34:50.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.225+0000 7f391ffff700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f392406af00 0x7f392406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:50.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.226+0000 7f39377fe700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f392406af00 0x7f392406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:50.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.226+0000 7f391ffff700 1 -- 172.21.15.72:0/3487752871 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f393008a600 con 0x7f393815a3a0 2023-10-14T12:34:50.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.226+0000 7f39377fe700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f392406af00 0x7f392406d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3928007fd0 tx=0x7f3928009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:50.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.230+0000 7f391ffff700 1 -- 172.21.15.72:0/3487752871 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39380c7ee0 con 0x7f393815a3a0 2023-10-14T12:34:50.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.415+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f393815e6c0 con 0x7f392406af00 2023-10-14T12:34:50.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.423+0000 7f391ffff700 1 -- 172.21.15.72:0/3487752871 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283481 (secure 0 0 0) 0x7f3928012730 con 0x7f392406af00 2023-10-14T12:34:50.428 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:50.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f392406af00 msgr2=0x7f392406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f392406af00 0x7f392406d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3928007fd0 tx=0x7f3928009040 comp rx=0 tx=0).stop 2023-10-14T12:34:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393815a3a0 msgr2=0x7f39380b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393815a3a0 0x7f39380b2350 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3920005810 tx=0x7f3930001d00 comp rx=0 tx=0).stop 2023-10-14T12:34:50.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 shutdown_connections 2023-10-14T12:34:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f392406af00 0x7f392406d3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f393815a3a0 0x7f39380b2350 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3938156b20 0x7f3938159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 --2- 172.21.15.72:0/3487752871 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f39380c9f10 0x7f39380b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 >> 172.21.15.72:0/3487752871 conn(0x7f39380d0180 msgr2=0x7f39380cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 shutdown_connections 2023-10-14T12:34:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:50.426+0000 7f393dce3700 1 -- 172.21.15.72:0/3487752871 wait complete. 2023-10-14T12:34:50.433 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:34:50.440 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-10-14T12:34:49.400836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220536,"kb_used_data":4368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754184,"statfs":{"total":773094113280,"available":772868284416,"internally_reserved":0,"allocated":4472832,"data_stored":2571404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000935"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726871+0000","last_change":"2023-10-14T12:34:43.726871+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726871+0000","last_undegraded":"2023-10-14T12:34:43.726871+0000","last_fullsized":"2023-10-14T12:34:43.726871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724752+0000","last_change":"2023-10-14T12:34:43.724752+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724752+0000","last_undegraded":"2023-10-14T12:34:43.724752+0000","last_fullsized":"2023-10-14T12:34:43.724752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724202+0000","last_change":"2023-10-14T12:34:43.724202+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724202+0000","last_undegraded":"2023-10-14T12:34:43.724202+0000","last_fullsized":"2023-10-14T12:34:43.724202+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723472+0000","last_change":"2023-10-14T12:34:43.723472+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723472+0000","last_undegraded":"2023-10-14T12:34:43.723472+0000","last_fullsized":"2023-10-14T12:34:43.723472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724099+0000","last_change":"2023-10-14T12:34:43.724099+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724099+0000","last_undegraded":"2023-10-14T12:34:43.724099+0000","last_fullsized":"2023-10-14T12:34:43.724099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726733+0000","last_change":"2023-10-14T12:34:43.726733+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726733+0000","last_undegraded":"2023-10-14T12:34:43.726733+0000","last_fullsized":"2023-10-14T12:34:43.726733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727120+0000","last_change":"2023-10-14T12:34:43.727120+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727120+0000","last_undegraded":"2023-10-14T12:34:43.727120+0000","last_fullsized":"2023-10-14T12:34:43.727120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725833+0000","last_change":"2023-10-14T12:34:43.725833+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725833+0000","last_undegraded":"2023-10-14T12:34:43.725833+0000","last_fullsized":"2023-10-14T12:34:43.725833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723760+0000","last_change":"2023-10-14T12:34:43.723760+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723760+0000","last_undegraded":"2023-10-14T12:34:43.723760+0000","last_fullsized":"2023-10-14T12:34:43.723760+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727666+0000","last_change":"2023-10-14T12:34:43.727666+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727666+0000","last_undegraded":"2023-10-14T12:34:43.727666+0000","last_fullsized":"2023-10-14T12:34:43.727666+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728346+0000","last_change":"2023-10-14T12:34:43.728346+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728346+0000","last_undegraded":"2023-10-14T12:34:43.728346+0000","last_fullsized":"2023-10-14T12:34:43.728346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723075+0000","last_change":"2023-10-14T12:34:43.723075+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723075+0000","last_undegraded":"2023-10-14T12:34:43.723075+0000","last_fullsized":"2023-10-14T12:34:43.723075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728011+0000","last_change":"2023-10-14T12:34:43.728011+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728011+0000","last_undegraded":"2023-10-14T12:34:43.728011+0000","last_fullsized":"2023-10-14T12:34:43.728011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731771+0000","last_change":"2023-10-14T12:34:43.731771+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731771+0000","last_undegraded":"2023-10-14T12:34:43.731771+0000","last_fullsized":"2023-10-14T12:34:43.731771+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.729162+0000","last_change":"2023-10-14T12:34:43.729162+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.729162+0000","last_undegraded":"2023-10-14T12:34:43.729162+0000","last_fullsized":"2023-10-14T12:34:43.729162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.734826+0000","last_change":"2023-10-14T12:34:43.734826+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.734826+0000","last_undegraded":"2023-10-14T12:34:43.734826+0000","last_fullsized":"2023-10-14T12:34:43.734826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.737373+0000","last_change":"2023-10-14T12:34:43.737373+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.737373+0000","last_undegraded":"2023-10-14T12:34:43.737373+0000","last_fullsized":"2023-10-14T12:34:43.737373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.732827+0000","last_change":"2023-10-14T12:34:43.732827+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.732827+0000","last_undegraded":"2023-10-14T12:34:43.732827+0000","last_fullsized":"2023-10-14T12:34:43.732827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722586+0000","last_change":"2023-10-14T12:34:43.722586+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722586+0000","last_undegraded":"2023-10-14T12:34:43.722586+0000","last_fullsized":"2023-10-14T12:34:43.722586+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.732974+0000","last_change":"2023-10-14T12:34:43.732974+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.732974+0000","last_undegraded":"2023-10-14T12:34:43.732974+0000","last_fullsized":"2023-10-14T12:34:43.732974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727552+0000","last_change":"2023-10-14T12:34:43.727552+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727552+0000","last_undegraded":"2023-10-14T12:34:43.727552+0000","last_fullsized":"2023-10-14T12:34:43.727552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731090+0000","last_change":"2023-10-14T12:34:43.731090+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731090+0000","last_undegraded":"2023-10-14T12:34:43.731090+0000","last_fullsized":"2023-10-14T12:34:43.731090+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733917+0000","last_change":"2023-10-14T12:34:43.733917+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733917+0000","last_undegraded":"2023-10-14T12:34:43.733917+0000","last_fullsized":"2023-10-14T12:34:43.733917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722559+0000","last_change":"2023-10-14T12:34:43.722559+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722559+0000","last_undegraded":"2023-10-14T12:34:43.722559+0000","last_fullsized":"2023-10-14T12:34:43.722559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730237+0000","last_change":"2023-10-14T12:34:43.730237+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730237+0000","last_undegraded":"2023-10-14T12:34:43.730237+0000","last_fullsized":"2023-10-14T12:34:43.730237+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728919+0000","last_change":"2023-10-14T12:34:43.728919+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728919+0000","last_undegraded":"2023-10-14T12:34:43.728919+0000","last_fullsized":"2023-10-14T12:34:43.728919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730552+0000","last_change":"2023-10-14T12:34:43.730552+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730552+0000","last_undegraded":"2023-10-14T12:34:43.730552+0000","last_fullsized":"2023-10-14T12:34:43.730552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726622+0000","last_change":"2023-10-14T12:34:43.726622+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726622+0000","last_undegraded":"2023-10-14T12:34:43.726622+0000","last_fullsized":"2023-10-14T12:34:43.726622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731369+0000","last_change":"2023-10-14T12:34:43.731369+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731369+0000","last_undegraded":"2023-10-14T12:34:43.731369+0000","last_fullsized":"2023-10-14T12:34:43.731369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727714+0000","last_change":"2023-10-14T12:34:43.727714+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727714+0000","last_undegraded":"2023-10-14T12:34:43.727714+0000","last_fullsized":"2023-10-14T12:34:43.727714+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.738442+0000","last_change":"2023-10-14T12:34:43.738442+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.738442+0000","last_undegraded":"2023-10-14T12:34:43.738442+0000","last_fullsized":"2023-10-14T12:34:43.738442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725827+0000","last_change":"2023-10-14T12:34:43.725827+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725827+0000","last_undegraded":"2023-10-14T12:34:43.725827+0000","last_fullsized":"2023-10-14T12:34:43.725827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.736133+0000","last_change":"2023-10-14T12:34:43.736133+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.736133+0000","last_undegraded":"2023-10-14T12:34:43.736133+0000","last_fullsized":"2023-10-14T12:34:43.736133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.747085+0000","last_change":"2023-10-14T12:34:43.742439+0000","last_active":"2023-10-14T12:34:43.747085+0000","last_peered":"2023-10-14T12:34:43.747085+0000","last_clean":"2023-10-14T12:34:43.747085+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:34:43.747085+0000","last_undegraded":"2023-10-14T12:34:43.747085+0000","last_fullsized":"2023-10-14T12:34:43.747085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726722+0000","last_change":"2023-10-14T12:34:43.726722+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726722+0000","last_undegraded":"2023-10-14T12:34:43.726722+0000","last_fullsized":"2023-10-14T12:34:43.726722+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.741767+0000","last_change":"2023-10-14T12:34:43.740875+0000","last_active":"2023-10-14T12:34:43.741767+0000","last_peered":"2023-10-14T12:34:43.741767+0000","last_clean":"2023-10-14T12:34:43.741767+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:34:43.741767+0000","last_undegraded":"2023-10-14T12:34:43.741767+0000","last_fullsized":"2023-10-14T12:34:43.741767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733603+0000","last_change":"2023-10-14T12:34:43.733603+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733603+0000","last_undegraded":"2023-10-14T12:34:43.733603+0000","last_fullsized":"2023-10-14T12:34:43.733603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740682+0000","last_change":"2023-10-14T12:34:43.737909+0000","last_active":"2023-10-14T12:34:43.740682+0000","last_peered":"2023-10-14T12:34:43.740682+0000","last_clean":"2023-10-14T12:34:43.740682+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:34:43.740682+0000","last_undegraded":"2023-10-14T12:34:43.740682+0000","last_fullsized":"2023-10-14T12:34:43.740682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:58.323321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724904+0000","last_change":"2023-10-14T12:34:43.724904+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724904+0000","last_undegraded":"2023-10-14T12:34:43.724904+0000","last_fullsized":"2023-10-14T12:34:43.724904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742667+0000","last_change":"2023-10-14T12:34:43.738060+0000","last_active":"2023-10-14T12:34:43.742667+0000","last_peered":"2023-10-14T12:34:43.742667+0000","last_clean":"2023-10-14T12:34:43.742667+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:34:43.742667+0000","last_undegraded":"2023-10-14T12:34:43.742667+0000","last_fullsized":"2023-10-14T12:34:43.742667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:05.797624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724345+0000","last_change":"2023-10-14T12:34:43.724345+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724345+0000","last_undegraded":"2023-10-14T12:34:43.724345+0000","last_fullsized":"2023-10-14T12:34:43.724345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.745697+0000","last_change":"2023-10-14T12:34:43.738857+0000","last_active":"2023-10-14T12:34:43.745697+0000","last_peered":"2023-10-14T12:34:43.745697+0000","last_clean":"2023-10-14T12:34:43.745697+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:34:43.745697+0000","last_undegraded":"2023-10-14T12:34:43.745697+0000","last_fullsized":"2023-10-14T12:34:43.745697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.727761+0000","last_change":"2023-10-14T12:34:43.727761+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.727761+0000","last_undegraded":"2023-10-14T12:34:43.727761+0000","last_fullsized":"2023-10-14T12:34:43.727761+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753769+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:43.753769+0000","last_peered":"2023-10-14T12:34:43.753769+0000","last_clean":"2023-10-14T12:34:43.753769+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:43.753769+0000","last_undegraded":"2023-10-14T12:34:43.753769+0000","last_fullsized":"2023-10-14T12:34:43.753769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.730609+0000","last_change":"2023-10-14T12:34:43.730609+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.730609+0000","last_undegraded":"2023-10-14T12:34:43.730609+0000","last_fullsized":"2023-10-14T12:34:43.730609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740755+0000","last_change":"2023-10-14T12:34:43.738248+0000","last_active":"2023-10-14T12:34:43.740755+0000","last_peered":"2023-10-14T12:34:43.740755+0000","last_clean":"2023-10-14T12:34:43.740755+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:34:43.740755+0000","last_undegraded":"2023-10-14T12:34:43.740755+0000","last_fullsized":"2023-10-14T12:34:43.740755+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725594+0000","last_change":"2023-10-14T12:34:43.725594+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725594+0000","last_undegraded":"2023-10-14T12:34:43.725594+0000","last_fullsized":"2023-10-14T12:34:43.725594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742475+0000","last_change":"2023-10-14T12:34:43.737450+0000","last_active":"2023-10-14T12:34:43.742475+0000","last_peered":"2023-10-14T12:34:43.742475+0000","last_clean":"2023-10-14T12:34:43.742475+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:34:43.742475+0000","last_undegraded":"2023-10-14T12:34:43.742475+0000","last_fullsized":"2023-10-14T12:34:43.742475+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.722903+0000","last_change":"2023-10-14T12:34:43.722903+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.722903+0000","last_undegraded":"2023-10-14T12:34:43.722903+0000","last_fullsized":"2023-10-14T12:34:43.722903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.735239+0000","last_change":"2023-10-14T12:34:43.733989+0000","last_active":"2023-10-14T12:34:43.735239+0000","last_peered":"2023-10-14T12:34:43.735239+0000","last_clean":"2023-10-14T12:34:43.735239+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:34:43.735239+0000","last_undegraded":"2023-10-14T12:34:43.735239+0000","last_fullsized":"2023-10-14T12:34:43.735239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:55.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.738155+0000","last_change":"2023-10-14T12:34:43.738155+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.738155+0000","last_undegraded":"2023-10-14T12:34:43.738155+0000","last_fullsized":"2023-10-14T12:34:43.738155+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740478+0000","last_change":"2023-10-14T12:34:43.734905+0000","last_active":"2023-10-14T12:34:43.740478+0000","last_peered":"2023-10-14T12:34:43.740478+0000","last_clean":"2023-10-14T12:34:43.740478+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:34:43.740478+0000","last_undegraded":"2023-10-14T12:34:43.740478+0000","last_fullsized":"2023-10-14T12:34:43.740478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723631+0000","last_change":"2023-10-14T12:34:43.723631+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723631+0000","last_undegraded":"2023-10-14T12:34:43.723631+0000","last_fullsized":"2023-10-14T12:34:43.723631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.743478+0000","last_change":"2023-10-14T12:34:43.735967+0000","last_active":"2023-10-14T12:34:43.743478+0000","last_peered":"2023-10-14T12:34:43.743478+0000","last_clean":"2023-10-14T12:34:43.743478+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:34:43.743478+0000","last_undegraded":"2023-10-14T12:34:43.743478+0000","last_fullsized":"2023-10-14T12:34:43.743478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.729931+0000","last_change":"2023-10-14T12:34:43.729931+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.729931+0000","last_undegraded":"2023-10-14T12:34:43.729931+0000","last_fullsized":"2023-10-14T12:34:43.729931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.741962+0000","last_change":"2023-10-14T12:34:43.741443+0000","last_active":"2023-10-14T12:34:43.741962+0000","last_peered":"2023-10-14T12:34:43.741962+0000","last_clean":"2023-10-14T12:34:43.741962+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:34:43.741962+0000","last_undegraded":"2023-10-14T12:34:43.741962+0000","last_fullsized":"2023-10-14T12:34:43.741962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.725130+0000","last_change":"2023-10-14T12:34:43.725130+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.725130+0000","last_undegraded":"2023-10-14T12:34:43.725130+0000","last_fullsized":"2023-10-14T12:34:43.725130+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740147+0000","last_change":"2023-10-14T12:34:43.738642+0000","last_active":"2023-10-14T12:34:43.740147+0000","last_peered":"2023-10-14T12:34:43.740147+0000","last_clean":"2023-10-14T12:34:43.740147+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:34:43.740147+0000","last_undegraded":"2023-10-14T12:34:43.740147+0000","last_fullsized":"2023-10-14T12:34:43.740147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:21.861042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724284+0000","last_change":"2023-10-14T12:34:43.724284+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724284+0000","last_undegraded":"2023-10-14T12:34:43.724284+0000","last_fullsized":"2023-10-14T12:34:43.724284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740594+0000","last_change":"2023-10-14T12:34:43.738291+0000","last_active":"2023-10-14T12:34:43.740594+0000","last_peered":"2023-10-14T12:34:43.740594+0000","last_clean":"2023-10-14T12:34:43.740594+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:34:43.740594+0000","last_undegraded":"2023-10-14T12:34:43.740594+0000","last_fullsized":"2023-10-14T12:34:43.740594+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:27.820010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.736704+0000","last_change":"2023-10-14T12:34:43.736704+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.736704+0000","last_undegraded":"2023-10-14T12:34:43.736704+0000","last_fullsized":"2023-10-14T12:34:43.736704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.746993+0000","last_change":"2023-10-14T12:34:43.742416+0000","last_active":"2023-10-14T12:34:43.746993+0000","last_peered":"2023-10-14T12:34:43.746993+0000","last_clean":"2023-10-14T12:34:43.746993+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:34:43.746993+0000","last_undegraded":"2023-10-14T12:34:43.746993+0000","last_fullsized":"2023-10-14T12:34:43.746993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726426+0000","last_change":"2023-10-14T12:34:43.726426+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726426+0000","last_undegraded":"2023-10-14T12:34:43.726426+0000","last_fullsized":"2023-10-14T12:34:43.726426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753719+0000","last_change":"2023-10-14T12:34:43.745867+0000","last_active":"2023-10-14T12:34:43.753719+0000","last_peered":"2023-10-14T12:34:43.753719+0000","last_clean":"2023-10-14T12:34:43.753719+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:34:43.753719+0000","last_undegraded":"2023-10-14T12:34:43.753719+0000","last_fullsized":"2023-10-14T12:34:43.753719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:58.323321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724608+0000","last_change":"2023-10-14T12:34:43.724608+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724608+0000","last_undegraded":"2023-10-14T12:34:43.724608+0000","last_fullsized":"2023-10-14T12:34:43.724608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.748271+0000","last_change":"2023-10-14T12:34:43.743560+0000","last_active":"2023-10-14T12:34:43.748271+0000","last_peered":"2023-10-14T12:34:43.748271+0000","last_clean":"2023-10-14T12:34:43.748271+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:34:43.748271+0000","last_undegraded":"2023-10-14T12:34:43.748271+0000","last_fullsized":"2023-10-14T12:34:43.748271+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:55.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728831+0000","last_change":"2023-10-14T12:34:43.728831+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728831+0000","last_undegraded":"2023-10-14T12:34:43.728831+0000","last_fullsized":"2023-10-14T12:34:43.728831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742565+0000","last_change":"2023-10-14T12:34:43.738033+0000","last_active":"2023-10-14T12:34:43.742565+0000","last_peered":"2023-10-14T12:34:43.742565+0000","last_clean":"2023-10-14T12:34:43.742565+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:34:43.742565+0000","last_undegraded":"2023-10-14T12:34:43.742565+0000","last_fullsized":"2023-10-14T12:34:43.742565+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:04.272524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.731148+0000","last_change":"2023-10-14T12:34:43.731148+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.731148+0000","last_undegraded":"2023-10-14T12:34:43.731148+0000","last_fullsized":"2023-10-14T12:34:43.731148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.745282+0000","last_change":"2023-10-14T12:34:43.744197+0000","last_active":"2023-10-14T12:34:43.745282+0000","last_peered":"2023-10-14T12:34:43.745282+0000","last_clean":"2023-10-14T12:34:43.745282+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:34:43.745282+0000","last_undegraded":"2023-10-14T12:34:43.745282+0000","last_fullsized":"2023-10-14T12:34:43.745282+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:41.521231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723520+0000","last_change":"2023-10-14T12:34:43.723520+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723520+0000","last_undegraded":"2023-10-14T12:34:43.723520+0000","last_fullsized":"2023-10-14T12:34:43.723520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740574+0000","last_change":"2023-10-14T12:34:43.739053+0000","last_active":"2023-10-14T12:34:43.740574+0000","last_peered":"2023-10-14T12:34:43.740574+0000","last_clean":"2023-10-14T12:34:43.740574+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:34:43.740574+0000","last_undegraded":"2023-10-14T12:34:43.740574+0000","last_fullsized":"2023-10-14T12:34:43.740574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:03.125663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.733799+0000","last_change":"2023-10-14T12:34:43.733799+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.733799+0000","last_undegraded":"2023-10-14T12:34:43.733799+0000","last_fullsized":"2023-10-14T12:34:43.733799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740751+0000","last_change":"2023-10-14T12:34:43.739027+0000","last_active":"2023-10-14T12:34:43.740751+0000","last_peered":"2023-10-14T12:34:43.740751+0000","last_clean":"2023-10-14T12:34:43.740751+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:34:43.740751+0000","last_undegraded":"2023-10-14T12:34:43.740751+0000","last_fullsized":"2023-10-14T12:34:43.740751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:51:35.469703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.723958+0000","last_change":"2023-10-14T12:34:43.723958+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.723958+0000","last_undegraded":"2023-10-14T12:34:43.723958+0000","last_fullsized":"2023-10-14T12:34:43.723958+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740535+0000","last_change":"2023-10-14T12:34:43.739164+0000","last_active":"2023-10-14T12:34:43.740535+0000","last_peered":"2023-10-14T12:34:43.740535+0000","last_clean":"2023-10-14T12:34:43.740535+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:34:43.740535+0000","last_undegraded":"2023-10-14T12:34:43.740535+0000","last_fullsized":"2023-10-14T12:34:43.740535+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:30:03.927284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726453+0000","last_change":"2023-10-14T12:34:43.726453+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726453+0000","last_undegraded":"2023-10-14T12:34:43.726453+0000","last_fullsized":"2023-10-14T12:34:43.726453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.753767+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:43.753767+0000","last_peered":"2023-10-14T12:34:43.753767+0000","last_clean":"2023-10-14T12:34:43.753767+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:43.753767+0000","last_undegraded":"2023-10-14T12:34:43.753767+0000","last_fullsized":"2023-10-14T12:34:43.753767+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726031+0000","last_change":"2023-10-14T12:34:43.726031+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726031+0000","last_undegraded":"2023-10-14T12:34:43.726031+0000","last_fullsized":"2023-10-14T12:34:43.726031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740525+0000","last_change":"2023-10-14T12:34:43.737529+0000","last_active":"2023-10-14T12:34:43.740525+0000","last_peered":"2023-10-14T12:34:43.740525+0000","last_clean":"2023-10-14T12:34:43.740525+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:34:43.740525+0000","last_undegraded":"2023-10-14T12:34:43.740525+0000","last_fullsized":"2023-10-14T12:34:43.740525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:22.993010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.726282+0000","last_change":"2023-10-14T12:34:43.726282+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.726282+0000","last_undegraded":"2023-10-14T12:34:43.726282+0000","last_fullsized":"2023-10-14T12:34:43.726282+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740607+0000","last_change":"2023-10-14T12:34:43.735693+0000","last_active":"2023-10-14T12:34:43.740607+0000","last_peered":"2023-10-14T12:34:43.740607+0000","last_clean":"2023-10-14T12:34:43.740607+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:34:43.740607+0000","last_undegraded":"2023-10-14T12:34:43.740607+0000","last_fullsized":"2023-10-14T12:34:43.740607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.737750+0000","last_change":"2023-10-14T12:34:43.737750+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.737750+0000","last_undegraded":"2023-10-14T12:34:43.737750+0000","last_fullsized":"2023-10-14T12:34:43.737750+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740007+0000","last_change":"2023-10-14T12:34:43.735820+0000","last_active":"2023-10-14T12:34:43.740007+0000","last_peered":"2023-10-14T12:34:43.740007+0000","last_clean":"2023-10-14T12:34:43.740007+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:34:43.740007+0000","last_undegraded":"2023-10-14T12:34:43.740007+0000","last_fullsized":"2023-10-14T12:34:43.740007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:27.870090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724257+0000","last_change":"2023-10-14T12:34:43.724257+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724257+0000","last_undegraded":"2023-10-14T12:34:43.724257+0000","last_fullsized":"2023-10-14T12:34:43.724257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.739633+0000","last_change":"2023-10-14T12:34:43.736834+0000","last_active":"2023-10-14T12:34:43.739633+0000","last_peered":"2023-10-14T12:34:43.739633+0000","last_clean":"2023-10-14T12:34:43.739633+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:34:43.739633+0000","last_undegraded":"2023-10-14T12:34:43.739633+0000","last_fullsized":"2023-10-14T12:34:43.739633+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:35:03.125663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.724745+0000","last_change":"2023-10-14T12:34:43.724745+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.724745+0000","last_undegraded":"2023-10-14T12:34:43.724745+0000","last_fullsized":"2023-10-14T12:34:43.724745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.740502+0000","last_change":"2023-10-14T12:34:43.737030+0000","last_active":"2023-10-14T12:34:43.740502+0000","last_peered":"2023-10-14T12:34:43.740502+0000","last_clean":"2023-10-14T12:34:43.740502+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:34:43.740502+0000","last_undegraded":"2023-10-14T12:34:43.740502+0000","last_fullsized":"2023-10-14T12:34:43.740502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:30.331498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728018+0000","last_change":"2023-10-14T12:34:43.728018+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728018+0000","last_undegraded":"2023-10-14T12:34:43.728018+0000","last_fullsized":"2023-10-14T12:34:43.728018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.744699+0000","last_change":"2023-10-14T12:34:43.740716+0000","last_active":"2023-10-14T12:34:43.744699+0000","last_peered":"2023-10-14T12:34:43.744699+0000","last_clean":"2023-10-14T12:34:43.744699+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:34:43.744699+0000","last_undegraded":"2023-10-14T12:34:43.744699+0000","last_fullsized":"2023-10-14T12:34:43.744699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:05.797624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728840+0000","last_change":"2023-10-14T12:34:43.728840+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728840+0000","last_undegraded":"2023-10-14T12:34:43.728840+0000","last_fullsized":"2023-10-14T12:34:43.728840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.742661+0000","last_change":"2023-10-14T12:34:43.738818+0000","last_active":"2023-10-14T12:34:43.742661+0000","last_peered":"2023-10-14T12:34:43.742661+0000","last_clean":"2023-10-14T12:34:43.742661+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:34:43.742661+0000","last_undegraded":"2023-10-14T12:34:43.742661+0000","last_fullsized":"2023-10-14T12:34:43.742661+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:09.474609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.735443+0000","last_change":"2023-10-14T12:34:43.735443+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.735443+0000","last_undegraded":"2023-10-14T12:34:43.735443+0000","last_fullsized":"2023-10-14T12:34:43.735443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.734046+0000","last_change":"2023-10-14T12:34:43.733187+0000","last_active":"2023-10-14T12:34:43.734046+0000","last_peered":"2023-10-14T12:34:43.734046+0000","last_clean":"2023-10-14T12:34:43.734046+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:34:43.734046+0000","last_undegraded":"2023-10-14T12:34:43.734046+0000","last_fullsized":"2023-10-14T12:34:43.734046+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-10-14T12:34:43.728733+0000","last_change":"2023-10-14T12:34:43.728733+0000","last_active":"2023-10-14T12:34:43.715979+0000","last_peered":"2023-10-14T12:34:43.715979+0000","last_clean":"2023-10-14T12:34:43.715979+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:34:43.728733+0000","last_undegraded":"2023-10-14T12:34:43.728733+0000","last_fullsized":"2023-10-14T12:34:43.728733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-10-14T12:34:43.748395+0000","last_change":"2023-10-14T12:34:43.744939+0000","last_active":"2023-10-14T12:34:43.748395+0000","last_peered":"2023-10-14T12:34:43.748395+0000","last_clean":"2023-10-14T12:34:43.748395+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:34:43.748395+0000","last_undegraded":"2023-10-14T12:34:43.748395+0000","last_fullsized":"2023-10-14T12:34:43.748395+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-14T12:34:42.726034+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:34:42.726034+0000","last_peered":"2023-10-14T12:34:42.726034+0000","last_clean":"2023-10-14T12:34:42.726034+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:34:42.726034+0000","last_undegraded":"2023-10-14T12:34:42.726034+0000","last_fullsized":"2023-10-14T12:34:42.726034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":765854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.60199999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.63200000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.432},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67600000000000005}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.66400000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.53700000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.623}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.441},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.35899999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.376},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39200000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.501}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":168876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.371},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.245}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.29199999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.74299999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.52900000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":765854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.33500000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.26100000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.315},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.438}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.30099999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.32300000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.377},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.47699999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.32300000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.56899999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.63900000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.626}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.52300000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.47999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":168876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.629}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.379}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:34:53.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:34:53.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.582+0000 7fa5fb0d4700 1 Processor -- start 2023-10-14T12:34:53.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.582+0000 7fa5fb0d4700 1 -- start start 2023-10-14T12:34:53.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.582+0000 7fa5fb0d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa5f406a820 0x7fa5f40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.582+0000 7fa5fb0d4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f40cfeb0 con 0x7fa5f415e7f0 2023-10-14T12:34:53.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.582+0000 7fa5fb0d4700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f415ec50 con 0x7fa5f40ca7d0 2023-10-14T12:34:53.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.582+0000 7fa5fb0d4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f40ce410 con 0x7fa5f406a820 2023-10-14T12:34:53.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f8e70700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa5f406a820 0x7fa5f40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa5f415e7f0 0x7fa5f406ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55080/0 (socket says 172.21.15.72:55080) 2023-10-14T12:34:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f3fff700 1 -- 172.21.15.72:0/2327418534 learned_addr learned my addr 172.21.15.72:0/2327418534 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f8e70700 1 -- 172.21.15.72:0/2327418534 >> v1:172.21.15.123:6789/0 conn(0x7fa5f40ca7d0 legacy=0x7fa5f4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f8e70700 1 -- 172.21.15.72:0/2327418534 >> v1:172.21.15.72:6789/0 conn(0x7fa5f415e7f0 legacy=0x7fa5f406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f8e70700 1 -- 172.21.15.72:0/2327418534 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f40af9d0 con 0x7fa5f406a820 2023-10-14T12:34:53.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f37fe700 1 -- 172.21.15.72:0/2327418534 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546316940 0 0) 0x7fa5f40cfeb0 con 0x7fa5f415e7f0 2023-10-14T12:34:53.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f8e70700 1 --2- 172.21.15.72:0/2327418534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f406a820 0x7fa5f40cf7d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009840 tx=0x7fa5e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a234a28fd313a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:53.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f37fe700 1 -- 172.21.15.72:0/2327418534 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8004230 con 0x7fa5f406a820 2023-10-14T12:34:53.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f37fe700 1 -- 172.21.15.72:0/2327418534 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8004390 con 0x7fa5f406a820 2023-10-14T12:34:53.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.583+0000 7fa5f37fe700 1 -- 172.21.15.72:0/2327418534 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80036a0 con 0x7fa5f406a820 2023-10-14T12:34:53.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.584+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/2327418534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f406a820 msgr2=0x7fa5f40cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.584+0000 7fa5fb0d4700 1 --2- 172.21.15.72:0/2327418534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f406a820 0x7fa5f40cf7d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009840 tx=0x7fa5e8009b50 comp rx=0 tx=0).stop 2023-10-14T12:34:53.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.584+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/2327418534 shutdown_connections 2023-10-14T12:34:53.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.584+0000 7fa5fb0d4700 1 --2- 172.21.15.72:0/2327418534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f406a820 0x7fa5f40cf7d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.584+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/2327418534 >> 172.21.15.72:0/2327418534 conn(0x7fa5f40d0180 msgr2=0x7fa5f40d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:53.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.584+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/2327418534 shutdown_connections 2023-10-14T12:34:53.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.584+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/2327418534 wait complete. 2023-10-14T12:34:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.585+0000 7fa5fb0d4700 1 Processor -- start 2023-10-14T12:34:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.585+0000 7fa5fb0d4700 1 -- start start 2023-10-14T12:34:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5fb0d4700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa5f406a820 0x7fa5f40b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5fb0d4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5f40ca7d0 0x7fa5f4152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5fb0d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f415e7f0 0x7fa5f40c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5fb0d4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40b56a0 con 0x7fa5f415e7f0 2023-10-14T12:34:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5fb0d4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40b40c0 con 0x7fa5f40ca7d0 2023-10-14T12:34:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5fb0d4700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40b43a0 con 0x7fa5f406a820 2023-10-14T12:34:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f9671700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f415e7f0 0x7fa5f40c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f9671700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f415e7f0 0x7fa5f40c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48788/0 (socket says 172.21.15.72:48788) 2023-10-14T12:34:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f9671700 1 -- 172.21.15.72:0/3049951272 learned_addr learned my addr 172.21.15.72:0/3049951272 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f3fff700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5f40ca7d0 0x7fa5f4152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f8e70700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa5f406a820 0x7fa5f40b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f9671700 1 -- 172.21.15.72:0/3049951272 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa5f406a820 msgr2=0x7fa5f40b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f9671700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa5f406a820 0x7fa5f40b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f9671700 1 -- 172.21.15.72:0/3049951272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5f40ca7d0 msgr2=0x7fa5f4152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f9671700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5f40ca7d0 0x7fa5f4152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f9671700 1 -- 172.21.15.72:0/3049951272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80094a0 con 0x7fa5f415e7f0 2023-10-14T12:34:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.586+0000 7fa5f9671700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f415e7f0 0x7fa5f40c7250 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00cc10 tx=0x7fa5ec00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:53.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.587+0000 7fa5f17fa700 1 -- 172.21.15.72:0/3049951272 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec004be0 con 0x7fa5f415e7f0 2023-10-14T12:34:53.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.587+0000 7fa5f17fa700 1 -- 172.21.15.72:0/3049951272 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec004d40 con 0x7fa5f415e7f0 2023-10-14T12:34:53.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.587+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f40b4680 con 0x7fa5f415e7f0 2023-10-14T12:34:53.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.587+0000 7fa5f17fa700 1 -- 172.21.15.72:0/3049951272 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00aae0 con 0x7fa5f415e7f0 2023-10-14T12:34:53.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.587+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f40b4c40 con 0x7fa5f415e7f0 2023-10-14T12:34:53.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.588+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f40b4e60 con 0x7fa5f415e7f0 2023-10-14T12:34:53.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.588+0000 7fa5f17fa700 1 -- 172.21.15.72:0/3049951272 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa5ec00ac40 con 0x7fa5f415e7f0 2023-10-14T12:34:53.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.588+0000 7fa5f17fa700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa5d806af00 0x7fa5d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.589+0000 7fa5f17fa700 1 -- 172.21.15.72:0/3049951272 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fa5ec089130 con 0x7fa5f415e7f0 2023-10-14T12:34:53.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.589+0000 7fa5f8e70700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa5d806af00 0x7fa5d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.589+0000 7fa5f8e70700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa5d806af00 0x7fa5d806d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80090b0 tx=0x7fa5e801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:53.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.593+0000 7fa5f17fa700 1 -- 172.21.15.72:0/3049951272 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5ec053fe0 con 0x7fa5f415e7f0 2023-10-14T12:34:53.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.781+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5f40af6f0 con 0x7fa5d806af00 2023-10-14T12:34:53.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.789+0000 7fa5f17fa700 1 -- 172.21.15.72:0/3049951272 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288833 (secure 0 0 0) 0x7fa5e8004130 con 0x7fa5d806af00 2023-10-14T12:34:53.794 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:53.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa5d806af00 msgr2=0x7fa5d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa5d806af00 0x7fa5d806d3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80090b0 tx=0x7fa5e801c040 comp rx=0 tx=0).stop 2023-10-14T12:34:53.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f415e7f0 msgr2=0x7fa5f40c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f415e7f0 0x7fa5f40c7250 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00cc10 tx=0x7fa5ec00cf20 comp rx=0 tx=0).stop 2023-10-14T12:34:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 shutdown_connections 2023-10-14T12:34:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fa5d806af00 0x7fa5d806d3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5f415e7f0 0x7fa5f40c7250 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fa5f406a820 0x7fa5f40b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 --2- 172.21.15.72:0/3049951272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5f40ca7d0 0x7fa5f4152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 >> 172.21.15.72:0/3049951272 conn(0x7fa5f40d0180 msgr2=0x7fa5f4071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:53.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 shutdown_connections 2023-10-14T12:34:53.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.792+0000 7fa5fb0d4700 1 -- 172.21.15.72:0/3049951272 wait complete. 2023-10-14T12:34:53.800 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:34:53.806 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-14T12:34:53.401691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220856,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753864,"statfs":{"total":773094113280,"available":772867956736,"internally_reserved":0,"allocated":4759552,"data_stored":2699604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.653240"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836180+0000","last_change":"2023-10-14T12:34:44.773258+0000","last_active":"2023-10-14T12:34:45.836180+0000","last_peered":"2023-10-14T12:34:45.836180+0000","last_clean":"2023-10-14T12:34:45.836180+0000","last_became_active":"2023-10-14T12:34:44.772874+0000","last_became_peered":"2023-10-14T12:34:44.772874+0000","last_unstale":"2023-10-14T12:34:45.836180+0000","last_undegraded":"2023-10-14T12:34:45.836180+0000","last_fullsized":"2023-10-14T12:34:45.836180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835866+0000","last_change":"2023-10-14T12:34:44.766065+0000","last_active":"2023-10-14T12:34:45.835866+0000","last_peered":"2023-10-14T12:34:45.835866+0000","last_clean":"2023-10-14T12:34:45.835866+0000","last_became_active":"2023-10-14T12:34:44.765783+0000","last_became_peered":"2023-10-14T12:34:44.765783+0000","last_unstale":"2023-10-14T12:34:45.835866+0000","last_undegraded":"2023-10-14T12:34:45.835866+0000","last_fullsized":"2023-10-14T12:34:45.835866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836798+0000","last_change":"2023-10-14T12:34:44.766216+0000","last_active":"2023-10-14T12:34:45.836798+0000","last_peered":"2023-10-14T12:34:45.836798+0000","last_clean":"2023-10-14T12:34:45.836798+0000","last_became_active":"2023-10-14T12:34:44.765915+0000","last_became_peered":"2023-10-14T12:34:44.765915+0000","last_unstale":"2023-10-14T12:34:45.836798+0000","last_undegraded":"2023-10-14T12:34:45.836798+0000","last_fullsized":"2023-10-14T12:34:45.836798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835634+0000","last_change":"2023-10-14T12:34:44.776783+0000","last_active":"2023-10-14T12:34:45.835634+0000","last_peered":"2023-10-14T12:34:45.835634+0000","last_clean":"2023-10-14T12:34:45.835634+0000","last_became_active":"2023-10-14T12:34:44.776527+0000","last_became_peered":"2023-10-14T12:34:44.776527+0000","last_unstale":"2023-10-14T12:34:45.835634+0000","last_undegraded":"2023-10-14T12:34:45.835634+0000","last_fullsized":"2023-10-14T12:34:45.835634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:10.476396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835368+0000","last_change":"2023-10-14T12:34:44.774798+0000","last_active":"2023-10-14T12:34:45.835368+0000","last_peered":"2023-10-14T12:34:45.835368+0000","last_clean":"2023-10-14T12:34:45.835368+0000","last_became_active":"2023-10-14T12:34:44.774508+0000","last_became_peered":"2023-10-14T12:34:44.774508+0000","last_unstale":"2023-10-14T12:34:45.835368+0000","last_undegraded":"2023-10-14T12:34:45.835368+0000","last_fullsized":"2023-10-14T12:34:45.835368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.842813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835002+0000","last_change":"2023-10-14T12:34:44.771286+0000","last_active":"2023-10-14T12:34:45.835002+0000","last_peered":"2023-10-14T12:34:45.835002+0000","last_clean":"2023-10-14T12:34:45.835002+0000","last_became_active":"2023-10-14T12:34:44.768717+0000","last_became_peered":"2023-10-14T12:34:44.768717+0000","last_unstale":"2023-10-14T12:34:45.835002+0000","last_undegraded":"2023-10-14T12:34:45.835002+0000","last_fullsized":"2023-10-14T12:34:45.835002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764118+0000","last_change":"2023-10-14T12:34:44.771173+0000","last_active":"2023-10-14T12:34:45.764118+0000","last_peered":"2023-10-14T12:34:45.764118+0000","last_clean":"2023-10-14T12:34:45.764118+0000","last_became_active":"2023-10-14T12:34:44.770869+0000","last_became_peered":"2023-10-14T12:34:44.770869+0000","last_unstale":"2023-10-14T12:34:45.764118+0000","last_undegraded":"2023-10-14T12:34:45.764118+0000","last_fullsized":"2023-10-14T12:34:45.764118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835912+0000","last_change":"2023-10-14T12:34:44.766306+0000","last_active":"2023-10-14T12:34:45.835912+0000","last_peered":"2023-10-14T12:34:45.835912+0000","last_clean":"2023-10-14T12:34:45.835912+0000","last_became_active":"2023-10-14T12:34:44.765917+0000","last_became_peered":"2023-10-14T12:34:44.765917+0000","last_unstale":"2023-10-14T12:34:45.835912+0000","last_undegraded":"2023-10-14T12:34:45.835912+0000","last_fullsized":"2023-10-14T12:34:45.835912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836985+0000","last_change":"2023-10-14T12:34:44.769040+0000","last_active":"2023-10-14T12:34:45.836985+0000","last_peered":"2023-10-14T12:34:45.836985+0000","last_clean":"2023-10-14T12:34:45.836985+0000","last_became_active":"2023-10-14T12:34:44.768514+0000","last_became_peered":"2023-10-14T12:34:44.768514+0000","last_unstale":"2023-10-14T12:34:45.836985+0000","last_undegraded":"2023-10-14T12:34:45.836985+0000","last_fullsized":"2023-10-14T12:34:45.836985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765522+0000","last_change":"2023-10-14T12:34:44.764554+0000","last_active":"2023-10-14T12:34:45.765522+0000","last_peered":"2023-10-14T12:34:45.765522+0000","last_clean":"2023-10-14T12:34:45.765522+0000","last_became_active":"2023-10-14T12:34:44.764252+0000","last_became_peered":"2023-10-14T12:34:44.764252+0000","last_unstale":"2023-10-14T12:34:45.765522+0000","last_undegraded":"2023-10-14T12:34:45.765522+0000","last_fullsized":"2023-10-14T12:34:45.765522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:36.689643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764651+0000","last_change":"2023-10-14T12:34:44.776394+0000","last_active":"2023-10-14T12:34:45.764651+0000","last_peered":"2023-10-14T12:34:45.764651+0000","last_clean":"2023-10-14T12:34:45.764651+0000","last_became_active":"2023-10-14T12:34:44.775897+0000","last_became_peered":"2023-10-14T12:34:44.775897+0000","last_unstale":"2023-10-14T12:34:45.764651+0000","last_undegraded":"2023-10-14T12:34:45.764651+0000","last_fullsized":"2023-10-14T12:34:45.764651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836748+0000","last_change":"2023-10-14T12:34:44.766520+0000","last_active":"2023-10-14T12:34:45.836748+0000","last_peered":"2023-10-14T12:34:45.836748+0000","last_clean":"2023-10-14T12:34:45.836748+0000","last_became_active":"2023-10-14T12:34:44.766208+0000","last_became_peered":"2023-10-14T12:34:44.766208+0000","last_unstale":"2023-10-14T12:34:45.836748+0000","last_undegraded":"2023-10-14T12:34:45.836748+0000","last_fullsized":"2023-10-14T12:34:45.836748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764453+0000","last_change":"2023-10-14T12:34:44.767161+0000","last_active":"2023-10-14T12:34:45.764453+0000","last_peered":"2023-10-14T12:34:45.764453+0000","last_clean":"2023-10-14T12:34:45.764453+0000","last_became_active":"2023-10-14T12:34:44.766602+0000","last_became_peered":"2023-10-14T12:34:44.766602+0000","last_unstale":"2023-10-14T12:34:45.764453+0000","last_undegraded":"2023-10-14T12:34:45.764453+0000","last_fullsized":"2023-10-14T12:34:45.764453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765845+0000","last_change":"2023-10-14T12:34:44.770652+0000","last_active":"2023-10-14T12:34:45.765845+0000","last_peered":"2023-10-14T12:34:45.765845+0000","last_clean":"2023-10-14T12:34:45.765845+0000","last_became_active":"2023-10-14T12:34:44.770368+0000","last_became_peered":"2023-10-14T12:34:44.770368+0000","last_unstale":"2023-10-14T12:34:45.765845+0000","last_undegraded":"2023-10-14T12:34:45.765845+0000","last_fullsized":"2023-10-14T12:34:45.765845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.763799+0000","last_change":"2023-10-14T12:34:44.764695+0000","last_active":"2023-10-14T12:34:45.763799+0000","last_peered":"2023-10-14T12:34:45.763799+0000","last_clean":"2023-10-14T12:34:45.763799+0000","last_became_active":"2023-10-14T12:34:44.763083+0000","last_became_peered":"2023-10-14T12:34:44.763083+0000","last_unstale":"2023-10-14T12:34:45.763799+0000","last_undegraded":"2023-10-14T12:34:45.763799+0000","last_fullsized":"2023-10-14T12:34:45.763799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765533+0000","last_change":"2023-10-14T12:34:44.768707+0000","last_active":"2023-10-14T12:34:45.765533+0000","last_peered":"2023-10-14T12:34:45.765533+0000","last_clean":"2023-10-14T12:34:45.765533+0000","last_became_active":"2023-10-14T12:34:44.768474+0000","last_became_peered":"2023-10-14T12:34:44.768474+0000","last_unstale":"2023-10-14T12:34:45.765533+0000","last_undegraded":"2023-10-14T12:34:45.765533+0000","last_fullsized":"2023-10-14T12:34:45.765533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765794+0000","last_change":"2023-10-14T12:34:44.771432+0000","last_active":"2023-10-14T12:34:45.765794+0000","last_peered":"2023-10-14T12:34:45.765794+0000","last_clean":"2023-10-14T12:34:45.765794+0000","last_became_active":"2023-10-14T12:34:44.771158+0000","last_became_peered":"2023-10-14T12:34:44.771158+0000","last_unstale":"2023-10-14T12:34:45.765794+0000","last_undegraded":"2023-10-14T12:34:45.765794+0000","last_fullsized":"2023-10-14T12:34:45.765794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835519+0000","last_change":"2023-10-14T12:34:44.776578+0000","last_active":"2023-10-14T12:34:45.835519+0000","last_peered":"2023-10-14T12:34:45.835519+0000","last_clean":"2023-10-14T12:34:45.835519+0000","last_became_active":"2023-10-14T12:34:44.776263+0000","last_became_peered":"2023-10-14T12:34:44.776263+0000","last_unstale":"2023-10-14T12:34:45.835519+0000","last_undegraded":"2023-10-14T12:34:45.835519+0000","last_fullsized":"2023-10-14T12:34:45.835519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835662+0000","last_change":"2023-10-14T12:34:44.767374+0000","last_active":"2023-10-14T12:34:45.835662+0000","last_peered":"2023-10-14T12:34:45.835662+0000","last_clean":"2023-10-14T12:34:45.835662+0000","last_became_active":"2023-10-14T12:34:44.767035+0000","last_became_peered":"2023-10-14T12:34:44.767035+0000","last_unstale":"2023-10-14T12:34:45.835662+0000","last_undegraded":"2023-10-14T12:34:45.835662+0000","last_fullsized":"2023-10-14T12:34:45.835662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:06.799411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835300+0000","last_change":"2023-10-14T12:34:44.775911+0000","last_active":"2023-10-14T12:34:45.835300+0000","last_peered":"2023-10-14T12:34:45.835300+0000","last_clean":"2023-10-14T12:34:45.835300+0000","last_became_active":"2023-10-14T12:34:44.775453+0000","last_became_peered":"2023-10-14T12:34:44.775453+0000","last_unstale":"2023-10-14T12:34:45.835300+0000","last_undegraded":"2023-10-14T12:34:45.835300+0000","last_fullsized":"2023-10-14T12:34:45.835300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:37.110615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764577+0000","last_change":"2023-10-14T12:34:44.766571+0000","last_active":"2023-10-14T12:34:45.764577+0000","last_peered":"2023-10-14T12:34:45.764577+0000","last_clean":"2023-10-14T12:34:45.764577+0000","last_became_active":"2023-10-14T12:34:44.766299+0000","last_became_peered":"2023-10-14T12:34:44.766299+0000","last_unstale":"2023-10-14T12:34:45.764577+0000","last_undegraded":"2023-10-14T12:34:45.764577+0000","last_fullsized":"2023-10-14T12:34:45.764577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765865+0000","last_change":"2023-10-14T12:34:44.770392+0000","last_active":"2023-10-14T12:34:45.765865+0000","last_peered":"2023-10-14T12:34:45.765865+0000","last_clean":"2023-10-14T12:34:45.765865+0000","last_became_active":"2023-10-14T12:34:44.770033+0000","last_became_peered":"2023-10-14T12:34:44.770033+0000","last_unstale":"2023-10-14T12:34:45.765865+0000","last_undegraded":"2023-10-14T12:34:45.765865+0000","last_fullsized":"2023-10-14T12:34:45.765865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765576+0000","last_change":"2023-10-14T12:34:44.768259+0000","last_active":"2023-10-14T12:34:45.765576+0000","last_peered":"2023-10-14T12:34:45.765576+0000","last_clean":"2023-10-14T12:34:45.765576+0000","last_became_active":"2023-10-14T12:34:44.767967+0000","last_became_peered":"2023-10-14T12:34:44.767967+0000","last_unstale":"2023-10-14T12:34:45.765576+0000","last_undegraded":"2023-10-14T12:34:45.765576+0000","last_fullsized":"2023-10-14T12:34:45.765576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835233+0000","last_change":"2023-10-14T12:34:44.770347+0000","last_active":"2023-10-14T12:34:45.835233+0000","last_peered":"2023-10-14T12:34:45.835233+0000","last_clean":"2023-10-14T12:34:45.835233+0000","last_became_active":"2023-10-14T12:34:44.768304+0000","last_became_peered":"2023-10-14T12:34:44.768304+0000","last_unstale":"2023-10-14T12:34:45.835233+0000","last_undegraded":"2023-10-14T12:34:45.835233+0000","last_fullsized":"2023-10-14T12:34:45.835233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:27:07.068125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835441+0000","last_change":"2023-10-14T12:34:44.764335+0000","last_active":"2023-10-14T12:34:45.835441+0000","last_peered":"2023-10-14T12:34:45.835441+0000","last_clean":"2023-10-14T12:34:45.835441+0000","last_became_active":"2023-10-14T12:34:44.764072+0000","last_became_peered":"2023-10-14T12:34:44.764072+0000","last_unstale":"2023-10-14T12:34:45.835441+0000","last_undegraded":"2023-10-14T12:34:45.835441+0000","last_fullsized":"2023-10-14T12:34:45.835441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835405+0000","last_change":"2023-10-14T12:34:44.768012+0000","last_active":"2023-10-14T12:34:45.835405+0000","last_peered":"2023-10-14T12:34:45.835405+0000","last_clean":"2023-10-14T12:34:45.835405+0000","last_became_active":"2023-10-14T12:34:44.767743+0000","last_became_peered":"2023-10-14T12:34:44.767743+0000","last_unstale":"2023-10-14T12:34:45.835405+0000","last_undegraded":"2023-10-14T12:34:45.835405+0000","last_fullsized":"2023-10-14T12:34:45.835405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835418+0000","last_change":"2023-10-14T12:34:44.766816+0000","last_active":"2023-10-14T12:34:45.835418+0000","last_peered":"2023-10-14T12:34:45.835418+0000","last_clean":"2023-10-14T12:34:45.835418+0000","last_became_active":"2023-10-14T12:34:44.766309+0000","last_became_peered":"2023-10-14T12:34:44.766309+0000","last_unstale":"2023-10-14T12:34:45.835418+0000","last_undegraded":"2023-10-14T12:34:45.835418+0000","last_fullsized":"2023-10-14T12:34:45.835418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764364+0000","last_change":"2023-10-14T12:34:44.766262+0000","last_active":"2023-10-14T12:34:45.764364+0000","last_peered":"2023-10-14T12:34:45.764364+0000","last_clean":"2023-10-14T12:34:45.764364+0000","last_became_active":"2023-10-14T12:34:44.765904+0000","last_became_peered":"2023-10-14T12:34:44.765904+0000","last_unstale":"2023-10-14T12:34:45.764364+0000","last_undegraded":"2023-10-14T12:34:45.764364+0000","last_fullsized":"2023-10-14T12:34:45.764364+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835345+0000","last_change":"2023-10-14T12:34:44.764983+0000","last_active":"2023-10-14T12:34:45.835345+0000","last_peered":"2023-10-14T12:34:45.835345+0000","last_clean":"2023-10-14T12:34:45.835345+0000","last_became_active":"2023-10-14T12:34:44.764719+0000","last_became_peered":"2023-10-14T12:34:44.764719+0000","last_unstale":"2023-10-14T12:34:45.835345+0000","last_undegraded":"2023-10-14T12:34:45.835345+0000","last_fullsized":"2023-10-14T12:34:45.835345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835251+0000","last_change":"2023-10-14T12:34:44.769030+0000","last_active":"2023-10-14T12:34:45.835251+0000","last_peered":"2023-10-14T12:34:45.835251+0000","last_clean":"2023-10-14T12:34:45.835251+0000","last_became_active":"2023-10-14T12:34:44.768729+0000","last_became_peered":"2023-10-14T12:34:44.768729+0000","last_unstale":"2023-10-14T12:34:45.835251+0000","last_undegraded":"2023-10-14T12:34:45.835251+0000","last_fullsized":"2023-10-14T12:34:45.835251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:36.593887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765428+0000","last_change":"2023-10-14T12:34:44.768972+0000","last_active":"2023-10-14T12:34:45.765428+0000","last_peered":"2023-10-14T12:34:45.765428+0000","last_clean":"2023-10-14T12:34:45.765428+0000","last_became_active":"2023-10-14T12:34:44.768243+0000","last_became_peered":"2023-10-14T12:34:44.768243+0000","last_unstale":"2023-10-14T12:34:45.765428+0000","last_undegraded":"2023-10-14T12:34:45.765428+0000","last_fullsized":"2023-10-14T12:34:45.765428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835003+0000","last_change":"2023-10-14T12:34:44.768827+0000","last_active":"2023-10-14T12:34:45.835003+0000","last_peered":"2023-10-14T12:34:45.835003+0000","last_clean":"2023-10-14T12:34:45.835003+0000","last_became_active":"2023-10-14T12:34:44.768423+0000","last_became_peered":"2023-10-14T12:34:44.768423+0000","last_unstale":"2023-10-14T12:34:45.835003+0000","last_undegraded":"2023-10-14T12:34:45.835003+0000","last_fullsized":"2023-10-14T12:34:45.835003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765078+0000","last_change":"2023-10-14T12:34:44.771115+0000","last_active":"2023-10-14T12:34:45.765078+0000","last_peered":"2023-10-14T12:34:45.765078+0000","last_clean":"2023-10-14T12:34:45.765078+0000","last_became_active":"2023-10-14T12:34:44.770846+0000","last_became_peered":"2023-10-14T12:34:44.770846+0000","last_unstale":"2023-10-14T12:34:45.765078+0000","last_undegraded":"2023-10-14T12:34:45.765078+0000","last_fullsized":"2023-10-14T12:34:45.765078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:18.644528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775649+0000","last_change":"2023-10-14T12:34:43.742439+0000","last_active":"2023-10-14T12:34:44.775649+0000","last_peered":"2023-10-14T12:34:44.775649+0000","last_clean":"2023-10-14T12:34:44.775649+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:34:44.775649+0000","last_undegraded":"2023-10-14T12:34:44.775649+0000","last_fullsized":"2023-10-14T12:34:44.775649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835738+0000","last_change":"2023-10-14T12:34:44.772445+0000","last_active":"2023-10-14T12:34:45.835738+0000","last_peered":"2023-10-14T12:34:45.835738+0000","last_clean":"2023-10-14T12:34:45.835738+0000","last_became_active":"2023-10-14T12:34:44.772093+0000","last_became_peered":"2023-10-14T12:34:44.772093+0000","last_unstale":"2023-10-14T12:34:45.835738+0000","last_undegraded":"2023-10-14T12:34:45.835738+0000","last_fullsized":"2023-10-14T12:34:45.835738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773796+0000","last_change":"2023-10-14T12:34:43.740875+0000","last_active":"2023-10-14T12:34:44.773796+0000","last_peered":"2023-10-14T12:34:44.773796+0000","last_clean":"2023-10-14T12:34:44.773796+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:34:44.773796+0000","last_undegraded":"2023-10-14T12:34:44.773796+0000","last_fullsized":"2023-10-14T12:34:44.773796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765494+0000","last_change":"2023-10-14T12:34:44.775914+0000","last_active":"2023-10-14T12:34:45.765494+0000","last_peered":"2023-10-14T12:34:45.765494+0000","last_clean":"2023-10-14T12:34:45.765494+0000","last_became_active":"2023-10-14T12:34:44.775648+0000","last_became_peered":"2023-10-14T12:34:44.775648+0000","last_unstale":"2023-10-14T12:34:45.765494+0000","last_undegraded":"2023-10-14T12:34:45.765494+0000","last_fullsized":"2023-10-14T12:34:45.765494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.774951+0000","last_change":"2023-10-14T12:34:43.737909+0000","last_active":"2023-10-14T12:34:44.774951+0000","last_peered":"2023-10-14T12:34:44.774951+0000","last_clean":"2023-10-14T12:34:44.774951+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:34:44.774951+0000","last_undegraded":"2023-10-14T12:34:44.774951+0000","last_fullsized":"2023-10-14T12:34:44.774951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:21.264726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836154+0000","last_change":"2023-10-14T12:34:44.765349+0000","last_active":"2023-10-14T12:34:45.836154+0000","last_peered":"2023-10-14T12:34:45.836154+0000","last_clean":"2023-10-14T12:34:45.836154+0000","last_became_active":"2023-10-14T12:34:44.765043+0000","last_became_peered":"2023-10-14T12:34:44.765043+0000","last_unstale":"2023-10-14T12:34:45.836154+0000","last_undegraded":"2023-10-14T12:34:45.836154+0000","last_fullsized":"2023-10-14T12:34:45.836154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775771+0000","last_change":"2023-10-14T12:34:43.738060+0000","last_active":"2023-10-14T12:34:44.775771+0000","last_peered":"2023-10-14T12:34:44.775771+0000","last_clean":"2023-10-14T12:34:44.775771+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:34:44.775771+0000","last_undegraded":"2023-10-14T12:34:44.775771+0000","last_fullsized":"2023-10-14T12:34:44.775771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836764+0000","last_change":"2023-10-14T12:34:44.763674+0000","last_active":"2023-10-14T12:34:45.836764+0000","last_peered":"2023-10-14T12:34:45.836764+0000","last_clean":"2023-10-14T12:34:45.836764+0000","last_became_active":"2023-10-14T12:34:44.763356+0000","last_became_peered":"2023-10-14T12:34:44.763356+0000","last_unstale":"2023-10-14T12:34:45.836764+0000","last_undegraded":"2023-10-14T12:34:45.836764+0000","last_fullsized":"2023-10-14T12:34:45.836764+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.772744+0000","last_change":"2023-10-14T12:34:43.738857+0000","last_active":"2023-10-14T12:34:44.772744+0000","last_peered":"2023-10-14T12:34:44.772744+0000","last_clean":"2023-10-14T12:34:44.772744+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:34:44.772744+0000","last_undegraded":"2023-10-14T12:34:44.772744+0000","last_fullsized":"2023-10-14T12:34:44.772744+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:47.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764009+0000","last_change":"2023-10-14T12:34:44.767242+0000","last_active":"2023-10-14T12:34:45.764009+0000","last_peered":"2023-10-14T12:34:45.764009+0000","last_clean":"2023-10-14T12:34:45.764009+0000","last_became_active":"2023-10-14T12:34:44.766961+0000","last_became_peered":"2023-10-14T12:34:44.766961+0000","last_unstale":"2023-10-14T12:34:45.764009+0000","last_undegraded":"2023-10-14T12:34:45.764009+0000","last_fullsized":"2023-10-14T12:34:45.764009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775710+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:44.775710+0000","last_peered":"2023-10-14T12:34:44.775710+0000","last_clean":"2023-10-14T12:34:44.775710+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:44.775710+0000","last_undegraded":"2023-10-14T12:34:44.775710+0000","last_fullsized":"2023-10-14T12:34:44.775710+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765983+0000","last_change":"2023-10-14T12:34:44.770562+0000","last_active":"2023-10-14T12:34:45.765983+0000","last_peered":"2023-10-14T12:34:45.765983+0000","last_clean":"2023-10-14T12:34:45.765983+0000","last_became_active":"2023-10-14T12:34:44.770030+0000","last_became_peered":"2023-10-14T12:34:44.770030+0000","last_unstale":"2023-10-14T12:34:45.765983+0000","last_undegraded":"2023-10-14T12:34:45.765983+0000","last_fullsized":"2023-10-14T12:34:45.765983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757619+0000","last_change":"2023-10-14T12:34:43.738248+0000","last_active":"2023-10-14T12:34:44.757619+0000","last_peered":"2023-10-14T12:34:44.757619+0000","last_clean":"2023-10-14T12:34:44.757619+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:34:44.757619+0000","last_undegraded":"2023-10-14T12:34:44.757619+0000","last_fullsized":"2023-10-14T12:34:44.757619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836002+0000","last_change":"2023-10-14T12:34:44.762002+0000","last_active":"2023-10-14T12:34:45.836002+0000","last_peered":"2023-10-14T12:34:45.836002+0000","last_clean":"2023-10-14T12:34:45.836002+0000","last_became_active":"2023-10-14T12:34:44.761308+0000","last_became_peered":"2023-10-14T12:34:44.761308+0000","last_unstale":"2023-10-14T12:34:45.836002+0000","last_undegraded":"2023-10-14T12:34:45.836002+0000","last_fullsized":"2023-10-14T12:34:45.836002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.754851+0000","last_change":"2023-10-14T12:34:43.737450+0000","last_active":"2023-10-14T12:34:44.754851+0000","last_peered":"2023-10-14T12:34:44.754851+0000","last_clean":"2023-10-14T12:34:44.754851+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:34:44.754851+0000","last_undegraded":"2023-10-14T12:34:44.754851+0000","last_fullsized":"2023-10-14T12:34:44.754851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:27.820010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835759+0000","last_change":"2023-10-14T12:34:44.776821+0000","last_active":"2023-10-14T12:34:45.835759+0000","last_peered":"2023-10-14T12:34:45.835759+0000","last_clean":"2023-10-14T12:34:45.835759+0000","last_became_active":"2023-10-14T12:34:44.776592+0000","last_became_peered":"2023-10-14T12:34:44.776592+0000","last_unstale":"2023-10-14T12:34:45.835759+0000","last_undegraded":"2023-10-14T12:34:45.835759+0000","last_fullsized":"2023-10-14T12:34:45.835759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:31.333285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.753775+0000","last_change":"2023-10-14T12:34:43.733989+0000","last_active":"2023-10-14T12:34:44.753775+0000","last_peered":"2023-10-14T12:34:44.753775+0000","last_clean":"2023-10-14T12:34:44.753775+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:34:44.753775+0000","last_undegraded":"2023-10-14T12:34:44.753775+0000","last_fullsized":"2023-10-14T12:34:44.753775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:52.723651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765232+0000","last_change":"2023-10-14T12:34:44.763705+0000","last_active":"2023-10-14T12:34:45.765232+0000","last_peered":"2023-10-14T12:34:45.765232+0000","last_clean":"2023-10-14T12:34:45.765232+0000","last_became_active":"2023-10-14T12:34:44.763408+0000","last_became_peered":"2023-10-14T12:34:44.763408+0000","last_unstale":"2023-10-14T12:34:45.765232+0000","last_undegraded":"2023-10-14T12:34:45.765232+0000","last_fullsized":"2023-10-14T12:34:45.765232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:02.756175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750731+0000","last_change":"2023-10-14T12:34:43.734905+0000","last_active":"2023-10-14T12:34:44.750731+0000","last_peered":"2023-10-14T12:34:44.750731+0000","last_clean":"2023-10-14T12:34:44.750731+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:34:44.750731+0000","last_undegraded":"2023-10-14T12:34:44.750731+0000","last_fullsized":"2023-10-14T12:34:44.750731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836842+0000","last_change":"2023-10-14T12:34:44.764740+0000","last_active":"2023-10-14T12:34:45.836842+0000","last_peered":"2023-10-14T12:34:45.836842+0000","last_clean":"2023-10-14T12:34:45.836842+0000","last_became_active":"2023-10-14T12:34:44.764455+0000","last_became_peered":"2023-10-14T12:34:44.764455+0000","last_unstale":"2023-10-14T12:34:45.836842+0000","last_undegraded":"2023-10-14T12:34:45.836842+0000","last_fullsized":"2023-10-14T12:34:45.836842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779891+0000","last_change":"2023-10-14T12:34:43.735967+0000","last_active":"2023-10-14T12:34:44.779891+0000","last_peered":"2023-10-14T12:34:44.779891+0000","last_clean":"2023-10-14T12:34:44.779891+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:34:44.779891+0000","last_undegraded":"2023-10-14T12:34:44.779891+0000","last_fullsized":"2023-10-14T12:34:44.779891+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765386+0000","last_change":"2023-10-14T12:34:44.774548+0000","last_active":"2023-10-14T12:34:45.765386+0000","last_peered":"2023-10-14T12:34:45.765386+0000","last_clean":"2023-10-14T12:34:45.765386+0000","last_became_active":"2023-10-14T12:34:44.774253+0000","last_became_peered":"2023-10-14T12:34:44.774253+0000","last_unstale":"2023-10-14T12:34:45.765386+0000","last_undegraded":"2023-10-14T12:34:45.765386+0000","last_fullsized":"2023-10-14T12:34:45.765386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779429+0000","last_change":"2023-10-14T12:34:43.741443+0000","last_active":"2023-10-14T12:34:44.779429+0000","last_peered":"2023-10-14T12:34:44.779429+0000","last_clean":"2023-10-14T12:34:44.779429+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:34:44.779429+0000","last_undegraded":"2023-10-14T12:34:44.779429+0000","last_fullsized":"2023-10-14T12:34:44.779429+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:17.642741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836528+0000","last_change":"2023-10-14T12:34:44.766187+0000","last_active":"2023-10-14T12:34:45.836528+0000","last_peered":"2023-10-14T12:34:45.836528+0000","last_clean":"2023-10-14T12:34:45.836528+0000","last_became_active":"2023-10-14T12:34:44.765932+0000","last_became_peered":"2023-10-14T12:34:44.765932+0000","last_unstale":"2023-10-14T12:34:45.836528+0000","last_undegraded":"2023-10-14T12:34:45.836528+0000","last_fullsized":"2023-10-14T12:34:45.836528+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773813+0000","last_change":"2023-10-14T12:34:43.738642+0000","last_active":"2023-10-14T12:34:44.773813+0000","last_peered":"2023-10-14T12:34:44.773813+0000","last_clean":"2023-10-14T12:34:44.773813+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:34:44.773813+0000","last_undegraded":"2023-10-14T12:34:44.773813+0000","last_fullsized":"2023-10-14T12:34:44.773813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835518+0000","last_change":"2023-10-14T12:34:44.773042+0000","last_active":"2023-10-14T12:34:45.835518+0000","last_peered":"2023-10-14T12:34:45.835518+0000","last_clean":"2023-10-14T12:34:45.835518+0000","last_became_active":"2023-10-14T12:34:44.772662+0000","last_became_peered":"2023-10-14T12:34:44.772662+0000","last_unstale":"2023-10-14T12:34:45.835518+0000","last_undegraded":"2023-10-14T12:34:45.835518+0000","last_fullsized":"2023-10-14T12:34:45.835518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758499+0000","last_change":"2023-10-14T12:34:43.738291+0000","last_active":"2023-10-14T12:34:44.758499+0000","last_peered":"2023-10-14T12:34:44.758499+0000","last_clean":"2023-10-14T12:34:44.758499+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:34:44.758499+0000","last_undegraded":"2023-10-14T12:34:44.758499+0000","last_fullsized":"2023-10-14T12:34:44.758499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:28.347591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764881+0000","last_change":"2023-10-14T12:34:44.761488+0000","last_active":"2023-10-14T12:34:45.764881+0000","last_peered":"2023-10-14T12:34:45.764881+0000","last_clean":"2023-10-14T12:34:45.764881+0000","last_became_active":"2023-10-14T12:34:44.761153+0000","last_became_peered":"2023-10-14T12:34:44.761153+0000","last_unstale":"2023-10-14T12:34:45.764881+0000","last_undegraded":"2023-10-14T12:34:45.764881+0000","last_fullsized":"2023-10-14T12:34:45.764881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.755992+0000","last_change":"2023-10-14T12:34:43.742416+0000","last_active":"2023-10-14T12:34:44.755992+0000","last_peered":"2023-10-14T12:34:44.755992+0000","last_clean":"2023-10-14T12:34:44.755992+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:34:44.755992+0000","last_undegraded":"2023-10-14T12:34:44.755992+0000","last_fullsized":"2023-10-14T12:34:44.755992+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835631+0000","last_change":"2023-10-14T12:34:44.762671+0000","last_active":"2023-10-14T12:34:45.835631+0000","last_peered":"2023-10-14T12:34:45.835631+0000","last_clean":"2023-10-14T12:34:45.835631+0000","last_became_active":"2023-10-14T12:34:44.762396+0000","last_became_peered":"2023-10-14T12:34:44.762396+0000","last_unstale":"2023-10-14T12:34:45.835631+0000","last_undegraded":"2023-10-14T12:34:45.835631+0000","last_fullsized":"2023-10-14T12:34:45.835631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.777137+0000","last_change":"2023-10-14T12:34:43.745867+0000","last_active":"2023-10-14T12:34:44.777137+0000","last_peered":"2023-10-14T12:34:44.777137+0000","last_clean":"2023-10-14T12:34:44.777137+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:34:44.777137+0000","last_undegraded":"2023-10-14T12:34:44.777137+0000","last_fullsized":"2023-10-14T12:34:44.777137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835643+0000","last_change":"2023-10-14T12:34:44.761814+0000","last_active":"2023-10-14T12:34:45.835643+0000","last_peered":"2023-10-14T12:34:45.835643+0000","last_clean":"2023-10-14T12:34:45.835643+0000","last_became_active":"2023-10-14T12:34:44.761558+0000","last_became_peered":"2023-10-14T12:34:44.761558+0000","last_unstale":"2023-10-14T12:34:45.835643+0000","last_undegraded":"2023-10-14T12:34:45.835643+0000","last_fullsized":"2023-10-14T12:34:45.835643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775988+0000","last_change":"2023-10-14T12:34:43.743560+0000","last_active":"2023-10-14T12:34:44.775988+0000","last_peered":"2023-10-14T12:34:44.775988+0000","last_clean":"2023-10-14T12:34:44.775988+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:34:44.775988+0000","last_undegraded":"2023-10-14T12:34:44.775988+0000","last_fullsized":"2023-10-14T12:34:44.775988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:26.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764518+0000","last_change":"2023-10-14T12:34:44.766417+0000","last_active":"2023-10-14T12:34:45.764518+0000","last_peered":"2023-10-14T12:34:45.764518+0000","last_clean":"2023-10-14T12:34:45.764518+0000","last_became_active":"2023-10-14T12:34:44.766119+0000","last_became_peered":"2023-10-14T12:34:44.766119+0000","last_unstale":"2023-10-14T12:34:45.764518+0000","last_undegraded":"2023-10-14T12:34:45.764518+0000","last_fullsized":"2023-10-14T12:34:45.764518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775467+0000","last_change":"2023-10-14T12:34:43.738033+0000","last_active":"2023-10-14T12:34:44.775467+0000","last_peered":"2023-10-14T12:34:44.775467+0000","last_clean":"2023-10-14T12:34:44.775467+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:34:44.775467+0000","last_undegraded":"2023-10-14T12:34:44.775467+0000","last_fullsized":"2023-10-14T12:34:44.775467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765588+0000","last_change":"2023-10-14T12:34:44.775797+0000","last_active":"2023-10-14T12:34:45.765588+0000","last_peered":"2023-10-14T12:34:45.765588+0000","last_clean":"2023-10-14T12:34:45.765588+0000","last_became_active":"2023-10-14T12:34:44.775417+0000","last_became_peered":"2023-10-14T12:34:44.775417+0000","last_unstale":"2023-10-14T12:34:45.765588+0000","last_undegraded":"2023-10-14T12:34:45.765588+0000","last_fullsized":"2023-10-14T12:34:45.765588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775680+0000","last_change":"2023-10-14T12:34:43.744197+0000","last_active":"2023-10-14T12:34:44.775680+0000","last_peered":"2023-10-14T12:34:44.775680+0000","last_clean":"2023-10-14T12:34:44.775680+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:34:44.775680+0000","last_undegraded":"2023-10-14T12:34:44.775680+0000","last_fullsized":"2023-10-14T12:34:44.775680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:53.838278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836010+0000","last_change":"2023-10-14T12:34:44.770567+0000","last_active":"2023-10-14T12:34:45.836010+0000","last_peered":"2023-10-14T12:34:45.836010+0000","last_clean":"2023-10-14T12:34:45.836010+0000","last_became_active":"2023-10-14T12:34:44.768157+0000","last_became_peered":"2023-10-14T12:34:44.768157+0000","last_unstale":"2023-10-14T12:34:45.836010+0000","last_undegraded":"2023-10-14T12:34:45.836010+0000","last_fullsized":"2023-10-14T12:34:45.836010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:05.274311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756934+0000","last_change":"2023-10-14T12:34:43.739053+0000","last_active":"2023-10-14T12:34:44.756934+0000","last_peered":"2023-10-14T12:34:44.756934+0000","last_clean":"2023-10-14T12:34:44.756934+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:34:44.756934+0000","last_undegraded":"2023-10-14T12:34:44.756934+0000","last_fullsized":"2023-10-14T12:34:44.756934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765656+0000","last_change":"2023-10-14T12:34:44.768620+0000","last_active":"2023-10-14T12:34:45.765656+0000","last_peered":"2023-10-14T12:34:45.765656+0000","last_clean":"2023-10-14T12:34:45.765656+0000","last_became_active":"2023-10-14T12:34:44.768087+0000","last_became_peered":"2023-10-14T12:34:44.768087+0000","last_unstale":"2023-10-14T12:34:45.765656+0000","last_undegraded":"2023-10-14T12:34:45.765656+0000","last_fullsized":"2023-10-14T12:34:45.765656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.769614+0000","last_change":"2023-10-14T12:34:43.739027+0000","last_active":"2023-10-14T12:34:44.769614+0000","last_peered":"2023-10-14T12:34:44.769614+0000","last_clean":"2023-10-14T12:34:44.769614+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:34:44.769614+0000","last_undegraded":"2023-10-14T12:34:44.769614+0000","last_fullsized":"2023-10-14T12:34:44.769614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:18.085129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836679+0000","last_change":"2023-10-14T12:34:44.761072+0000","last_active":"2023-10-14T12:34:45.836679+0000","last_peered":"2023-10-14T12:34:45.836679+0000","last_clean":"2023-10-14T12:34:45.836679+0000","last_became_active":"2023-10-14T12:34:44.760736+0000","last_became_peered":"2023-10-14T12:34:44.760736+0000","last_unstale":"2023-10-14T12:34:45.836679+0000","last_undegraded":"2023-10-14T12:34:45.836679+0000","last_fullsized":"2023-10-14T12:34:45.836679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.759860+0000","last_change":"2023-10-14T12:34:43.739164+0000","last_active":"2023-10-14T12:34:44.759860+0000","last_peered":"2023-10-14T12:34:44.759860+0000","last_clean":"2023-10-14T12:34:44.759860+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:34:44.759860+0000","last_undegraded":"2023-10-14T12:34:44.759860+0000","last_fullsized":"2023-10-14T12:34:44.759860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:58.156116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764254+0000","last_change":"2023-10-14T12:34:44.764345+0000","last_active":"2023-10-14T12:34:45.764254+0000","last_peered":"2023-10-14T12:34:45.764254+0000","last_clean":"2023-10-14T12:34:45.764254+0000","last_became_active":"2023-10-14T12:34:44.764069+0000","last_became_peered":"2023-10-14T12:34:44.764069+0000","last_unstale":"2023-10-14T12:34:45.764254+0000","last_undegraded":"2023-10-14T12:34:45.764254+0000","last_fullsized":"2023-10-14T12:34:45.764254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.751773+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:44.751773+0000","last_peered":"2023-10-14T12:34:44.751773+0000","last_clean":"2023-10-14T12:34:44.751773+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:44.751773+0000","last_undegraded":"2023-10-14T12:34:44.751773+0000","last_fullsized":"2023-10-14T12:34:44.751773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835883+0000","last_change":"2023-10-14T12:34:44.768053+0000","last_active":"2023-10-14T12:34:45.835883+0000","last_peered":"2023-10-14T12:34:45.835883+0000","last_clean":"2023-10-14T12:34:45.835883+0000","last_became_active":"2023-10-14T12:34:44.767802+0000","last_became_peered":"2023-10-14T12:34:44.767802+0000","last_unstale":"2023-10-14T12:34:45.835883+0000","last_undegraded":"2023-10-14T12:34:45.835883+0000","last_fullsized":"2023-10-14T12:34:45.835883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757835+0000","last_change":"2023-10-14T12:34:43.737529+0000","last_active":"2023-10-14T12:34:44.757835+0000","last_peered":"2023-10-14T12:34:44.757835+0000","last_clean":"2023-10-14T12:34:44.757835+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:34:44.757835+0000","last_undegraded":"2023-10-14T12:34:44.757835+0000","last_fullsized":"2023-10-14T12:34:44.757835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:30:56.810287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835146+0000","last_change":"2023-10-14T12:34:44.768491+0000","last_active":"2023-10-14T12:34:45.835146+0000","last_peered":"2023-10-14T12:34:45.835146+0000","last_clean":"2023-10-14T12:34:45.835146+0000","last_became_active":"2023-10-14T12:34:44.768177+0000","last_became_peered":"2023-10-14T12:34:44.768177+0000","last_unstale":"2023-10-14T12:34:45.835146+0000","last_undegraded":"2023-10-14T12:34:45.835146+0000","last_fullsized":"2023-10-14T12:34:45.835146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779481+0000","last_change":"2023-10-14T12:34:43.735693+0000","last_active":"2023-10-14T12:34:44.779481+0000","last_peered":"2023-10-14T12:34:44.779481+0000","last_clean":"2023-10-14T12:34:44.779481+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:34:44.779481+0000","last_undegraded":"2023-10-14T12:34:44.779481+0000","last_fullsized":"2023-10-14T12:34:44.779481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765390+0000","last_change":"2023-10-14T12:34:44.761812+0000","last_active":"2023-10-14T12:34:45.765390+0000","last_peered":"2023-10-14T12:34:45.765390+0000","last_clean":"2023-10-14T12:34:45.765390+0000","last_became_active":"2023-10-14T12:34:44.761519+0000","last_became_peered":"2023-10-14T12:34:44.761519+0000","last_unstale":"2023-10-14T12:34:45.765390+0000","last_undegraded":"2023-10-14T12:34:45.765390+0000","last_fullsized":"2023-10-14T12:34:45.765390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835973+0000","last_change":"2023-10-14T12:34:43.735820+0000","last_active":"2023-10-14T12:34:45.835973+0000","last_peered":"2023-10-14T12:34:45.835973+0000","last_clean":"2023-10-14T12:34:45.835973+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:34:45.835973+0000","last_undegraded":"2023-10-14T12:34:45.835973+0000","last_fullsized":"2023-10-14T12:34:45.835973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:56.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835989+0000","last_change":"2023-10-14T12:34:44.776057+0000","last_active":"2023-10-14T12:34:45.835989+0000","last_peered":"2023-10-14T12:34:45.835989+0000","last_clean":"2023-10-14T12:34:45.835989+0000","last_became_active":"2023-10-14T12:34:44.775820+0000","last_became_peered":"2023-10-14T12:34:44.775820+0000","last_unstale":"2023-10-14T12:34:45.835989+0000","last_undegraded":"2023-10-14T12:34:45.835989+0000","last_fullsized":"2023-10-14T12:34:45.835989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758094+0000","last_change":"2023-10-14T12:34:43.736834+0000","last_active":"2023-10-14T12:34:44.758094+0000","last_peered":"2023-10-14T12:34:44.758094+0000","last_clean":"2023-10-14T12:34:44.758094+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:34:44.758094+0000","last_undegraded":"2023-10-14T12:34:44.758094+0000","last_fullsized":"2023-10-14T12:34:44.758094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:43.074134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836529+0000","last_change":"2023-10-14T12:34:44.769426+0000","last_active":"2023-10-14T12:34:45.836529+0000","last_peered":"2023-10-14T12:34:45.836529+0000","last_clean":"2023-10-14T12:34:45.836529+0000","last_became_active":"2023-10-14T12:34:44.769173+0000","last_became_peered":"2023-10-14T12:34:44.769173+0000","last_unstale":"2023-10-14T12:34:45.836529+0000","last_undegraded":"2023-10-14T12:34:45.836529+0000","last_fullsized":"2023-10-14T12:34:45.836529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757464+0000","last_change":"2023-10-14T12:34:43.737030+0000","last_active":"2023-10-14T12:34:44.757464+0000","last_peered":"2023-10-14T12:34:44.757464+0000","last_clean":"2023-10-14T12:34:44.757464+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:34:44.757464+0000","last_undegraded":"2023-10-14T12:34:44.757464+0000","last_fullsized":"2023-10-14T12:34:44.757464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835225+0000","last_change":"2023-10-14T12:34:44.763379+0000","last_active":"2023-10-14T12:34:45.835225+0000","last_peered":"2023-10-14T12:34:45.835225+0000","last_clean":"2023-10-14T12:34:45.835225+0000","last_became_active":"2023-10-14T12:34:44.763069+0000","last_became_peered":"2023-10-14T12:34:44.763069+0000","last_unstale":"2023-10-14T12:34:45.835225+0000","last_undegraded":"2023-10-14T12:34:45.835225+0000","last_fullsized":"2023-10-14T12:34:45.835225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756075+0000","last_change":"2023-10-14T12:34:43.740716+0000","last_active":"2023-10-14T12:34:44.756075+0000","last_peered":"2023-10-14T12:34:44.756075+0000","last_clean":"2023-10-14T12:34:44.756075+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:34:44.756075+0000","last_undegraded":"2023-10-14T12:34:44.756075+0000","last_fullsized":"2023-10-14T12:34:44.756075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.766013+0000","last_change":"2023-10-14T12:34:44.769837+0000","last_active":"2023-10-14T12:34:45.766013+0000","last_peered":"2023-10-14T12:34:45.766013+0000","last_clean":"2023-10-14T12:34:45.766013+0000","last_became_active":"2023-10-14T12:34:44.769543+0000","last_became_peered":"2023-10-14T12:34:44.769543+0000","last_unstale":"2023-10-14T12:34:45.766013+0000","last_undegraded":"2023-10-14T12:34:45.766013+0000","last_fullsized":"2023-10-14T12:34:45.766013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758262+0000","last_change":"2023-10-14T12:34:43.738818+0000","last_active":"2023-10-14T12:34:44.758262+0000","last_peered":"2023-10-14T12:34:44.758262+0000","last_clean":"2023-10-14T12:34:44.758262+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:34:44.758262+0000","last_undegraded":"2023-10-14T12:34:44.758262+0000","last_fullsized":"2023-10-14T12:34:44.758262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:21.861042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765067+0000","last_change":"2023-10-14T12:34:44.764824+0000","last_active":"2023-10-14T12:34:45.765067+0000","last_peered":"2023-10-14T12:34:45.765067+0000","last_clean":"2023-10-14T12:34:45.765067+0000","last_became_active":"2023-10-14T12:34:44.764567+0000","last_became_peered":"2023-10-14T12:34:44.764567+0000","last_unstale":"2023-10-14T12:34:45.765067+0000","last_undegraded":"2023-10-14T12:34:45.765067+0000","last_fullsized":"2023-10-14T12:34:45.765067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:53.725438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752091+0000","last_change":"2023-10-14T12:34:43.733187+0000","last_active":"2023-10-14T12:34:44.752091+0000","last_peered":"2023-10-14T12:34:44.752091+0000","last_clean":"2023-10-14T12:34:44.752091+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:34:44.752091+0000","last_undegraded":"2023-10-14T12:34:44.752091+0000","last_fullsized":"2023-10-14T12:34:44.752091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765866+0000","last_change":"2023-10-14T12:34:44.767412+0000","last_active":"2023-10-14T12:34:45.765866+0000","last_peered":"2023-10-14T12:34:45.765866+0000","last_clean":"2023-10-14T12:34:45.765866+0000","last_became_active":"2023-10-14T12:34:44.766080+0000","last_became_peered":"2023-10-14T12:34:44.766080+0000","last_unstale":"2023-10-14T12:34:45.765866+0000","last_undegraded":"2023-10-14T12:34:45.765866+0000","last_fullsized":"2023-10-14T12:34:45.765866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:41.477384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752465+0000","last_change":"2023-10-14T12:34:43.744939+0000","last_active":"2023-10-14T12:34:44.752465+0000","last_peered":"2023-10-14T12:34:44.752465+0000","last_clean":"2023-10-14T12:34:44.752465+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:34:44.752465+0000","last_undegraded":"2023-10-14T12:34:44.752465+0000","last_fullsized":"2023-10-14T12:34:44.752465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:42.271784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750684+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:34:44.750684+0000","last_peered":"2023-10-14T12:34:44.750684+0000","last_clean":"2023-10-14T12:34:44.750684+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:34:44.750684+0000","last_undegraded":"2023-10-14T12:34:44.750684+0000","last_fullsized":"2023-10-14T12:34:44.750684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.621}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.69999999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.68700000000000006}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.67400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.48299999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.375},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.434}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.33700000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.497}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.45800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.437},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.38500000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.627}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.73399999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.748},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":779658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.31900000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.33800000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.434}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.47799999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.38800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.32000000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.28499999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.35399999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.42399999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.443},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.46800000000000003}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.56499999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.51600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":190902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.312}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.376}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.435},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44600000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.497},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.505}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.44700000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.48399999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.48999999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.42599999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.621}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:34:53.812 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T12:34:53.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-14T12:34:53.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.972+0000 7f6c184cb700 1 Processor -- start 2023-10-14T12:34:53.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.972+0000 7f6c184cb700 1 -- start start 2023-10-14T12:34:53.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.973+0000 7f6c184cb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c1015d660 0x7f6c100cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.973+0000 7f6c184cb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c10161c50 0x7f6c100ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.973+0000 7f6c184cb700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c10072b70 con 0x7f6c100cd800 2023-10-14T12:34:53.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.973+0000 7f6c184cb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c10162210 con 0x7f6c1015d660 2023-10-14T12:34:53.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.973+0000 7f6c184cb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1006a9c0 con 0x7f6c10161c50 2023-10-14T12:34:53.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.973+0000 7f6c16267700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c1015d660 0x7f6c100cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.973+0000 7f6c16267700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c1015d660 0x7f6c100cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48792/0 (socket says 172.21.15.72:48792) 2023-10-14T12:34:53.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.973+0000 7f6c16267700 1 -- 172.21.15.72:0/1248686766 learned_addr learned my addr 172.21.15.72:0/1248686766 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:53.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.973+0000 7f6c16a68700 1 --2- 172.21.15.72:0/1248686766 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c10161c50 0x7f6c100ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c16267700 1 -- 172.21.15.72:0/1248686766 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c10161c50 msgr2=0x7f6c100ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:53.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c16267700 1 --2- 172.21.15.72:0/1248686766 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c10161c50 0x7f6c100ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c16267700 1 -- 172.21.15.72:0/1248686766 >> v1:172.21.15.123:6789/0 conn(0x7f6c100cd800 legacy=0x7f6c1006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c16267700 1 -- 172.21.15.72:0/1248686766 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1006ac60 con 0x7f6c1015d660 2023-10-14T12:34:53.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c16a68700 1 --2- 172.21.15.72:0/1248686766 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c10161c50 0x7f6c100ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:53.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c16267700 1 --2- 172.21.15.72:0/1248686766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 0x7f6c100cde30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6c000098f0 tx=0x7f6c00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883faddbf8622ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:53.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c15265700 1 -- 172.21.15.72:0/1248686766 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000b8a0 con 0x7f6c1015d660 2023-10-14T12:34:53.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c15265700 1 -- 172.21.15.72:0/1248686766 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0000ba00 con 0x7f6c1015d660 2023-10-14T12:34:53.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c15265700 1 -- 172.21.15.72:0/1248686766 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000bd90 con 0x7f6c1015d660 2023-10-14T12:34:53.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c184cb700 1 -- 172.21.15.72:0/1248686766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 msgr2=0x7f6c100cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c184cb700 1 --2- 172.21.15.72:0/1248686766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 0x7f6c100cde30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6c000098f0 tx=0x7f6c00009c00 comp rx=0 tx=0).stop 2023-10-14T12:34:53.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c184cb700 1 -- 172.21.15.72:0/1248686766 shutdown_connections 2023-10-14T12:34:53.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c184cb700 1 --2- 172.21.15.72:0/1248686766 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c10161c50 0x7f6c100ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c184cb700 1 --2- 172.21.15.72:0/1248686766 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 0x7f6c100cde30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.974+0000 7f6c184cb700 1 -- 172.21.15.72:0/1248686766 >> 172.21.15.72:0/1248686766 conn(0x7f6c100ccce0 msgr2=0x7f6c100cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:53.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.975+0000 7f6c184cb700 1 -- 172.21.15.72:0/1248686766 shutdown_connections 2023-10-14T12:34:53.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.975+0000 7f6c184cb700 1 -- 172.21.15.72:0/1248686766 wait complete. 2023-10-14T12:34:53.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.976+0000 7f6c184cb700 1 Processor -- start 2023-10-14T12:34:53.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.976+0000 7f6c184cb700 1 -- start start 2023-10-14T12:34:53.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.976+0000 7f6c184cb700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c100cd800 0x7f6c1014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.976+0000 7f6c184cb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 0x7f6c1014f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.976+0000 7f6c184cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c10161c50 0x7f6c100c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.976+0000 7f6c184cb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101f7c00 con 0x7f6c1015d660 2023-10-14T12:34:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.976+0000 7f6c184cb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101f6ca0 con 0x7f6c10161c50 2023-10-14T12:34:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.976+0000 7f6c184cb700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101f6f80 con 0x7f6c100cd800 2023-10-14T12:34:53.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c15a66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 0x7f6c1014f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c15a66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 0x7f6c1014f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48800/0 (socket says 172.21.15.72:48800) 2023-10-14T12:34:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c15a66700 1 -- 172.21.15.72:0/1883961840 learned_addr learned my addr 172.21.15.72:0/1883961840 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c16267700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c100cd800 0x7f6c1014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c16a68700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c10161c50 0x7f6c100c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c15a66700 1 -- 172.21.15.72:0/1883961840 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c100cd800 msgr2=0x7f6c1014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c15a66700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c100cd800 0x7f6c1014f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c15a66700 1 -- 172.21.15.72:0/1883961840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c10161c50 msgr2=0x7f6c100c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c15a66700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c10161c50 0x7f6c100c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c15a66700 1 -- 172.21.15.72:0/1883961840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009550 con 0x7f6c1015d660 2023-10-14T12:34:53.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c15a66700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 0x7f6c1014f030 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00c4b0 tx=0x7f6c0c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c06ffd700 1 -- 172.21.15.72:0/1883961840 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0052d0 con 0x7f6c1015d660 2023-10-14T12:34:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c06ffd700 1 -- 172.21.15.72:0/1883961840 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c005430 con 0x7f6c1015d660 2023-10-14T12:34:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c101f7260 con 0x7f6c1015d660 2023-10-14T12:34:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c06ffd700 1 -- 172.21.15.72:0/1883961840 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0038c0 con 0x7f6c1015d660 2023-10-14T12:34:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.977+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c101f7820 con 0x7f6c1015d660 2023-10-14T12:34:53.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.978+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1004ebb0 con 0x7f6c1015d660 2023-10-14T12:34:53.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.978+0000 7f6c06ffd700 1 -- 172.21.15.72:0/1883961840 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c0c003a20 con 0x7f6c1015d660 2023-10-14T12:34:53.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.979+0000 7f6c06ffd700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6bf406af00 0x7f6bf406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:53.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.979+0000 7f6c16267700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6bf406af00 0x7f6bf406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:53.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.979+0000 7f6c06ffd700 1 -- 172.21.15.72:0/1883961840 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f6c0c088a30 con 0x7f6c1015d660 2023-10-14T12:34:53.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.979+0000 7f6c16267700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6bf406af00 0x7f6bf406d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009c40 tx=0x7f6c00008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:53.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:53.983+0000 7f6c06ffd700 1 -- 172.21.15.72:0/1883961840 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c0c053a10 con 0x7f6c1015d660 2023-10-14T12:34:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.249+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7f6c10161a30 con 0x7f6c1015d660 2023-10-14T12:34:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.253+0000 7f6c06ffd700 1 -- 172.21.15.72:0/1883961840 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 195+0+152 (secure 0 0 0) 0x7f6c0c0170f0 con 0x7f6c1015d660 2023-10-14T12:34:54.255 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-10-14T12:34:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBniiplx+gcNBAA9Bt6El4sSwdUx/6c4Ruo3g== 2023-10-14T12:34:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-10-14T12:34:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-10-14T12:34:54.255 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-14T12:34:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6bf406af00 msgr2=0x7f6bf406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6bf406af00 0x7f6bf406d3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009c40 tx=0x7f6c00008030 comp rx=0 tx=0).stop 2023-10-14T12:34:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 msgr2=0x7f6c1014f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 0x7f6c1014f030 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00c4b0 tx=0x7f6c0c00c7c0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 shutdown_connections 2023-10-14T12:34:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f6bf406af00 0x7f6bf406d3c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c10161c50 0x7f6c100c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f6c100cd800 0x7f6c1014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 --2- 172.21.15.72:0/1883961840 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1015d660 0x7f6c1014f030 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 >> 172.21.15.72:0/1883961840 conn(0x7f6c100ccce0 msgr2=0x7f6c100cb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 shutdown_connections 2023-10-14T12:34:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.255+0000 7f6c184cb700 1 -- 172.21.15.72:0/1883961840 wait complete. 2023-10-14T12:34:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-10-14T12:34:54.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:34:54.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.387+0000 7f3407d36700 1 Processor -- start 2023-10-14T12:34:54.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.387+0000 7f3407d36700 1 -- start start 2023-10-14T12:34:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f3407d36700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34000cd570 0x7f34000cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f3407d36700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000cbe10 con 0x7f34000b3410 2023-10-14T12:34:54.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f3407d36700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3400070d70 con 0x7f3400152470 2023-10-14T12:34:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f3407d36700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3400071200 con 0x7f34000cd570 2023-10-14T12:34:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f34062d3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34000cd570 0x7f34000cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:54.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f34052d1700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f34000b3410 0x7f34000b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55106/0 (socket says 172.21.15.72:55106) 2023-10-14T12:34:54.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f34052d1700 1 -- 172.21.15.72:0/2220070390 learned_addr learned my addr 172.21.15.72:0/2220070390 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:54.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f34062d3700 1 -- 172.21.15.72:0/2220070390 >> v1:172.21.15.123:6789/0 conn(0x7f3400152470 legacy=0x7f34000b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:54.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f34062d3700 1 -- 172.21.15.72:0/2220070390 >> v1:172.21.15.72:6789/0 conn(0x7f34000b3410 legacy=0x7f34000b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:54.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f34062d3700 1 -- 172.21.15.72:0/2220070390 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340015c990 con 0x7f34000cd570 2023-10-14T12:34:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.388+0000 7f3404ad0700 1 -- 172.21.15.72:0/2220070390 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802082066 0 0) 0x7f34000cbe10 con 0x7f34000b3410 2023-10-14T12:34:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f34062d3700 1 --2- 172.21.15.72:0/2220070390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 0x7f34000cb8d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009d90 tx=0x7f33f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cae4ec3dcdfc9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3404ad0700 1 -- 172.21.15.72:0/2220070390 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f800e070 con 0x7f34000cd570 2023-10-14T12:34:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3404ad0700 1 -- 172.21.15.72:0/2220070390 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f800bb90 con 0x7f34000cd570 2023-10-14T12:34:54.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3404ad0700 1 -- 172.21.15.72:0/2220070390 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8003a20 con 0x7f34000cd570 2023-10-14T12:34:54.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3407d36700 1 -- 172.21.15.72:0/2220070390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 msgr2=0x7f34000cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:54.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3407d36700 1 --2- 172.21.15.72:0/2220070390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 0x7f34000cb8d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009d90 tx=0x7f33f800b330 comp rx=0 tx=0).stop 2023-10-14T12:34:54.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3407d36700 1 -- 172.21.15.72:0/2220070390 shutdown_connections 2023-10-14T12:34:54.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3407d36700 1 --2- 172.21.15.72:0/2220070390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 0x7f34000cb8d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3407d36700 1 -- 172.21.15.72:0/2220070390 >> 172.21.15.72:0/2220070390 conn(0x7f34000cdd00 msgr2=0x7f34000ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:54.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3407d36700 1 -- 172.21.15.72:0/2220070390 shutdown_connections 2023-10-14T12:34:54.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.389+0000 7f3407d36700 1 -- 172.21.15.72:0/2220070390 wait complete. 2023-10-14T12:34:54.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f3407d36700 1 Processor -- start 2023-10-14T12:34:54.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f3407d36700 1 -- start start 2023-10-14T12:34:54.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f3407d36700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34000b3410 0x7f34000b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:54.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f3407d36700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 0x7f340014f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:54.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f3407d36700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3400152470 0x7f34000ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:54.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f3407d36700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000b58b0 con 0x7f34000cd570 2023-10-14T12:34:54.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f3407d36700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000c8350 con 0x7f34000b3410 2023-10-14T12:34:54.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f3407d36700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000cac10 con 0x7f3400152470 2023-10-14T12:34:54.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f34052d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 0x7f340014f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:54.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f34052d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 0x7f340014f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48814/0 (socket says 172.21.15.72:48814) 2023-10-14T12:34:54.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.391+0000 7f34052d1700 1 -- 172.21.15.72:0/2024122311 learned_addr learned my addr 172.21.15.72:0/2024122311 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:54.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f34052d1700 1 -- 172.21.15.72:0/2024122311 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3400152470 msgr2=0x7f34000ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:54.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f34052d1700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3400152470 0x7f34000ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f34052d1700 1 -- 172.21.15.72:0/2024122311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34000b3410 msgr2=0x7f34000b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:54.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f3405ad2700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34000b3410 0x7f34000b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:54.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f34052d1700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34000b3410 0x7f34000b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f34052d1700 1 -- 172.21.15.72:0/2024122311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009a70 con 0x7f34000cd570 2023-10-14T12:34:54.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f3405ad2700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34000b3410 0x7f34000b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:54.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f34052d1700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 0x7f340014f5d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0011e0 tx=0x7f33fc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f33f67fc700 1 -- 172.21.15.72:0/2024122311 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004c80 con 0x7f34000cd570 2023-10-14T12:34:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f33f67fc700 1 -- 172.21.15.72:0/2024122311 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33fc004e00 con 0x7f34000cd570 2023-10-14T12:34:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34000caef0 con 0x7f34000cd570 2023-10-14T12:34:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f33f67fc700 1 -- 172.21.15.72:0/2024122311 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc007310 con 0x7f34000cd570 2023-10-14T12:34:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.392+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34000c8610 con 0x7f34000cd570 2023-10-14T12:34:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.393+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34000c8830 con 0x7f34000cd570 2023-10-14T12:34:54.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.393+0000 7f33f67fc700 1 -- 172.21.15.72:0/2024122311 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f33fc007470 con 0x7f34000cd570 2023-10-14T12:34:54.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.394+0000 7f33f67fc700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f33e406aed0 0x7f33e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:54.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.394+0000 7f33f67fc700 1 -- 172.21.15.72:0/2024122311 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f33fc089510 con 0x7f34000cd570 2023-10-14T12:34:54.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.394+0000 7f3405ad2700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f33e406aed0 0x7f33e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:54.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.394+0000 7f3405ad2700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f33e406aed0 0x7f33e406d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:54.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.398+0000 7f33f67fc700 1 -- 172.21.15.72:0/2024122311 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33fc054460 con 0x7f34000cd570 2023-10-14T12:34:54.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.633+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f340004ebb0 con 0x7f34000cd570 2023-10-14T12:34:54.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.634+0000 7f33f67fc700 1 -- 172.21.15.72:0/2024122311 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f33fc057a80 con 0x7f34000cd570 2023-10-14T12:34:54.636 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:54.636 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4258036152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4258036152},{"type":"v1","addr":"172.21.15.123:6834","nonce":4258036152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1898946436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1898946436},{"type":"v1","addr":"172.21.15.123:6835","nonce":1898946436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5256,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3912655583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3912655583},{"type":"v1","addr":"172.21.15.72:6837","nonce":3912655583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:34:44.116303+0000","modified":"2023-10-14T12:34:47.161994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5259":{"gid":5259,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/1876334136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1876334136},{"type":"v1","addr":"172.21.15.72:6836","nonce":1876334136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T12:34:54.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f33e406aed0 msgr2=0x7f33e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:54.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f33e406aed0 0x7f33e406d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f33f0006fd0 tx=0x7f33f0008040 comp rx=0 tx=0).stop 2023-10-14T12:34:54.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 msgr2=0x7f340014f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:54.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 0x7f340014f5d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0011e0 tx=0x7f33fc00cae0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 shutdown_connections 2023-10-14T12:34:54.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f33e406aed0 0x7f33e406d390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3400152470 0x7f34000ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34000b3410 0x7f34000b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 --2- 172.21.15.72:0/2024122311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34000cd570 0x7f340014f5d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:54.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 >> 172.21.15.72:0/2024122311 conn(0x7f34000cdd00 msgr2=0x7f34000b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:54.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 shutdown_connections 2023-10-14T12:34:54.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:54.636+0000 7f3407d36700 1 -- 172.21.15.72:0/2024122311 wait complete. 2023-10-14T12:34:54.640 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2023-10-14T12:34:55.052 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T12:34:44.116303+0000', 'modified': '2023-10-14T12:34:47.161994+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5259}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5259': {'gid': 5259, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6836/1876334136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6834', 'nonce': 1876334136}, {'type': 'v1', 'addr': '172.21.15.72:6836', 'nonce': 1876334136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T12:34:55.052 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T12:34:55.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T12:34:55.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.174+0000 7f780bd18700 1 Processor -- start 2023-10-14T12:34:55.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.175+0000 7f780bd18700 1 -- start start 2023-10-14T12:34:55.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.175+0000 7f780bd18700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78040cb400 0x7f780415e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.175+0000 7f780bd18700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f780415eb80 0x7f78040aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.175+0000 7f780bd18700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780415e1b0 con 0x7f780415a240 2023-10-14T12:34:55.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.175+0000 7f780bd18700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780415de60 con 0x7f780415eb80 2023-10-14T12:34:55.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.175+0000 7f780bd18700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78040cb9c0 con 0x7f78040cb400 2023-10-14T12:34:55.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.175+0000 7f780a2b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f780415eb80 0x7f78040aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f780a2b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f780415eb80 0x7f78040aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48824/0 (socket says 172.21.15.72:48824) 2023-10-14T12:34:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f780a2b5700 1 -- 172.21.15.72:0/908713117 learned_addr learned my addr 172.21.15.72:0/908713117 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f78092b3700 1 --2- 172.21.15.72:0/908713117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78040cb400 0x7f780415e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f780a2b5700 1 -- 172.21.15.72:0/908713117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78040cb400 msgr2=0x7f780415e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f780a2b5700 1 --2- 172.21.15.72:0/908713117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78040cb400 0x7f780415e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f780a2b5700 1 -- 172.21.15.72:0/908713117 >> v1:172.21.15.123:6789/0 conn(0x7f780415a240 legacy=0x7f78040caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f780a2b5700 1 -- 172.21.15.72:0/908713117 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040cbca0 con 0x7f780415eb80 2023-10-14T12:34:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f780a2b5700 1 --2- 172.21.15.72:0/908713117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f780415eb80 0x7f78040aefb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00d150 tx=0x7f77fc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbb210e10035f69 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f7808ab2700 1 -- 172.21.15.72:0/908713117 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc010070 con 0x7f780415eb80 2023-10-14T12:34:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f7808ab2700 1 -- 172.21.15.72:0/908713117 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc00dd10 con 0x7f780415eb80 2023-10-14T12:34:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.176+0000 7f7808ab2700 1 -- 172.21.15.72:0/908713117 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00b310 con 0x7f780415eb80 2023-10-14T12:34:55.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.177+0000 7f780bd18700 1 -- 172.21.15.72:0/908713117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f780415eb80 msgr2=0x7f78040aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.177+0000 7f780bd18700 1 --2- 172.21.15.72:0/908713117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f780415eb80 0x7f78040aefb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00d150 tx=0x7f77fc00d460 comp rx=0 tx=0).stop 2023-10-14T12:34:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.177+0000 7f780bd18700 1 -- 172.21.15.72:0/908713117 shutdown_connections 2023-10-14T12:34:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.177+0000 7f780bd18700 1 --2- 172.21.15.72:0/908713117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f780415eb80 0x7f78040aefb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.177+0000 7f780bd18700 1 --2- 172.21.15.72:0/908713117 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f78040cb400 0x7f780415e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.177+0000 7f780bd18700 1 -- 172.21.15.72:0/908713117 >> 172.21.15.72:0/908713117 conn(0x7f78040ccbd0 msgr2=0x7f78040ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:55.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.177+0000 7f780bd18700 1 -- 172.21.15.72:0/908713117 shutdown_connections 2023-10-14T12:34:55.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.177+0000 7f780bd18700 1 -- 172.21.15.72:0/908713117 wait complete. 2023-10-14T12:34:55.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.178+0000 7f780bd18700 1 Processor -- start 2023-10-14T12:34:55.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.178+0000 7f780bd18700 1 -- start start 2023-10-14T12:34:55.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780bd18700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78040cb400 0x7f7804156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780bd18700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f780415a240 0x7f78041f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780bd18700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780415eb80 0x7f78040c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780bd18700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78041f6630 con 0x7f78040cb400 2023-10-14T12:34:55.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780bd18700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78040c78d0 con 0x7f780415eb80 2023-10-14T12:34:55.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780bd18700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7804156b90 con 0x7f780415a240 2023-10-14T12:34:55.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f7809ab4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78040cb400 0x7f7804156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f7809ab4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78040cb400 0x7f7804156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48826/0 (socket says 172.21.15.72:48826) 2023-10-14T12:34:55.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f7809ab4700 1 -- 172.21.15.72:0/1605647514 learned_addr learned my addr 172.21.15.72:0/1605647514 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:55.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f78092b3700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f780415a240 0x7f78041f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780a2b5700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780415eb80 0x7f78040c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f7809ab4700 1 -- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f780415a240 msgr2=0x7f78041f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f7809ab4700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f780415a240 0x7f78041f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f7809ab4700 1 -- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780415eb80 msgr2=0x7f78040c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f7809ab4700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780415eb80 0x7f78040c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f7809ab4700 1 -- 172.21.15.72:0/1605647514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc00bd40 con 0x7f78040cb400 2023-10-14T12:34:55.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f78092b3700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f780415a240 0x7f78041f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:55.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780a2b5700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780415eb80 0x7f78040c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:55.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f7809ab4700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78040cb400 0x7f7804156650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c4e0 tx=0x7f77f400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f77fa7fc700 1 -- 172.21.15.72:0/1605647514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40052d0 con 0x7f78040cb400 2023-10-14T12:34:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f77fa7fc700 1 -- 172.21.15.72:0/1605647514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4005430 con 0x7f78040cb400 2023-10-14T12:34:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780bd18700 1 -- 172.21.15.72:0/1605647514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78040c7310 con 0x7f78040cb400 2023-10-14T12:34:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f77fa7fc700 1 -- 172.21.15.72:0/1605647514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40038c0 con 0x7f78040cb400 2023-10-14T12:34:55.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.179+0000 7f780bd18700 1 -- 172.21.15.72:0/1605647514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78041f6250 con 0x7f78040cb400 2023-10-14T12:34:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.181+0000 7f77fa7fc700 1 -- 172.21.15.72:0/1605647514 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f77f4003a20 con 0x7f78040cb400 2023-10-14T12:34:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.181+0000 7f77fa7fc700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77e806af00 0x7f77e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.182+0000 7f77fa7fc700 1 -- 172.21.15.72:0/1605647514 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f77f4088bc0 con 0x7f78040cb400 2023-10-14T12:34:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.182+0000 7f78092b3700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77e806af00 0x7f77e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.182+0000 7f78092b3700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77e806af00 0x7f77e806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7800009c30 tx=0x7f7800008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.183+0000 7f7817f02b80 1 Processor -- start 2023-10-14T12:34:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.183+0000 7f7817f02b80 1 -- start start 2023-10-14T12:34:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402f3ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f3bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f0f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f7817f02b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558402e85c20 con 0x558402f39630 2023-10-14T12:34:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f7817f02b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x558402e6ac10 con 0x558402f34220 2023-10-14T12:34:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f7817f02b80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x558402e68530 con 0x558402f0f010 2023-10-14T12:34:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f78092b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f3bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f78092b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f3bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48836/0 (socket says 172.21.15.72:48836) 2023-10-14T12:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f78092b3700 1 -- 172.21.15.72:0/2422144284 learned_addr learned my addr 172.21.15.72:0/2422144284 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f7809ab4700 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402f3ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f780a2b5700 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f0f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f78092b3700 1 -- 172.21.15.72:0/2422144284 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 msgr2=0x558402f0f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f78092b3700 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f0f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f78092b3700 1 -- 172.21.15.72:0/2422144284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 msgr2=0x558402f3ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.184+0000 7f78092b3700 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402f3ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.185+0000 7f78092b3700 1 -- 172.21.15.72:0/2422144284 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558402e213a0 con 0x558402f39630 2023-10-14T12:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.185+0000 7f780a2b5700 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f0f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:55.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.185+0000 7f78092b3700 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f3bfb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7800004490 tx=0x7f7800014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4f322e75951b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.185+0000 7f77e77fe700 1 -- 172.21.15.72:0/2422144284 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800004540 con 0x558402f39630 2023-10-14T12:34:55.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.185+0000 7f77e77fe700 1 -- 172.21.15.72:0/2422144284 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78000036a0 con 0x558402f39630 2023-10-14T12:34:55.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.185+0000 7f77e77fe700 1 -- 172.21.15.72:0/2422144284 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7800003a10 con 0x558402f39630 2023-10-14T12:34:55.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.185+0000 7f7817f02b80 1 -- 172.21.15.72:0/2422144284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 msgr2=0x558402f3bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.185+0000 7f7817f02b80 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f3bfb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7800004490 tx=0x7f7800014000 comp rx=0 tx=0).stop 2023-10-14T12:34:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.186+0000 7f7817f02b80 1 -- 172.21.15.72:0/2422144284 shutdown_connections 2023-10-14T12:34:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.186+0000 7f7817f02b80 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f0f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.186+0000 7f7817f02b80 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402f3ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.186+0000 7f7817f02b80 1 --2- 172.21.15.72:0/2422144284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f3bfb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.186+0000 7f7817f02b80 1 -- 172.21.15.72:0/2422144284 >> 172.21.15.72:0/2422144284 conn(0x558402e3ed80 msgr2=0x558402f59ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.186+0000 7f7817f02b80 1 -- 172.21.15.72:0/2422144284 shutdown_connections 2023-10-14T12:34:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.186+0000 7f7817f02b80 1 -- 172.21.15.72:0/2422144284 wait complete. 2023-10-14T12:34:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.186+0000 7f7817f02b80 1 -- start start 2023-10-14T12:34:55.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.186+0000 7f7817f02b80 1 Processor -- start 2023-10-14T12:34:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f33640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f34220 0x558402f65cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f39630 0x558402f3aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7817f02b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558402e63e20 con 0x558402f0f010 2023-10-14T12:34:55.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7817f02b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x558402e006c0 con 0x558402f39630 2023-10-14T12:34:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7817f02b80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x558402e00360 con 0x558402f34220 2023-10-14T12:34:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7817f02b80 10 client.0 _ll_register_callbacks cb 0x558402c5d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:34:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7809ab4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f33640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7809ab4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f33640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48840/0 (socket says 172.21.15.72:48840) 2023-10-14T12:34:55.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7809ab4700 1 -- 172.21.15.72:0/1820769992 learned_addr learned my addr 172.21.15.72:0/1820769992 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f780a2b5700 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f39630 0x558402f3aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f78092b3700 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f34220 0x558402f65cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7809ab4700 1 -- 172.21.15.72:0/1820769992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f34220 msgr2=0x558402f65cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7809ab4700 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f34220 0x558402f65cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7809ab4700 1 -- 172.21.15.72:0/1820769992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f39630 msgr2=0x558402f3aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.187+0000 7f7809ab4700 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f39630 0x558402f3aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7809ab4700 1 -- 172.21.15.72:0/1820769992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7800004170 con 0x558402f0f010 2023-10-14T12:34:55.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f78092b3700 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f34220 0x558402f65cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:55.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7809ab4700 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f33640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f77f4057560 tx=0x7f77f4057860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2744c60e8b3b5745 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f77e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-10-14T12:34:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f77e4ff9700 1 -- 172.21.15.72:0/1820769992 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f406f180 con 0x558402f0f010 2023-10-14T12:34:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f77e4ff9700 1 -- 172.21.15.72:0/1820769992 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f77f405fb60 con 0x558402f0f010 2023-10-14T12:34:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7817f02b80 1 -- 172.21.15.72:0/1820769992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558402f045b0 con 0x558402f0f010 2023-10-14T12:34:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f77e4ff9700 1 -- 172.21.15.72:0/1820769992 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77f4057630 con 0x558402f0f010 2023-10-14T12:34:55.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7817f02b80 10 client.5487 fetch_fsmap learned FSMap version 18 2023-10-14T12:34:55.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7817f02b80 1 -- 172.21.15.72:0/1820769992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558402c8ed90 con 0x558402f0f010 2023-10-14T12:34:55.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f77e4ff9700 1 -- 172.21.15.72:0/1820769992 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4074020 con 0x558402f0f010 2023-10-14T12:34:55.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f77e4ff9700 1 -- 172.21.15.72:0/1820769992 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 18) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f77f4056d50 con 0x558402f0f010 2023-10-14T12:34:55.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7817f02b80 10 client.5487 fetch_fsmap finished waiting for FSMap version 18 2023-10-14T12:34:55.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7817f02b80 10 client.5487 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T12:34:55.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7817f02b80 20 client.5487 populate_metadata read hostname 'smithi072' 2023-10-14T12:34:55.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7817f02b80 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] conn(0x558402f37ef0 0x558402f382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7817f02b80 4 client.5487 mds_command: new command op to 5259 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T12:34:55.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f7817f02b80 1 -- 172.21.15.72:0/1820769992 --> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558402e5ce00 con 0x558402f37ef0 2023-10-14T12:34:55.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.188+0000 7f78092b3700 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] conn(0x558402f37ef0 0x558402f382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f77e4ff9700 10 client.5487 ms_handle_connect on v2:172.21.15.72:6834/1876334136 2023-10-14T12:34:55.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f78092b3700 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] conn(0x558402f37ef0 0x558402f382d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f53e97f16bdc4e01 server_cookie=c317aff583e6d612 in_seq=0 out_seq=0 2023-10-14T12:34:55.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f77e4ff9700 1 -- 172.21.15.72:0/1820769992 <== mds.0 v2:172.21.15.72:6834/1876334136 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558402e5ce00 con 0x558402f37ef0 2023-10-14T12:34:55.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f77e4ff9700 10 client.5487 handle_command_reply: tid=0 2023-10-14T12:34:55.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f7817f02b80 1 client.5487 shutdown 2023-10-14T12:34:55.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f7817f02b80 1 -- 172.21.15.72:0/1820769992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 msgr2=0x558402f33640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f7817f02b80 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f33640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f77f4057560 tx=0x7f77f4057860 comp rx=0 tx=0).stop 2023-10-14T12:34:55.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f7817f02b80 1 -- 172.21.15.72:0/1820769992 shutdown_connections 2023-10-14T12:34:55.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f7817f02b80 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f39630 0x558402f3aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f7817f02b80 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f33640 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f7817f02b80 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] conn(0x558402f37ef0 0x558402f382d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f7817f02b80 1 --2- 172.21.15.72:0/1820769992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f34220 0x558402f65cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f7817f02b80 1 -- 172.21.15.72:0/1820769992 >> 172.21.15.72:0/1820769992 conn(0x558402e3ed80 msgr2=0x558402f59f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:55.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.189+0000 7f77e4ff9700 0 client.5487 ms_handle_reset on v2:172.21.15.72:6834/1876334136 2023-10-14T12:34:55.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.190+0000 7f7817f02b80 1 -- 172.21.15.72:0/1820769992 shutdown_connections 2023-10-14T12:34:55.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.190+0000 7f7817f02b80 1 -- 172.21.15.72:0/1820769992 wait complete. 2023-10-14T12:34:55.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.190+0000 7f7817f02b80 20 client.5487 trim_cache size 0 max 16384 2023-10-14T12:34:55.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.207+0000 7f7817f02b80 1 Processor -- start 2023-10-14T12:34:55.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.207+0000 7f7817f02b80 1 -- start start 2023-10-14T12:34:55.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f35bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402f32ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f7817f02b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558402ce48d0 con 0x558402f39630 2023-10-14T12:34:55.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f7817f02b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x558402f50ed0 con 0x558402f34220 2023-10-14T12:34:55.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f7817f02b80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x558402f36420 con 0x558402f0f010 2023-10-14T12:34:55.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f780a2b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f780a2b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48852/0 (socket says 172.21.15.72:48852) 2023-10-14T12:34:55.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f780a2b5700 1 -- 172.21.15.72:0/4159670315 learned_addr learned my addr 172.21.15.72:0/4159670315 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:55.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f78092b3700 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402f32ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f7809ab4700 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f35bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f780a2b5700 1 -- 172.21.15.72:0/4159670315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 msgr2=0x558402f35bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f780a2b5700 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f35bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f780a2b5700 1 -- 172.21.15.72:0/4159670315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 msgr2=0x558402f32ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f780a2b5700 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402f32ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f780a2b5700 1 -- 172.21.15.72:0/4159670315 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558402f0db20 con 0x558402f39630 2023-10-14T12:34:55.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f7809ab4700 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f35bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:55.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.208+0000 7f780a2b5700 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f382d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00b5e0 tx=0x7f77fc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350ac86359a990f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f77e7fff700 1 -- 172.21.15.72:0/4159670315 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc003a20 con 0x558402f39630 2023-10-14T12:34:55.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f77e7fff700 1 -- 172.21.15.72:0/4159670315 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc003b80 con 0x558402f39630 2023-10-14T12:34:55.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f77e7fff700 1 -- 172.21.15.72:0/4159670315 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc004040 con 0x558402f39630 2023-10-14T12:34:55.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f7817f02b80 1 -- 172.21.15.72:0/4159670315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 msgr2=0x558402f382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f7817f02b80 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f382d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00b5e0 tx=0x7f77fc012000 comp rx=0 tx=0).stop 2023-10-14T12:34:55.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f7817f02b80 1 -- 172.21.15.72:0/4159670315 shutdown_connections 2023-10-14T12:34:55.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f7817f02b80 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f39630 0x558402f382d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f7817f02b80 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f0f010 0x558402f35bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f7817f02b80 1 --2- 172.21.15.72:0/4159670315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402f32ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f7817f02b80 1 -- 172.21.15.72:0/4159670315 >> 172.21.15.72:0/4159670315 conn(0x558402e3ed80 msgr2=0x558402f78700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:55.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f7817f02b80 1 -- 172.21.15.72:0/4159670315 shutdown_connections 2023-10-14T12:34:55.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.209+0000 7f7817f02b80 1 -- 172.21.15.72:0/4159670315 wait complete. 2023-10-14T12:34:55.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.210+0000 7f7817f02b80 1 -- start start 2023-10-14T12:34:55.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.210+0000 7f7817f02b80 1 Processor -- start 2023-10-14T12:34:55.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f35220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402fa6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7817f02b80 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f39630 0x558402f05f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7817f02b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558402f65810 con 0x558402f0f010 2023-10-14T12:34:55.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7817f02b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x558402fc1f50 con 0x558402f34220 2023-10-14T12:34:55.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7817f02b80 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x558402fc2210 con 0x558402f39630 2023-10-14T12:34:55.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7817f02b80 10 client.0 _ll_register_callbacks cb 0x7f77f40573c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:34:55.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7809ab4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f35220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7809ab4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f35220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48854/0 (socket says 172.21.15.72:48854) 2023-10-14T12:34:55.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7809ab4700 1 -- 172.21.15.72:0/3223384138 learned_addr learned my addr 172.21.15.72:0/3223384138 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:55.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f78092b3700 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402fa6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f780a2b5700 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f39630 0x558402f05f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7809ab4700 1 -- 172.21.15.72:0/3223384138 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f39630 msgr2=0x558402f05f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7809ab4700 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f39630 0x558402f05f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7809ab4700 1 -- 172.21.15.72:0/3223384138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 msgr2=0x558402fa6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7809ab4700 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402fa6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7809ab4700 1 -- 172.21.15.72:0/3223384138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78040cbca0 con 0x558402f0f010 2023-10-14T12:34:55.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f780a2b5700 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f39630 0x558402f05f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:55.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7809ab4700 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f35220 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f77f405f630 tx=0x7f77f4086ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb9080dfc9bdd29 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f77e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-10-14T12:34:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f77e4ff9700 1 -- 172.21.15.72:0/3223384138 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f405f6d0 con 0x558402f0f010 2023-10-14T12:34:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f77e4ff9700 1 -- 172.21.15.72:0/3223384138 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f77f4075080 con 0x558402f0f010 2023-10-14T12:34:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.211+0000 7f7817f02b80 1 -- 172.21.15.72:0/3223384138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f78000036a0 con 0x558402f0f010 2023-10-14T12:34:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f77e4ff9700 1 -- 172.21.15.72:0/3223384138 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77f406f180 con 0x558402f0f010 2023-10-14T12:34:55.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f7817f02b80 10 client.5493 fetch_fsmap learned FSMap version 18 2023-10-14T12:34:55.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f7817f02b80 1 -- 172.21.15.72:0/3223384138 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558402c77c10 con 0x558402f0f010 2023-10-14T12:34:55.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f77e4ff9700 1 -- 172.21.15.72:0/3223384138 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78000036a0 con 0x558402f0f010 2023-10-14T12:34:55.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f77e4ff9700 1 -- 172.21.15.72:0/3223384138 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 18) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f77f4056d50 con 0x558402f0f010 2023-10-14T12:34:55.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f7817f02b80 10 client.5493 fetch_fsmap finished waiting for FSMap version 18 2023-10-14T12:34:55.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f7817f02b80 10 client.5493 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T12:34:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f7817f02b80 20 client.5493 populate_metadata read hostname 'smithi072' 2023-10-14T12:34:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f7817f02b80 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] conn(0x558402f649a0 0x558402f64d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f7817f02b80 4 client.5493 mds_command: new command op to 5259 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T12:34:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f7817f02b80 1 -- 172.21.15.72:0/3223384138 --> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558402e5cb20 con 0x558402f649a0 2023-10-14T12:34:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f78092b3700 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] conn(0x558402f649a0 0x558402f64d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f77e4ff9700 10 client.5493 ms_handle_connect on v2:172.21.15.72:6834/1876334136 2023-10-14T12:34:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.212+0000 7f78092b3700 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] conn(0x558402f649a0 0x558402f64d80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb08a0fb5ae2fe6c server_cookie=98cbb09ee644d33c in_seq=0 out_seq=0 2023-10-14T12:34:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f77e4ff9700 1 -- 172.21.15.72:0/3223384138 <== mds.0 v2:172.21.15.72:6834/1876334136 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x558402e5cb20 con 0x558402f649a0 2023-10-14T12:34:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f77e4ff9700 10 client.5493 handle_command_reply: tid=0 2023-10-14T12:34:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 client.5493 shutdown 2023-10-14T12:34:55.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 -- 172.21.15.72:0/3223384138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 msgr2=0x558402f35220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f35220 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f77f405f630 tx=0x7f77f4086ef0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 -- 172.21.15.72:0/3223384138 shutdown_connections 2023-10-14T12:34:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.72:6834/1876334136,v1:172.21.15.72:6836/1876334136] conn(0x558402f649a0 0x558402f64d80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x558402f39630 0x558402f05f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558402f0f010 0x558402f35220 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 --2- 172.21.15.72:0/3223384138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558402f34220 0x558402fa6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f77e4ff9700 0 client.5493 ms_handle_reset on v2:172.21.15.72:6834/1876334136 2023-10-14T12:34:55.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 -- 172.21.15.72:0/3223384138 >> 172.21.15.72:0/3223384138 conn(0x558402e3ed80 msgr2=0x558402f78700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:55.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 -- 172.21.15.72:0/3223384138 shutdown_connections 2023-10-14T12:34:55.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 1 -- 172.21.15.72:0/3223384138 wait complete. 2023-10-14T12:34:55.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f7817f02b80 20 client.5493 trim_cache size 0 max 16384 2023-10-14T12:34:55.239 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:34:55.239 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8", 2023-10-14T12:34:55.239 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-10-14T12:34:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5259, 2023-10-14T12:34:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-10-14T12:34:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-10-14T12:34:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "testcephfs1", 2023-10-14T12:34:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 10.467094444000001, 2023-10-14T12:34:55.241 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 18, 2023-10-14T12:34:55.241 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 38, 2023-10-14T12:34:55.241 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 38, 2023-10-14T12:34:55.241 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 18.367185958 2023-10-14T12:34:55.241 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:34:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 -- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77e806af00 msgr2=0x7f77e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77e806af00 0x7f77e806d3c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7800009c30 tx=0x7f7800008040 comp rx=0 tx=0).stop 2023-10-14T12:34:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 -- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78040cb400 msgr2=0x7f7804156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78040cb400 0x7f7804156650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c4e0 tx=0x7f77f400c8a0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 -- 172.21.15.72:0/1605647514 shutdown_connections 2023-10-14T12:34:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f77e806af00 0x7f77e806d3c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780415eb80 0x7f78040c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78040cb400 0x7f7804156650 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 --2- 172.21.15.72:0/1605647514 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f780415a240 0x7f78041f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.213+0000 7f780bd18700 1 -- 172.21.15.72:0/1605647514 >> 172.21.15.72:0/1605647514 conn(0x7f78040ccbd0 msgr2=0x7f7804157780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:55.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.214+0000 7f780bd18700 1 -- 172.21.15.72:0/1605647514 shutdown_connections 2023-10-14T12:34:55.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.214+0000 7f780bd18700 1 -- 172.21.15.72:0/1605647514 wait complete. 2023-10-14T12:34:55.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:34:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.365+0000 7f8d91362700 1 Processor -- start 2023-10-14T12:34:55.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.365+0000 7f8d91362700 1 -- start start 2023-10-14T12:34:55.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.365+0000 7f8d91362700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d8c0c9dd0 0x7f8d8c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.365+0000 7f8d91362700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.365+0000 7f8d91362700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c06d6b0 con 0x7f8d8c0cba60 2023-10-14T12:34:55.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.365+0000 7f8d91362700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c0cc450 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.365+0000 7f8d91362700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c15fea0 con 0x7f8d8c15f6c0 2023-10-14T12:34:55.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d8b7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d8affd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d8c0c9dd0 0x7f8d8c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d8b7fe700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:44514/0 (socket says 172.21.15.72:44514) 2023-10-14T12:34:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d8b7fe700 1 -- 172.21.15.72:0/2409364799 learned_addr learned my addr 172.21.15.72:0/2409364799 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d8b7fe700 1 -- 172.21.15.72:0/2409364799 >> v2:172.21.15.123:3300/0 conn(0x7f8d8c0c9dd0 msgr2=0x7f8d8c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:55.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d8b7fe700 1 --2- 172.21.15.72:0/2409364799 >> v2:172.21.15.123:3300/0 conn(0x7f8d8c0c9dd0 0x7f8d8c15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d8b7fe700 1 -- 172.21.15.72:0/2409364799 >> v1:172.21.15.123:6789/0 conn(0x7f8d8c0cba60 legacy=0x7f8d8c15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d8b7fe700 1 -- 172.21.15.72:0/2409364799 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c15fbc0 con 0x7f8d8c15f6c0 2023-10-14T12:34:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d8b7fe700 1 --2- 172.21.15.72:0/2409364799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cbf10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009e50 tx=0x7f8d8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=178f2e97943b581c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d89ffb700 1 -- 172.21.15.72:0/2409364799 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8400e070 con 0x7f8d8c15f6c0 2023-10-14T12:34:55.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.366+0000 7f8d89ffb700 1 -- 172.21.15.72:0/2409364799 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8400b910 con 0x7f8d8c15f6c0 2023-10-14T12:34:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.367+0000 7f8d89ffb700 1 -- 172.21.15.72:0/2409364799 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8400bcc0 con 0x7f8d8c15f6c0 2023-10-14T12:34:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.367+0000 7f8d91362700 1 -- 172.21.15.72:0/2409364799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 msgr2=0x7f8d8c0cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.367+0000 7f8d91362700 1 --2- 172.21.15.72:0/2409364799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cbf10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009e50 tx=0x7f8d8400b330 comp rx=0 tx=0).stop 2023-10-14T12:34:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.367+0000 7f8d91362700 1 -- 172.21.15.72:0/2409364799 shutdown_connections 2023-10-14T12:34:55.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.367+0000 7f8d91362700 1 --2- 172.21.15.72:0/2409364799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cbf10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.367+0000 7f8d91362700 1 --2- 172.21.15.72:0/2409364799 >> v2:172.21.15.123:3300/0 conn(0x7f8d8c0c9dd0 0x7f8d8c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.367+0000 7f8d91362700 1 -- 172.21.15.72:0/2409364799 >> 172.21.15.72:0/2409364799 conn(0x7f8d8c06c850 msgr2=0x7f8d8c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.367+0000 7f8d91362700 1 -- 172.21.15.72:0/2409364799 shutdown_connections 2023-10-14T12:34:55.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.367+0000 7f8d91362700 1 -- 172.21.15.72:0/2409364799 wait complete. 2023-10-14T12:34:55.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.368+0000 7f8d91362700 1 Processor -- start 2023-10-14T12:34:55.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.368+0000 7f8d91362700 1 -- start start 2023-10-14T12:34:55.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d91362700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c9dd0 0x7f8d8c0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d91362700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d8c0cba60 0x7f8d8c146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d91362700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d91362700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0b2450 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d91362700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0b2db0 con 0x7f8d8c0cba60 2023-10-14T12:34:55.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d91362700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c1471c0 con 0x7f8d8c15f6c0 2023-10-14T12:34:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d8affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c9dd0 0x7f8d8c0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d8affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c9dd0 0x7f8d8c0b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48866/0 (socket says 172.21.15.72:48866) 2023-10-14T12:34:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d8affd700 1 -- 172.21.15.72:0/4079545992 learned_addr learned my addr 172.21.15.72:0/4079545992 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:55.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d8a7fc700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d8c0cba60 0x7f8d8c146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.369+0000 7f8d8b7fe700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d8affd700 1 -- 172.21.15.72:0/4079545992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 msgr2=0x7f8d8c0cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d8affd700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d8affd700 1 -- 172.21.15.72:0/4079545992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d8c0cba60 msgr2=0x7f8d8c146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d8affd700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d8c0cba60 0x7f8d8c146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d8affd700 1 -- 172.21.15.72:0/4079545992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84009b30 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d8b7fe700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d8affd700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c9dd0 0x7f8d8c0b2870 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e9b0 tx=0x7f8d7c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d837fe700 1 -- 172.21.15.72:0/4079545992 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c009710 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d837fe700 1 -- 172.21.15.72:0/4079545992 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c00c850 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c0b4180 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d837fe700 1 -- 172.21.15.72:0/4079545992 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00cbc0 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.370+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c0b1d90 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.371+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c0b26c0 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.371+0000 7f8d837fe700 1 -- 172.21.15.72:0/4079545992 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8d7c00cd20 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.372+0000 7f8d837fe700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8d6c06af00 0x7f8d6c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.372+0000 7f8d8a7fc700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8d6c06af00 0x7f8d6c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.372+0000 7f8d837fe700 1 -- 172.21.15.72:0/4079545992 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f8d7c089700 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.372+0000 7f8d8a7fc700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8d6c06af00 0x7f8d6c06d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8d74007fd0 tx=0x7f8d74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:55.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.376+0000 7f8d837fe700 1 -- 172.21.15.72:0/4079545992 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d7c0546e0 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.611+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d8c04f400 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.612+0000 7f8d837fe700 1 -- 172.21.15.72:0/4079545992 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8d7c057d00 con 0x7f8d8c0c9dd0 2023-10-14T12:34:55.614 INFO:teuthology.orchestra.run.smithi072.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-14T12:34:55.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8d6c06af00 msgr2=0x7f8d6c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8d6c06af00 0x7f8d6c06d3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8d74007fd0 tx=0x7f8d74009040 comp rx=0 tx=0).stop 2023-10-14T12:34:55.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c9dd0 msgr2=0x7f8d8c0b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:55.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c9dd0 0x7f8d8c0b2870 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e9b0 tx=0x7f8d7c00ecc0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 shutdown_connections 2023-10-14T12:34:55.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f8d6c06af00 0x7f8d6c06d3c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8d8c15f6c0 0x7f8d8c0cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8c0c9dd0 0x7f8d8c0b2870 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 --2- 172.21.15.72:0/4079545992 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d8c0cba60 0x7f8d8c146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 >> 172.21.15.72:0/4079545992 conn(0x7f8d8c06c850 msgr2=0x7f8d8c1558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 shutdown_connections 2023-10-14T12:34:55.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:55.614+0000 7f8d91362700 1 -- 172.21.15.72:0/4079545992 wait complete. 2023-10-14T12:34:55.627 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T12:34:55.628 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:34:55.628 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-10-14T12:34:55.629 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T12:34:55.629 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T12:34:55.629 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T12:34:55.630 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T12:34:55.630 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:34:55.630 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:34:55.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:55.631 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-10-14T12:34:55.649 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:34:55.649 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:34:55.650 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:34:55.650 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:55.650 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T12:34:55.650 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:55.651 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:55.651 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:55.651 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:55.651 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:55.651 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:34:55.652 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:55.652 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:34:55.652 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:55.652 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:34:55.652 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42334sec preferred_lft 42334sec 2023-10-14T12:34:55.653 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e497:c464:2199:335/64 scope link noprefixroute 2023-10-14T12:34:55.653 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:55.653 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:34:55.653 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 5a:05:82:e7:5e:60 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:34:55.653 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T12:34:55.654 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:55.654 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::fc8e:48ff:fe28:ff93/64 scope link 2023-10-14T12:34:55.654 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:55.654 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:34:55.654 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether fe:41:c0:8b:d6:30 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:34:55.655 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::fc41:c0ff:fe8b:d630/64 scope link 2023-10-14T12:34:55.655 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:55.655 INFO:teuthology.orchestra.run.smithi072.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:34:55.655 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 5a:05:82:e7:5e:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:34:55.655 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::5805:82ff:fee7:5e60/64 scope link 2023-10-14T12:34:55.655 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:34:55.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:55.656 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:34:55.714 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-14T12:34:55.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:55.716 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-10-14T12:34:55.775 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-10-14T12:34:55.775 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:34:55.775 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:34:55.775 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:34:55.776 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:34:55.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:55.777 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T12:34:55.777 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T12:34:55.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:34:55.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:34:55.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:34:55.778 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T12:34:55.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:55.880 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T12:34:55.896 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T12:34:55.897 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T12:34:55.897 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:34:55.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:55.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-10-14T12:34:55.964 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:55.965 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T12:34:56.022 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:34:56.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:34:56.024 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:34:56.078 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-14T12:34:56.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:56.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:56.164 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:56.165 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:56.188 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:56.189 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:56.189 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:56.189 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 0@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:56.189 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:56.189 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:56.190 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:56.190 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:56.245 INFO:teuthology.orchestra.run.smithi072.stderr:mount error 2 = No such file or directory 2023-10-14T12:34:56.246 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T12:34:56.246 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T12:34:56.246 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.123:3300,172.21.15.123:3301" 2023-10-14T12:34:56.247 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 0@76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8.cephfs=/ 2023-10-14T12:34:56.247 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.72:3300/172.21.15.123:3300/172.21.15.123:3301" will pass to kernel 2023-10-14T12:34:56.247 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T12:34:56.247 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T12:34:56.248 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T12:34:56.248 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790" 2023-10-14T12:34:56.248 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.123:6789,172.21.15.123:6790:/ 2023-10-14T12:34:56.248 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8" will pass to kernel 2023-10-14T12:34:56.249 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-14T12:34:56.250 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-10-14T12:34:56.250 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ERROR 2023-10-14T12:34:56.251 INFO:tasks.cephfs_test_runner: 2023-10-14T12:34:56.251 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T12:34:56.252 INFO:tasks.cephfs_test_runner:ERROR: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-10-14T12:34:56.252 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T12:34:56.252 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T12:34:56.252 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/xfstests_dev.py", line 27, in setUp 2023-10-14T12:34:56.253 INFO:tasks.cephfs_test_runner: super(XFSTestsDev, self).setUp() 2023-10-14T12:34:56.253 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-14T12:34:56.253 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-14T12:34:56.254 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-14T12:34:56.254 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-14T12:34:56.254 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-14T12:34:56.254 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-14T12:34:56.255 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-14T12:34:56.255 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-14T12:34:56.255 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T12:34:56.255 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T12:34:56.256 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T12:34:56.256 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T12:34:56.257 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T12:34:56.257 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T12:34:56.257 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T12:34:56.257 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T12:34:56.258 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-14T12:34:56.258 INFO:tasks.cephfs_test_runner: 2023-10-14T12:34:56.258 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T12:34:56.259 INFO:tasks.cephfs_test_runner:Ran 1 test in 40.559s 2023-10-14T12:34:56.259 INFO:tasks.cephfs_test_runner: 2023-10-14T12:34:56.259 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-14T12:34:56.260 INFO:tasks.cephfs_test_runner: 2023-10-14T12:34:56.260 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T12:34:56.260 INFO:tasks.cephfs_test_runner:ERROR: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-10-14T12:34:56.260 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T12:34:56.261 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T12:34:56.261 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/xfstests_dev.py", line 27, in setUp 2023-10-14T12:34:56.261 INFO:tasks.cephfs_test_runner: super(XFSTestsDev, self).setUp() 2023-10-14T12:34:56.261 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-14T12:34:56.262 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-14T12:34:56.262 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-14T12:34:56.262 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-14T12:34:56.263 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-14T12:34:56.263 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-14T12:34:56.263 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-14T12:34:56.263 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-14T12:34:56.264 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T12:34:56.264 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T12:34:56.264 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T12:34:56.265 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T12:34:56.265 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T12:34:56.265 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T12:34:56.265 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T12:34:56.266 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T12:34:56.266 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-14T12:34:56.266 INFO:tasks.cephfs_test_runner: 2023-10-14T12:34:56.267 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-10-14T12:34:56.330 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=69e6799bf7284c98a43bdbc1a4d76279 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2023-10-14T12:34:56.332 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T12:34:56.344 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-14T12:34:56.356 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-14T12:34:56.356 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:56.357 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:56.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284100k,nr_inodes=4071025,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19461 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-14T12:34:56.379 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T12:34:56.379 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:56.436 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284100k,nr_inodes=4071025,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19461 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-14T12:34:56.437 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:56.438 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:56.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-14T12:34:56.463 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2023-10-14T12:34:56.463 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:34:56.523 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-14T12:34:56.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:56.525 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T12:34:56.542 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T12:34:56.543 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T12:34:56.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:56.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:34:56.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:56.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:34:56.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:56.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-14T12:34:56.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:56.813 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T12:34:56.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:56.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-14T12:34:56.899 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-10-14T12:34:56.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:34:56.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:56.902 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-10-14T12:34:56.923 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T12:34:56.923 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T12:34:56.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:56.924 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T12:34:57.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:57.006 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:34:57.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:57.102 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2023-10-14T12:34:57.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:57.204 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2023-10-14T12:34:57.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:34:57.221 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2023-10-14T12:34:57.291 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2023-10-14T12:34:57.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:34:57.293 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T12:34:57.304 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T12:34:57.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:34:57.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.428+0000 7f5afc1e7700 1 Processor -- start 2023-10-14T12:34:57.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.428+0000 7f5afc1e7700 1 -- start start 2023-10-14T12:34:57.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5afc1e7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5af4143de0 0x7f5af415b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5afc1e7700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5af40c5020 0x7f5af40c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5afc1e7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af415dec0 con 0x7f5af415e910 2023-10-14T12:34:57.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5afc1e7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af415e4f0 con 0x7f5af4143de0 2023-10-14T12:34:57.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5afc1e7700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af415edc0 con 0x7f5af40c5020 2023-10-14T12:34:57.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af9f83700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5af4143de0 0x7f5af415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af9782700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5af415e910 0x7f5af40cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55178/0 (socket says 172.21.15.72:55178) 2023-10-14T12:34:57.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af9782700 1 -- 172.21.15.72:0/153097095 learned_addr learned my addr 172.21.15.72:0/153097095 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:57.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5afa784700 1 --2- 172.21.15.72:0/153097095 >> v2:172.21.15.123:3300/0 conn(0x7f5af40c5020 0x7f5af40c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af9f83700 1 -- 172.21.15.72:0/153097095 >> v2:172.21.15.123:3300/0 conn(0x7f5af40c5020 msgr2=0x7f5af40c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:57.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af9f83700 1 --2- 172.21.15.72:0/153097095 >> v2:172.21.15.123:3300/0 conn(0x7f5af40c5020 0x7f5af40c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af9f83700 1 -- 172.21.15.72:0/153097095 >> v1:172.21.15.72:6789/0 conn(0x7f5af415e910 legacy=0x7f5af40cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af8f81700 1 -- 172.21.15.72:0/153097095 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417130692 0 0) 0x7f5af415dec0 con 0x7f5af415e910 2023-10-14T12:34:57.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af9f83700 1 -- 172.21.15.72:0/153097095 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40c5990 con 0x7f5af4143de0 2023-10-14T12:34:57.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af9f83700 1 --2- 172.21.15.72:0/153097095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 0x7f5af415b450 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5af406c310 tx=0x7f5af0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383e2c9212c85531 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.429+0000 7f5af8f81700 1 -- 172.21.15.72:0/153097095 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0011830 con 0x7f5af4143de0 2023-10-14T12:34:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5af8f81700 1 -- 172.21.15.72:0/153097095 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af0011990 con 0x7f5af4143de0 2023-10-14T12:34:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5af8f81700 1 -- 172.21.15.72:0/153097095 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0011d20 con 0x7f5af4143de0 2023-10-14T12:34:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5afc1e7700 1 -- 172.21.15.72:0/153097095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 msgr2=0x7f5af415b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5afc1e7700 1 --2- 172.21.15.72:0/153097095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 0x7f5af415b450 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5af406c310 tx=0x7f5af0009b20 comp rx=0 tx=0).stop 2023-10-14T12:34:57.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5afc1e7700 1 -- 172.21.15.72:0/153097095 shutdown_connections 2023-10-14T12:34:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5afc1e7700 1 --2- 172.21.15.72:0/153097095 >> v2:172.21.15.123:3300/0 conn(0x7f5af40c5020 0x7f5af40c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5afc1e7700 1 --2- 172.21.15.72:0/153097095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 0x7f5af415b450 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5afc1e7700 1 -- 172.21.15.72:0/153097095 >> 172.21.15.72:0/153097095 conn(0x7f5af406c850 msgr2=0x7f5af406cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5afc1e7700 1 -- 172.21.15.72:0/153097095 shutdown_connections 2023-10-14T12:34:57.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.430+0000 7f5afc1e7700 1 -- 172.21.15.72:0/153097095 wait complete. 2023-10-14T12:34:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.431+0000 7f5afc1e7700 1 Processor -- start 2023-10-14T12:34:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.431+0000 7f5afc1e7700 1 -- start start 2023-10-14T12:34:57.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5afc1e7700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5af40c5020 0x7f5af40c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5afc1e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 0x7f5af40b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5afc1e7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5af415e910 0x7f5af40a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5afc1e7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b4230 con 0x7f5af4143de0 2023-10-14T12:34:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5afc1e7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b3620 con 0x7f5af415e910 2023-10-14T12:34:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5afc1e7700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40b3900 con 0x7f5af40c5020 2023-10-14T12:34:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5af9782700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 0x7f5af40b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5af9782700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 0x7f5af40b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48884/0 (socket says 172.21.15.72:48884) 2023-10-14T12:34:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5af9782700 1 -- 172.21.15.72:0/464122975 learned_addr learned my addr 172.21.15.72:0/464122975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5afa784700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5af415e910 0x7f5af40a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5af9782700 1 -- 172.21.15.72:0/464122975 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5af40c5020 msgr2=0x7f5af40c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5af9782700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5af40c5020 0x7f5af40c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5af9782700 1 -- 172.21.15.72:0/464122975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5af415e910 msgr2=0x7f5af40a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5af9782700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5af415e910 0x7f5af40a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.432+0000 7f5af9782700 1 -- 172.21.15.72:0/464122975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af00094a0 con 0x7f5af4143de0 2023-10-14T12:34:57.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.433+0000 7f5af9782700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 0x7f5af40b46c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40011e0 tx=0x7f5ae400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:57.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.433+0000 7f5aea7fc700 1 -- 172.21.15.72:0/464122975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4004c80 con 0x7f5af4143de0 2023-10-14T12:34:57.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.433+0000 7f5aea7fc700 1 -- 172.21.15.72:0/464122975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4004e00 con 0x7f5af4143de0 2023-10-14T12:34:57.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.433+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af40b3be0 con 0x7f5af4143de0 2023-10-14T12:34:57.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.433+0000 7f5aea7fc700 1 -- 172.21.15.72:0/464122975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4007310 con 0x7f5af4143de0 2023-10-14T12:34:57.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.433+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af40b3280 con 0x7f5af4143de0 2023-10-14T12:34:57.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.434+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af404f400 con 0x7f5af4143de0 2023-10-14T12:34:57.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.434+0000 7f5aea7fc700 1 -- 172.21.15.72:0/464122975 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5ae4007470 con 0x7f5af4143de0 2023-10-14T12:34:57.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.434+0000 7f5aea7fc700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5ad806af00 0x7f5ad806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.434+0000 7f5aea7fc700 1 -- 172.21.15.72:0/464122975 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5ae4089450 con 0x7f5af4143de0 2023-10-14T12:34:57.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.434+0000 7f5af9f83700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5ad806af00 0x7f5ad806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.435+0000 7f5af9f83700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5ad806af00 0x7f5ad806d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5af00090b0 tx=0x7f5af0010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:57.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.439+0000 7f5aea7fc700 1 -- 172.21.15.72:0/464122975 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ae4054430 con 0x7f5af4143de0 2023-10-14T12:34:57.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.625+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5af40ce8c0 con 0x7f5ad806af00 2023-10-14T12:34:57.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.633+0000 7f5aea7fc700 1 -- 172.21.15.72:0/464122975 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288747 (secure 0 0 0) 0x7f5af001f070 con 0x7f5ad806af00 2023-10-14T12:34:57.639 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:57.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5ad806af00 msgr2=0x7f5ad806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5ad806af00 0x7f5ad806d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5af00090b0 tx=0x7f5af0010000 comp rx=0 tx=0).stop 2023-10-14T12:34:57.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 msgr2=0x7f5af40b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 0x7f5af40b46c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40011e0 tx=0x7f5ae400cae0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 shutdown_connections 2023-10-14T12:34:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5ad806af00 0x7f5ad806d3c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5af415e910 0x7f5af40a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5af40c5020 0x7f5af40c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 --2- 172.21.15.72:0/464122975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5af4143de0 0x7f5af40b46c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 >> 172.21.15.72:0/464122975 conn(0x7f5af406c850 msgr2=0x7f5af4071870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:57.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 shutdown_connections 2023-10-14T12:34:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.636+0000 7f5afc1e7700 1 -- 172.21.15.72:0/464122975 wait complete. 2023-10-14T12:34:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:34:57.650 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-14T12:34:57.402496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220856,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753864,"statfs":{"total":773094113280,"available":772867956736,"internally_reserved":0,"allocated":4759552,"data_stored":2699604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.640399"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836180+0000","last_change":"2023-10-14T12:34:44.773258+0000","last_active":"2023-10-14T12:34:45.836180+0000","last_peered":"2023-10-14T12:34:45.836180+0000","last_clean":"2023-10-14T12:34:45.836180+0000","last_became_active":"2023-10-14T12:34:44.772874+0000","last_became_peered":"2023-10-14T12:34:44.772874+0000","last_unstale":"2023-10-14T12:34:45.836180+0000","last_undegraded":"2023-10-14T12:34:45.836180+0000","last_fullsized":"2023-10-14T12:34:45.836180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835866+0000","last_change":"2023-10-14T12:34:44.766065+0000","last_active":"2023-10-14T12:34:45.835866+0000","last_peered":"2023-10-14T12:34:45.835866+0000","last_clean":"2023-10-14T12:34:45.835866+0000","last_became_active":"2023-10-14T12:34:44.765783+0000","last_became_peered":"2023-10-14T12:34:44.765783+0000","last_unstale":"2023-10-14T12:34:45.835866+0000","last_undegraded":"2023-10-14T12:34:45.835866+0000","last_fullsized":"2023-10-14T12:34:45.835866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836798+0000","last_change":"2023-10-14T12:34:44.766216+0000","last_active":"2023-10-14T12:34:45.836798+0000","last_peered":"2023-10-14T12:34:45.836798+0000","last_clean":"2023-10-14T12:34:45.836798+0000","last_became_active":"2023-10-14T12:34:44.765915+0000","last_became_peered":"2023-10-14T12:34:44.765915+0000","last_unstale":"2023-10-14T12:34:45.836798+0000","last_undegraded":"2023-10-14T12:34:45.836798+0000","last_fullsized":"2023-10-14T12:34:45.836798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835634+0000","last_change":"2023-10-14T12:34:44.776783+0000","last_active":"2023-10-14T12:34:45.835634+0000","last_peered":"2023-10-14T12:34:45.835634+0000","last_clean":"2023-10-14T12:34:45.835634+0000","last_became_active":"2023-10-14T12:34:44.776527+0000","last_became_peered":"2023-10-14T12:34:44.776527+0000","last_unstale":"2023-10-14T12:34:45.835634+0000","last_undegraded":"2023-10-14T12:34:45.835634+0000","last_fullsized":"2023-10-14T12:34:45.835634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:10.476396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835368+0000","last_change":"2023-10-14T12:34:44.774798+0000","last_active":"2023-10-14T12:34:45.835368+0000","last_peered":"2023-10-14T12:34:45.835368+0000","last_clean":"2023-10-14T12:34:45.835368+0000","last_became_active":"2023-10-14T12:34:44.774508+0000","last_became_peered":"2023-10-14T12:34:44.774508+0000","last_unstale":"2023-10-14T12:34:45.835368+0000","last_undegraded":"2023-10-14T12:34:45.835368+0000","last_fullsized":"2023-10-14T12:34:45.835368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.842813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835002+0000","last_change":"2023-10-14T12:34:44.771286+0000","last_active":"2023-10-14T12:34:45.835002+0000","last_peered":"2023-10-14T12:34:45.835002+0000","last_clean":"2023-10-14T12:34:45.835002+0000","last_became_active":"2023-10-14T12:34:44.768717+0000","last_became_peered":"2023-10-14T12:34:44.768717+0000","last_unstale":"2023-10-14T12:34:45.835002+0000","last_undegraded":"2023-10-14T12:34:45.835002+0000","last_fullsized":"2023-10-14T12:34:45.835002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764118+0000","last_change":"2023-10-14T12:34:44.771173+0000","last_active":"2023-10-14T12:34:45.764118+0000","last_peered":"2023-10-14T12:34:45.764118+0000","last_clean":"2023-10-14T12:34:45.764118+0000","last_became_active":"2023-10-14T12:34:44.770869+0000","last_became_peered":"2023-10-14T12:34:44.770869+0000","last_unstale":"2023-10-14T12:34:45.764118+0000","last_undegraded":"2023-10-14T12:34:45.764118+0000","last_fullsized":"2023-10-14T12:34:45.764118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835912+0000","last_change":"2023-10-14T12:34:44.766306+0000","last_active":"2023-10-14T12:34:45.835912+0000","last_peered":"2023-10-14T12:34:45.835912+0000","last_clean":"2023-10-14T12:34:45.835912+0000","last_became_active":"2023-10-14T12:34:44.765917+0000","last_became_peered":"2023-10-14T12:34:44.765917+0000","last_unstale":"2023-10-14T12:34:45.835912+0000","last_undegraded":"2023-10-14T12:34:45.835912+0000","last_fullsized":"2023-10-14T12:34:45.835912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836985+0000","last_change":"2023-10-14T12:34:44.769040+0000","last_active":"2023-10-14T12:34:45.836985+0000","last_peered":"2023-10-14T12:34:45.836985+0000","last_clean":"2023-10-14T12:34:45.836985+0000","last_became_active":"2023-10-14T12:34:44.768514+0000","last_became_peered":"2023-10-14T12:34:44.768514+0000","last_unstale":"2023-10-14T12:34:45.836985+0000","last_undegraded":"2023-10-14T12:34:45.836985+0000","last_fullsized":"2023-10-14T12:34:45.836985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765522+0000","last_change":"2023-10-14T12:34:44.764554+0000","last_active":"2023-10-14T12:34:45.765522+0000","last_peered":"2023-10-14T12:34:45.765522+0000","last_clean":"2023-10-14T12:34:45.765522+0000","last_became_active":"2023-10-14T12:34:44.764252+0000","last_became_peered":"2023-10-14T12:34:44.764252+0000","last_unstale":"2023-10-14T12:34:45.765522+0000","last_undegraded":"2023-10-14T12:34:45.765522+0000","last_fullsized":"2023-10-14T12:34:45.765522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:36.689643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764651+0000","last_change":"2023-10-14T12:34:44.776394+0000","last_active":"2023-10-14T12:34:45.764651+0000","last_peered":"2023-10-14T12:34:45.764651+0000","last_clean":"2023-10-14T12:34:45.764651+0000","last_became_active":"2023-10-14T12:34:44.775897+0000","last_became_peered":"2023-10-14T12:34:44.775897+0000","last_unstale":"2023-10-14T12:34:45.764651+0000","last_undegraded":"2023-10-14T12:34:45.764651+0000","last_fullsized":"2023-10-14T12:34:45.764651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836748+0000","last_change":"2023-10-14T12:34:44.766520+0000","last_active":"2023-10-14T12:34:45.836748+0000","last_peered":"2023-10-14T12:34:45.836748+0000","last_clean":"2023-10-14T12:34:45.836748+0000","last_became_active":"2023-10-14T12:34:44.766208+0000","last_became_peered":"2023-10-14T12:34:44.766208+0000","last_unstale":"2023-10-14T12:34:45.836748+0000","last_undegraded":"2023-10-14T12:34:45.836748+0000","last_fullsized":"2023-10-14T12:34:45.836748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764453+0000","last_change":"2023-10-14T12:34:44.767161+0000","last_active":"2023-10-14T12:34:45.764453+0000","last_peered":"2023-10-14T12:34:45.764453+0000","last_clean":"2023-10-14T12:34:45.764453+0000","last_became_active":"2023-10-14T12:34:44.766602+0000","last_became_peered":"2023-10-14T12:34:44.766602+0000","last_unstale":"2023-10-14T12:34:45.764453+0000","last_undegraded":"2023-10-14T12:34:45.764453+0000","last_fullsized":"2023-10-14T12:34:45.764453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765845+0000","last_change":"2023-10-14T12:34:44.770652+0000","last_active":"2023-10-14T12:34:45.765845+0000","last_peered":"2023-10-14T12:34:45.765845+0000","last_clean":"2023-10-14T12:34:45.765845+0000","last_became_active":"2023-10-14T12:34:44.770368+0000","last_became_peered":"2023-10-14T12:34:44.770368+0000","last_unstale":"2023-10-14T12:34:45.765845+0000","last_undegraded":"2023-10-14T12:34:45.765845+0000","last_fullsized":"2023-10-14T12:34:45.765845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.763799+0000","last_change":"2023-10-14T12:34:44.764695+0000","last_active":"2023-10-14T12:34:45.763799+0000","last_peered":"2023-10-14T12:34:45.763799+0000","last_clean":"2023-10-14T12:34:45.763799+0000","last_became_active":"2023-10-14T12:34:44.763083+0000","last_became_peered":"2023-10-14T12:34:44.763083+0000","last_unstale":"2023-10-14T12:34:45.763799+0000","last_undegraded":"2023-10-14T12:34:45.763799+0000","last_fullsized":"2023-10-14T12:34:45.763799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765533+0000","last_change":"2023-10-14T12:34:44.768707+0000","last_active":"2023-10-14T12:34:45.765533+0000","last_peered":"2023-10-14T12:34:45.765533+0000","last_clean":"2023-10-14T12:34:45.765533+0000","last_became_active":"2023-10-14T12:34:44.768474+0000","last_became_peered":"2023-10-14T12:34:44.768474+0000","last_unstale":"2023-10-14T12:34:45.765533+0000","last_undegraded":"2023-10-14T12:34:45.765533+0000","last_fullsized":"2023-10-14T12:34:45.765533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765794+0000","last_change":"2023-10-14T12:34:44.771432+0000","last_active":"2023-10-14T12:34:45.765794+0000","last_peered":"2023-10-14T12:34:45.765794+0000","last_clean":"2023-10-14T12:34:45.765794+0000","last_became_active":"2023-10-14T12:34:44.771158+0000","last_became_peered":"2023-10-14T12:34:44.771158+0000","last_unstale":"2023-10-14T12:34:45.765794+0000","last_undegraded":"2023-10-14T12:34:45.765794+0000","last_fullsized":"2023-10-14T12:34:45.765794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835519+0000","last_change":"2023-10-14T12:34:44.776578+0000","last_active":"2023-10-14T12:34:45.835519+0000","last_peered":"2023-10-14T12:34:45.835519+0000","last_clean":"2023-10-14T12:34:45.835519+0000","last_became_active":"2023-10-14T12:34:44.776263+0000","last_became_peered":"2023-10-14T12:34:44.776263+0000","last_unstale":"2023-10-14T12:34:45.835519+0000","last_undegraded":"2023-10-14T12:34:45.835519+0000","last_fullsized":"2023-10-14T12:34:45.835519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835662+0000","last_change":"2023-10-14T12:34:44.767374+0000","last_active":"2023-10-14T12:34:45.835662+0000","last_peered":"2023-10-14T12:34:45.835662+0000","last_clean":"2023-10-14T12:34:45.835662+0000","last_became_active":"2023-10-14T12:34:44.767035+0000","last_became_peered":"2023-10-14T12:34:44.767035+0000","last_unstale":"2023-10-14T12:34:45.835662+0000","last_undegraded":"2023-10-14T12:34:45.835662+0000","last_fullsized":"2023-10-14T12:34:45.835662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:06.799411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835300+0000","last_change":"2023-10-14T12:34:44.775911+0000","last_active":"2023-10-14T12:34:45.835300+0000","last_peered":"2023-10-14T12:34:45.835300+0000","last_clean":"2023-10-14T12:34:45.835300+0000","last_became_active":"2023-10-14T12:34:44.775453+0000","last_became_peered":"2023-10-14T12:34:44.775453+0000","last_unstale":"2023-10-14T12:34:45.835300+0000","last_undegraded":"2023-10-14T12:34:45.835300+0000","last_fullsized":"2023-10-14T12:34:45.835300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:37.110615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764577+0000","last_change":"2023-10-14T12:34:44.766571+0000","last_active":"2023-10-14T12:34:45.764577+0000","last_peered":"2023-10-14T12:34:45.764577+0000","last_clean":"2023-10-14T12:34:45.764577+0000","last_became_active":"2023-10-14T12:34:44.766299+0000","last_became_peered":"2023-10-14T12:34:44.766299+0000","last_unstale":"2023-10-14T12:34:45.764577+0000","last_undegraded":"2023-10-14T12:34:45.764577+0000","last_fullsized":"2023-10-14T12:34:45.764577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765865+0000","last_change":"2023-10-14T12:34:44.770392+0000","last_active":"2023-10-14T12:34:45.765865+0000","last_peered":"2023-10-14T12:34:45.765865+0000","last_clean":"2023-10-14T12:34:45.765865+0000","last_became_active":"2023-10-14T12:34:44.770033+0000","last_became_peered":"2023-10-14T12:34:44.770033+0000","last_unstale":"2023-10-14T12:34:45.765865+0000","last_undegraded":"2023-10-14T12:34:45.765865+0000","last_fullsized":"2023-10-14T12:34:45.765865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765576+0000","last_change":"2023-10-14T12:34:44.768259+0000","last_active":"2023-10-14T12:34:45.765576+0000","last_peered":"2023-10-14T12:34:45.765576+0000","last_clean":"2023-10-14T12:34:45.765576+0000","last_became_active":"2023-10-14T12:34:44.767967+0000","last_became_peered":"2023-10-14T12:34:44.767967+0000","last_unstale":"2023-10-14T12:34:45.765576+0000","last_undegraded":"2023-10-14T12:34:45.765576+0000","last_fullsized":"2023-10-14T12:34:45.765576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835233+0000","last_change":"2023-10-14T12:34:44.770347+0000","last_active":"2023-10-14T12:34:45.835233+0000","last_peered":"2023-10-14T12:34:45.835233+0000","last_clean":"2023-10-14T12:34:45.835233+0000","last_became_active":"2023-10-14T12:34:44.768304+0000","last_became_peered":"2023-10-14T12:34:44.768304+0000","last_unstale":"2023-10-14T12:34:45.835233+0000","last_undegraded":"2023-10-14T12:34:45.835233+0000","last_fullsized":"2023-10-14T12:34:45.835233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:27:07.068125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835441+0000","last_change":"2023-10-14T12:34:44.764335+0000","last_active":"2023-10-14T12:34:45.835441+0000","last_peered":"2023-10-14T12:34:45.835441+0000","last_clean":"2023-10-14T12:34:45.835441+0000","last_became_active":"2023-10-14T12:34:44.764072+0000","last_became_peered":"2023-10-14T12:34:44.764072+0000","last_unstale":"2023-10-14T12:34:45.835441+0000","last_undegraded":"2023-10-14T12:34:45.835441+0000","last_fullsized":"2023-10-14T12:34:45.835441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835405+0000","last_change":"2023-10-14T12:34:44.768012+0000","last_active":"2023-10-14T12:34:45.835405+0000","last_peered":"2023-10-14T12:34:45.835405+0000","last_clean":"2023-10-14T12:34:45.835405+0000","last_became_active":"2023-10-14T12:34:44.767743+0000","last_became_peered":"2023-10-14T12:34:44.767743+0000","last_unstale":"2023-10-14T12:34:45.835405+0000","last_undegraded":"2023-10-14T12:34:45.835405+0000","last_fullsized":"2023-10-14T12:34:45.835405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835418+0000","last_change":"2023-10-14T12:34:44.766816+0000","last_active":"2023-10-14T12:34:45.835418+0000","last_peered":"2023-10-14T12:34:45.835418+0000","last_clean":"2023-10-14T12:34:45.835418+0000","last_became_active":"2023-10-14T12:34:44.766309+0000","last_became_peered":"2023-10-14T12:34:44.766309+0000","last_unstale":"2023-10-14T12:34:45.835418+0000","last_undegraded":"2023-10-14T12:34:45.835418+0000","last_fullsized":"2023-10-14T12:34:45.835418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764364+0000","last_change":"2023-10-14T12:34:44.766262+0000","last_active":"2023-10-14T12:34:45.764364+0000","last_peered":"2023-10-14T12:34:45.764364+0000","last_clean":"2023-10-14T12:34:45.764364+0000","last_became_active":"2023-10-14T12:34:44.765904+0000","last_became_peered":"2023-10-14T12:34:44.765904+0000","last_unstale":"2023-10-14T12:34:45.764364+0000","last_undegraded":"2023-10-14T12:34:45.764364+0000","last_fullsized":"2023-10-14T12:34:45.764364+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835345+0000","last_change":"2023-10-14T12:34:44.764983+0000","last_active":"2023-10-14T12:34:45.835345+0000","last_peered":"2023-10-14T12:34:45.835345+0000","last_clean":"2023-10-14T12:34:45.835345+0000","last_became_active":"2023-10-14T12:34:44.764719+0000","last_became_peered":"2023-10-14T12:34:44.764719+0000","last_unstale":"2023-10-14T12:34:45.835345+0000","last_undegraded":"2023-10-14T12:34:45.835345+0000","last_fullsized":"2023-10-14T12:34:45.835345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835251+0000","last_change":"2023-10-14T12:34:44.769030+0000","last_active":"2023-10-14T12:34:45.835251+0000","last_peered":"2023-10-14T12:34:45.835251+0000","last_clean":"2023-10-14T12:34:45.835251+0000","last_became_active":"2023-10-14T12:34:44.768729+0000","last_became_peered":"2023-10-14T12:34:44.768729+0000","last_unstale":"2023-10-14T12:34:45.835251+0000","last_undegraded":"2023-10-14T12:34:45.835251+0000","last_fullsized":"2023-10-14T12:34:45.835251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:36.593887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765428+0000","last_change":"2023-10-14T12:34:44.768972+0000","last_active":"2023-10-14T12:34:45.765428+0000","last_peered":"2023-10-14T12:34:45.765428+0000","last_clean":"2023-10-14T12:34:45.765428+0000","last_became_active":"2023-10-14T12:34:44.768243+0000","last_became_peered":"2023-10-14T12:34:44.768243+0000","last_unstale":"2023-10-14T12:34:45.765428+0000","last_undegraded":"2023-10-14T12:34:45.765428+0000","last_fullsized":"2023-10-14T12:34:45.765428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835003+0000","last_change":"2023-10-14T12:34:44.768827+0000","last_active":"2023-10-14T12:34:45.835003+0000","last_peered":"2023-10-14T12:34:45.835003+0000","last_clean":"2023-10-14T12:34:45.835003+0000","last_became_active":"2023-10-14T12:34:44.768423+0000","last_became_peered":"2023-10-14T12:34:44.768423+0000","last_unstale":"2023-10-14T12:34:45.835003+0000","last_undegraded":"2023-10-14T12:34:45.835003+0000","last_fullsized":"2023-10-14T12:34:45.835003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765078+0000","last_change":"2023-10-14T12:34:44.771115+0000","last_active":"2023-10-14T12:34:45.765078+0000","last_peered":"2023-10-14T12:34:45.765078+0000","last_clean":"2023-10-14T12:34:45.765078+0000","last_became_active":"2023-10-14T12:34:44.770846+0000","last_became_peered":"2023-10-14T12:34:44.770846+0000","last_unstale":"2023-10-14T12:34:45.765078+0000","last_undegraded":"2023-10-14T12:34:45.765078+0000","last_fullsized":"2023-10-14T12:34:45.765078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:18.644528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775649+0000","last_change":"2023-10-14T12:34:43.742439+0000","last_active":"2023-10-14T12:34:44.775649+0000","last_peered":"2023-10-14T12:34:44.775649+0000","last_clean":"2023-10-14T12:34:44.775649+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:34:44.775649+0000","last_undegraded":"2023-10-14T12:34:44.775649+0000","last_fullsized":"2023-10-14T12:34:44.775649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835738+0000","last_change":"2023-10-14T12:34:44.772445+0000","last_active":"2023-10-14T12:34:45.835738+0000","last_peered":"2023-10-14T12:34:45.835738+0000","last_clean":"2023-10-14T12:34:45.835738+0000","last_became_active":"2023-10-14T12:34:44.772093+0000","last_became_peered":"2023-10-14T12:34:44.772093+0000","last_unstale":"2023-10-14T12:34:45.835738+0000","last_undegraded":"2023-10-14T12:34:45.835738+0000","last_fullsized":"2023-10-14T12:34:45.835738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773796+0000","last_change":"2023-10-14T12:34:43.740875+0000","last_active":"2023-10-14T12:34:44.773796+0000","last_peered":"2023-10-14T12:34:44.773796+0000","last_clean":"2023-10-14T12:34:44.773796+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:34:44.773796+0000","last_undegraded":"2023-10-14T12:34:44.773796+0000","last_fullsized":"2023-10-14T12:34:44.773796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765494+0000","last_change":"2023-10-14T12:34:44.775914+0000","last_active":"2023-10-14T12:34:45.765494+0000","last_peered":"2023-10-14T12:34:45.765494+0000","last_clean":"2023-10-14T12:34:45.765494+0000","last_became_active":"2023-10-14T12:34:44.775648+0000","last_became_peered":"2023-10-14T12:34:44.775648+0000","last_unstale":"2023-10-14T12:34:45.765494+0000","last_undegraded":"2023-10-14T12:34:45.765494+0000","last_fullsized":"2023-10-14T12:34:45.765494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.774951+0000","last_change":"2023-10-14T12:34:43.737909+0000","last_active":"2023-10-14T12:34:44.774951+0000","last_peered":"2023-10-14T12:34:44.774951+0000","last_clean":"2023-10-14T12:34:44.774951+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:34:44.774951+0000","last_undegraded":"2023-10-14T12:34:44.774951+0000","last_fullsized":"2023-10-14T12:34:44.774951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:21.264726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836154+0000","last_change":"2023-10-14T12:34:44.765349+0000","last_active":"2023-10-14T12:34:45.836154+0000","last_peered":"2023-10-14T12:34:45.836154+0000","last_clean":"2023-10-14T12:34:45.836154+0000","last_became_active":"2023-10-14T12:34:44.765043+0000","last_became_peered":"2023-10-14T12:34:44.765043+0000","last_unstale":"2023-10-14T12:34:45.836154+0000","last_undegraded":"2023-10-14T12:34:45.836154+0000","last_fullsized":"2023-10-14T12:34:45.836154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775771+0000","last_change":"2023-10-14T12:34:43.738060+0000","last_active":"2023-10-14T12:34:44.775771+0000","last_peered":"2023-10-14T12:34:44.775771+0000","last_clean":"2023-10-14T12:34:44.775771+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:34:44.775771+0000","last_undegraded":"2023-10-14T12:34:44.775771+0000","last_fullsized":"2023-10-14T12:34:44.775771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836764+0000","last_change":"2023-10-14T12:34:44.763674+0000","last_active":"2023-10-14T12:34:45.836764+0000","last_peered":"2023-10-14T12:34:45.836764+0000","last_clean":"2023-10-14T12:34:45.836764+0000","last_became_active":"2023-10-14T12:34:44.763356+0000","last_became_peered":"2023-10-14T12:34:44.763356+0000","last_unstale":"2023-10-14T12:34:45.836764+0000","last_undegraded":"2023-10-14T12:34:45.836764+0000","last_fullsized":"2023-10-14T12:34:45.836764+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.772744+0000","last_change":"2023-10-14T12:34:43.738857+0000","last_active":"2023-10-14T12:34:44.772744+0000","last_peered":"2023-10-14T12:34:44.772744+0000","last_clean":"2023-10-14T12:34:44.772744+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:34:44.772744+0000","last_undegraded":"2023-10-14T12:34:44.772744+0000","last_fullsized":"2023-10-14T12:34:44.772744+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:47.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764009+0000","last_change":"2023-10-14T12:34:44.767242+0000","last_active":"2023-10-14T12:34:45.764009+0000","last_peered":"2023-10-14T12:34:45.764009+0000","last_clean":"2023-10-14T12:34:45.764009+0000","last_became_active":"2023-10-14T12:34:44.766961+0000","last_became_peered":"2023-10-14T12:34:44.766961+0000","last_unstale":"2023-10-14T12:34:45.764009+0000","last_undegraded":"2023-10-14T12:34:45.764009+0000","last_fullsized":"2023-10-14T12:34:45.764009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775710+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:44.775710+0000","last_peered":"2023-10-14T12:34:44.775710+0000","last_clean":"2023-10-14T12:34:44.775710+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:44.775710+0000","last_undegraded":"2023-10-14T12:34:44.775710+0000","last_fullsized":"2023-10-14T12:34:44.775710+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765983+0000","last_change":"2023-10-14T12:34:44.770562+0000","last_active":"2023-10-14T12:34:45.765983+0000","last_peered":"2023-10-14T12:34:45.765983+0000","last_clean":"2023-10-14T12:34:45.765983+0000","last_became_active":"2023-10-14T12:34:44.770030+0000","last_became_peered":"2023-10-14T12:34:44.770030+0000","last_unstale":"2023-10-14T12:34:45.765983+0000","last_undegraded":"2023-10-14T12:34:45.765983+0000","last_fullsized":"2023-10-14T12:34:45.765983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757619+0000","last_change":"2023-10-14T12:34:43.738248+0000","last_active":"2023-10-14T12:34:44.757619+0000","last_peered":"2023-10-14T12:34:44.757619+0000","last_clean":"2023-10-14T12:34:44.757619+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:34:44.757619+0000","last_undegraded":"2023-10-14T12:34:44.757619+0000","last_fullsized":"2023-10-14T12:34:44.757619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836002+0000","last_change":"2023-10-14T12:34:44.762002+0000","last_active":"2023-10-14T12:34:45.836002+0000","last_peered":"2023-10-14T12:34:45.836002+0000","last_clean":"2023-10-14T12:34:45.836002+0000","last_became_active":"2023-10-14T12:34:44.761308+0000","last_became_peered":"2023-10-14T12:34:44.761308+0000","last_unstale":"2023-10-14T12:34:45.836002+0000","last_undegraded":"2023-10-14T12:34:45.836002+0000","last_fullsized":"2023-10-14T12:34:45.836002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.754851+0000","last_change":"2023-10-14T12:34:43.737450+0000","last_active":"2023-10-14T12:34:44.754851+0000","last_peered":"2023-10-14T12:34:44.754851+0000","last_clean":"2023-10-14T12:34:44.754851+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:34:44.754851+0000","last_undegraded":"2023-10-14T12:34:44.754851+0000","last_fullsized":"2023-10-14T12:34:44.754851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:27.820010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835759+0000","last_change":"2023-10-14T12:34:44.776821+0000","last_active":"2023-10-14T12:34:45.835759+0000","last_peered":"2023-10-14T12:34:45.835759+0000","last_clean":"2023-10-14T12:34:45.835759+0000","last_became_active":"2023-10-14T12:34:44.776592+0000","last_became_peered":"2023-10-14T12:34:44.776592+0000","last_unstale":"2023-10-14T12:34:45.835759+0000","last_undegraded":"2023-10-14T12:34:45.835759+0000","last_fullsized":"2023-10-14T12:34:45.835759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:31.333285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.753775+0000","last_change":"2023-10-14T12:34:43.733989+0000","last_active":"2023-10-14T12:34:44.753775+0000","last_peered":"2023-10-14T12:34:44.753775+0000","last_clean":"2023-10-14T12:34:44.753775+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:34:44.753775+0000","last_undegraded":"2023-10-14T12:34:44.753775+0000","last_fullsized":"2023-10-14T12:34:44.753775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:52.723651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765232+0000","last_change":"2023-10-14T12:34:44.763705+0000","last_active":"2023-10-14T12:34:45.765232+0000","last_peered":"2023-10-14T12:34:45.765232+0000","last_clean":"2023-10-14T12:34:45.765232+0000","last_became_active":"2023-10-14T12:34:44.763408+0000","last_became_peered":"2023-10-14T12:34:44.763408+0000","last_unstale":"2023-10-14T12:34:45.765232+0000","last_undegraded":"2023-10-14T12:34:45.765232+0000","last_fullsized":"2023-10-14T12:34:45.765232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:02.756175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750731+0000","last_change":"2023-10-14T12:34:43.734905+0000","last_active":"2023-10-14T12:34:44.750731+0000","last_peered":"2023-10-14T12:34:44.750731+0000","last_clean":"2023-10-14T12:34:44.750731+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:34:44.750731+0000","last_undegraded":"2023-10-14T12:34:44.750731+0000","last_fullsized":"2023-10-14T12:34:44.750731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836842+0000","last_change":"2023-10-14T12:34:44.764740+0000","last_active":"2023-10-14T12:34:45.836842+0000","last_peered":"2023-10-14T12:34:45.836842+0000","last_clean":"2023-10-14T12:34:45.836842+0000","last_became_active":"2023-10-14T12:34:44.764455+0000","last_became_peered":"2023-10-14T12:34:44.764455+0000","last_unstale":"2023-10-14T12:34:45.836842+0000","last_undegraded":"2023-10-14T12:34:45.836842+0000","last_fullsized":"2023-10-14T12:34:45.836842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779891+0000","last_change":"2023-10-14T12:34:43.735967+0000","last_active":"2023-10-14T12:34:44.779891+0000","last_peered":"2023-10-14T12:34:44.779891+0000","last_clean":"2023-10-14T12:34:44.779891+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:34:44.779891+0000","last_undegraded":"2023-10-14T12:34:44.779891+0000","last_fullsized":"2023-10-14T12:34:44.779891+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765386+0000","last_change":"2023-10-14T12:34:44.774548+0000","last_active":"2023-10-14T12:34:45.765386+0000","last_peered":"2023-10-14T12:34:45.765386+0000","last_clean":"2023-10-14T12:34:45.765386+0000","last_became_active":"2023-10-14T12:34:44.774253+0000","last_became_peered":"2023-10-14T12:34:44.774253+0000","last_unstale":"2023-10-14T12:34:45.765386+0000","last_undegraded":"2023-10-14T12:34:45.765386+0000","last_fullsized":"2023-10-14T12:34:45.765386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779429+0000","last_change":"2023-10-14T12:34:43.741443+0000","last_active":"2023-10-14T12:34:44.779429+0000","last_peered":"2023-10-14T12:34:44.779429+0000","last_clean":"2023-10-14T12:34:44.779429+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:34:44.779429+0000","last_undegraded":"2023-10-14T12:34:44.779429+0000","last_fullsized":"2023-10-14T12:34:44.779429+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:17.642741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836528+0000","last_change":"2023-10-14T12:34:44.766187+0000","last_active":"2023-10-14T12:34:45.836528+0000","last_peered":"2023-10-14T12:34:45.836528+0000","last_clean":"2023-10-14T12:34:45.836528+0000","last_became_active":"2023-10-14T12:34:44.765932+0000","last_became_peered":"2023-10-14T12:34:44.765932+0000","last_unstale":"2023-10-14T12:34:45.836528+0000","last_undegraded":"2023-10-14T12:34:45.836528+0000","last_fullsized":"2023-10-14T12:34:45.836528+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773813+0000","last_change":"2023-10-14T12:34:43.738642+0000","last_active":"2023-10-14T12:34:44.773813+0000","last_peered":"2023-10-14T12:34:44.773813+0000","last_clean":"2023-10-14T12:34:44.773813+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:34:44.773813+0000","last_undegraded":"2023-10-14T12:34:44.773813+0000","last_fullsized":"2023-10-14T12:34:44.773813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835518+0000","last_change":"2023-10-14T12:34:44.773042+0000","last_active":"2023-10-14T12:34:45.835518+0000","last_peered":"2023-10-14T12:34:45.835518+0000","last_clean":"2023-10-14T12:34:45.835518+0000","last_became_active":"2023-10-14T12:34:44.772662+0000","last_became_peered":"2023-10-14T12:34:44.772662+0000","last_unstale":"2023-10-14T12:34:45.835518+0000","last_undegraded":"2023-10-14T12:34:45.835518+0000","last_fullsized":"2023-10-14T12:34:45.835518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758499+0000","last_change":"2023-10-14T12:34:43.738291+0000","last_active":"2023-10-14T12:34:44.758499+0000","last_peered":"2023-10-14T12:34:44.758499+0000","last_clean":"2023-10-14T12:34:44.758499+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:34:44.758499+0000","last_undegraded":"2023-10-14T12:34:44.758499+0000","last_fullsized":"2023-10-14T12:34:44.758499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:28.347591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764881+0000","last_change":"2023-10-14T12:34:44.761488+0000","last_active":"2023-10-14T12:34:45.764881+0000","last_peered":"2023-10-14T12:34:45.764881+0000","last_clean":"2023-10-14T12:34:45.764881+0000","last_became_active":"2023-10-14T12:34:44.761153+0000","last_became_peered":"2023-10-14T12:34:44.761153+0000","last_unstale":"2023-10-14T12:34:45.764881+0000","last_undegraded":"2023-10-14T12:34:45.764881+0000","last_fullsized":"2023-10-14T12:34:45.764881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.755992+0000","last_change":"2023-10-14T12:34:43.742416+0000","last_active":"2023-10-14T12:34:44.755992+0000","last_peered":"2023-10-14T12:34:44.755992+0000","last_clean":"2023-10-14T12:34:44.755992+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:34:44.755992+0000","last_undegraded":"2023-10-14T12:34:44.755992+0000","last_fullsized":"2023-10-14T12:34:44.755992+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835631+0000","last_change":"2023-10-14T12:34:44.762671+0000","last_active":"2023-10-14T12:34:45.835631+0000","last_peered":"2023-10-14T12:34:45.835631+0000","last_clean":"2023-10-14T12:34:45.835631+0000","last_became_active":"2023-10-14T12:34:44.762396+0000","last_became_peered":"2023-10-14T12:34:44.762396+0000","last_unstale":"2023-10-14T12:34:45.835631+0000","last_undegraded":"2023-10-14T12:34:45.835631+0000","last_fullsized":"2023-10-14T12:34:45.835631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.777137+0000","last_change":"2023-10-14T12:34:43.745867+0000","last_active":"2023-10-14T12:34:44.777137+0000","last_peered":"2023-10-14T12:34:44.777137+0000","last_clean":"2023-10-14T12:34:44.777137+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:34:44.777137+0000","last_undegraded":"2023-10-14T12:34:44.777137+0000","last_fullsized":"2023-10-14T12:34:44.777137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835643+0000","last_change":"2023-10-14T12:34:44.761814+0000","last_active":"2023-10-14T12:34:45.835643+0000","last_peered":"2023-10-14T12:34:45.835643+0000","last_clean":"2023-10-14T12:34:45.835643+0000","last_became_active":"2023-10-14T12:34:44.761558+0000","last_became_peered":"2023-10-14T12:34:44.761558+0000","last_unstale":"2023-10-14T12:34:45.835643+0000","last_undegraded":"2023-10-14T12:34:45.835643+0000","last_fullsized":"2023-10-14T12:34:45.835643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775988+0000","last_change":"2023-10-14T12:34:43.743560+0000","last_active":"2023-10-14T12:34:44.775988+0000","last_peered":"2023-10-14T12:34:44.775988+0000","last_clean":"2023-10-14T12:34:44.775988+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:34:44.775988+0000","last_undegraded":"2023-10-14T12:34:44.775988+0000","last_fullsized":"2023-10-14T12:34:44.775988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:26.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764518+0000","last_change":"2023-10-14T12:34:44.766417+0000","last_active":"2023-10-14T12:34:45.764518+0000","last_peered":"2023-10-14T12:34:45.764518+0000","last_clean":"2023-10-14T12:34:45.764518+0000","last_became_active":"2023-10-14T12:34:44.766119+0000","last_became_peered":"2023-10-14T12:34:44.766119+0000","last_unstale":"2023-10-14T12:34:45.764518+0000","last_undegraded":"2023-10-14T12:34:45.764518+0000","last_fullsized":"2023-10-14T12:34:45.764518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775467+0000","last_change":"2023-10-14T12:34:43.738033+0000","last_active":"2023-10-14T12:34:44.775467+0000","last_peered":"2023-10-14T12:34:44.775467+0000","last_clean":"2023-10-14T12:34:44.775467+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:34:44.775467+0000","last_undegraded":"2023-10-14T12:34:44.775467+0000","last_fullsized":"2023-10-14T12:34:44.775467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765588+0000","last_change":"2023-10-14T12:34:44.775797+0000","last_active":"2023-10-14T12:34:45.765588+0000","last_peered":"2023-10-14T12:34:45.765588+0000","last_clean":"2023-10-14T12:34:45.765588+0000","last_became_active":"2023-10-14T12:34:44.775417+0000","last_became_peered":"2023-10-14T12:34:44.775417+0000","last_unstale":"2023-10-14T12:34:45.765588+0000","last_undegraded":"2023-10-14T12:34:45.765588+0000","last_fullsized":"2023-10-14T12:34:45.765588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775680+0000","last_change":"2023-10-14T12:34:43.744197+0000","last_active":"2023-10-14T12:34:44.775680+0000","last_peered":"2023-10-14T12:34:44.775680+0000","last_clean":"2023-10-14T12:34:44.775680+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:34:44.775680+0000","last_undegraded":"2023-10-14T12:34:44.775680+0000","last_fullsized":"2023-10-14T12:34:44.775680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:53.838278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836010+0000","last_change":"2023-10-14T12:34:44.770567+0000","last_active":"2023-10-14T12:34:45.836010+0000","last_peered":"2023-10-14T12:34:45.836010+0000","last_clean":"2023-10-14T12:34:45.836010+0000","last_became_active":"2023-10-14T12:34:44.768157+0000","last_became_peered":"2023-10-14T12:34:44.768157+0000","last_unstale":"2023-10-14T12:34:45.836010+0000","last_undegraded":"2023-10-14T12:34:45.836010+0000","last_fullsized":"2023-10-14T12:34:45.836010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:05.274311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756934+0000","last_change":"2023-10-14T12:34:43.739053+0000","last_active":"2023-10-14T12:34:44.756934+0000","last_peered":"2023-10-14T12:34:44.756934+0000","last_clean":"2023-10-14T12:34:44.756934+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:34:44.756934+0000","last_undegraded":"2023-10-14T12:34:44.756934+0000","last_fullsized":"2023-10-14T12:34:44.756934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765656+0000","last_change":"2023-10-14T12:34:44.768620+0000","last_active":"2023-10-14T12:34:45.765656+0000","last_peered":"2023-10-14T12:34:45.765656+0000","last_clean":"2023-10-14T12:34:45.765656+0000","last_became_active":"2023-10-14T12:34:44.768087+0000","last_became_peered":"2023-10-14T12:34:44.768087+0000","last_unstale":"2023-10-14T12:34:45.765656+0000","last_undegraded":"2023-10-14T12:34:45.765656+0000","last_fullsized":"2023-10-14T12:34:45.765656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.769614+0000","last_change":"2023-10-14T12:34:43.739027+0000","last_active":"2023-10-14T12:34:44.769614+0000","last_peered":"2023-10-14T12:34:44.769614+0000","last_clean":"2023-10-14T12:34:44.769614+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:34:44.769614+0000","last_undegraded":"2023-10-14T12:34:44.769614+0000","last_fullsized":"2023-10-14T12:34:44.769614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:18.085129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836679+0000","last_change":"2023-10-14T12:34:44.761072+0000","last_active":"2023-10-14T12:34:45.836679+0000","last_peered":"2023-10-14T12:34:45.836679+0000","last_clean":"2023-10-14T12:34:45.836679+0000","last_became_active":"2023-10-14T12:34:44.760736+0000","last_became_peered":"2023-10-14T12:34:44.760736+0000","last_unstale":"2023-10-14T12:34:45.836679+0000","last_undegraded":"2023-10-14T12:34:45.836679+0000","last_fullsized":"2023-10-14T12:34:45.836679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.759860+0000","last_change":"2023-10-14T12:34:43.739164+0000","last_active":"2023-10-14T12:34:44.759860+0000","last_peered":"2023-10-14T12:34:44.759860+0000","last_clean":"2023-10-14T12:34:44.759860+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:34:44.759860+0000","last_undegraded":"2023-10-14T12:34:44.759860+0000","last_fullsized":"2023-10-14T12:34:44.759860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:58.156116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764254+0000","last_change":"2023-10-14T12:34:44.764345+0000","last_active":"2023-10-14T12:34:45.764254+0000","last_peered":"2023-10-14T12:34:45.764254+0000","last_clean":"2023-10-14T12:34:45.764254+0000","last_became_active":"2023-10-14T12:34:44.764069+0000","last_became_peered":"2023-10-14T12:34:44.764069+0000","last_unstale":"2023-10-14T12:34:45.764254+0000","last_undegraded":"2023-10-14T12:34:45.764254+0000","last_fullsized":"2023-10-14T12:34:45.764254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.751773+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:44.751773+0000","last_peered":"2023-10-14T12:34:44.751773+0000","last_clean":"2023-10-14T12:34:44.751773+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:44.751773+0000","last_undegraded":"2023-10-14T12:34:44.751773+0000","last_fullsized":"2023-10-14T12:34:44.751773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835883+0000","last_change":"2023-10-14T12:34:44.768053+0000","last_active":"2023-10-14T12:34:45.835883+0000","last_peered":"2023-10-14T12:34:45.835883+0000","last_clean":"2023-10-14T12:34:45.835883+0000","last_became_active":"2023-10-14T12:34:44.767802+0000","last_became_peered":"2023-10-14T12:34:44.767802+0000","last_unstale":"2023-10-14T12:34:45.835883+0000","last_undegraded":"2023-10-14T12:34:45.835883+0000","last_fullsized":"2023-10-14T12:34:45.835883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757835+0000","last_change":"2023-10-14T12:34:43.737529+0000","last_active":"2023-10-14T12:34:44.757835+0000","last_peered":"2023-10-14T12:34:44.757835+0000","last_clean":"2023-10-14T12:34:44.757835+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:34:44.757835+0000","last_undegraded":"2023-10-14T12:34:44.757835+0000","last_fullsized":"2023-10-14T12:34:44.757835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:30:56.810287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835146+0000","last_change":"2023-10-14T12:34:44.768491+0000","last_active":"2023-10-14T12:34:45.835146+0000","last_peered":"2023-10-14T12:34:45.835146+0000","last_clean":"2023-10-14T12:34:45.835146+0000","last_became_active":"2023-10-14T12:34:44.768177+0000","last_became_peered":"2023-10-14T12:34:44.768177+0000","last_unstale":"2023-10-14T12:34:45.835146+0000","last_undegraded":"2023-10-14T12:34:45.835146+0000","last_fullsized":"2023-10-14T12:34:45.835146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779481+0000","last_change":"2023-10-14T12:34:43.735693+0000","last_active":"2023-10-14T12:34:44.779481+0000","last_peered":"2023-10-14T12:34:44.779481+0000","last_clean":"2023-10-14T12:34:44.779481+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:34:44.779481+0000","last_undegraded":"2023-10-14T12:34:44.779481+0000","last_fullsized":"2023-10-14T12:34:44.779481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765390+0000","last_change":"2023-10-14T12:34:44.761812+0000","last_active":"2023-10-14T12:34:45.765390+0000","last_peered":"2023-10-14T12:34:45.765390+0000","last_clean":"2023-10-14T12:34:45.765390+0000","last_became_active":"2023-10-14T12:34:44.761519+0000","last_became_peered":"2023-10-14T12:34:44.761519+0000","last_unstale":"2023-10-14T12:34:45.765390+0000","last_undegraded":"2023-10-14T12:34:45.765390+0000","last_fullsized":"2023-10-14T12:34:45.765390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835973+0000","last_change":"2023-10-14T12:34:43.735820+0000","last_active":"2023-10-14T12:34:45.835973+0000","last_peered":"2023-10-14T12:34:45.835973+0000","last_clean":"2023-10-14T12:34:45.835973+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:34:45.835973+0000","last_undegraded":"2023-10-14T12:34:45.835973+0000","last_fullsized":"2023-10-14T12:34:45.835973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:56.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835989+0000","last_change":"2023-10-14T12:34:44.776057+0000","last_active":"2023-10-14T12:34:45.835989+0000","last_peered":"2023-10-14T12:34:45.835989+0000","last_clean":"2023-10-14T12:34:45.835989+0000","last_became_active":"2023-10-14T12:34:44.775820+0000","last_became_peered":"2023-10-14T12:34:44.775820+0000","last_unstale":"2023-10-14T12:34:45.835989+0000","last_undegraded":"2023-10-14T12:34:45.835989+0000","last_fullsized":"2023-10-14T12:34:45.835989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758094+0000","last_change":"2023-10-14T12:34:43.736834+0000","last_active":"2023-10-14T12:34:44.758094+0000","last_peered":"2023-10-14T12:34:44.758094+0000","last_clean":"2023-10-14T12:34:44.758094+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:34:44.758094+0000","last_undegraded":"2023-10-14T12:34:44.758094+0000","last_fullsized":"2023-10-14T12:34:44.758094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:43.074134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836529+0000","last_change":"2023-10-14T12:34:44.769426+0000","last_active":"2023-10-14T12:34:45.836529+0000","last_peered":"2023-10-14T12:34:45.836529+0000","last_clean":"2023-10-14T12:34:45.836529+0000","last_became_active":"2023-10-14T12:34:44.769173+0000","last_became_peered":"2023-10-14T12:34:44.769173+0000","last_unstale":"2023-10-14T12:34:45.836529+0000","last_undegraded":"2023-10-14T12:34:45.836529+0000","last_fullsized":"2023-10-14T12:34:45.836529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757464+0000","last_change":"2023-10-14T12:34:43.737030+0000","last_active":"2023-10-14T12:34:44.757464+0000","last_peered":"2023-10-14T12:34:44.757464+0000","last_clean":"2023-10-14T12:34:44.757464+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:34:44.757464+0000","last_undegraded":"2023-10-14T12:34:44.757464+0000","last_fullsized":"2023-10-14T12:34:44.757464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835225+0000","last_change":"2023-10-14T12:34:44.763379+0000","last_active":"2023-10-14T12:34:45.835225+0000","last_peered":"2023-10-14T12:34:45.835225+0000","last_clean":"2023-10-14T12:34:45.835225+0000","last_became_active":"2023-10-14T12:34:44.763069+0000","last_became_peered":"2023-10-14T12:34:44.763069+0000","last_unstale":"2023-10-14T12:34:45.835225+0000","last_undegraded":"2023-10-14T12:34:45.835225+0000","last_fullsized":"2023-10-14T12:34:45.835225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756075+0000","last_change":"2023-10-14T12:34:43.740716+0000","last_active":"2023-10-14T12:34:44.756075+0000","last_peered":"2023-10-14T12:34:44.756075+0000","last_clean":"2023-10-14T12:34:44.756075+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:34:44.756075+0000","last_undegraded":"2023-10-14T12:34:44.756075+0000","last_fullsized":"2023-10-14T12:34:44.756075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.766013+0000","last_change":"2023-10-14T12:34:44.769837+0000","last_active":"2023-10-14T12:34:45.766013+0000","last_peered":"2023-10-14T12:34:45.766013+0000","last_clean":"2023-10-14T12:34:45.766013+0000","last_became_active":"2023-10-14T12:34:44.769543+0000","last_became_peered":"2023-10-14T12:34:44.769543+0000","last_unstale":"2023-10-14T12:34:45.766013+0000","last_undegraded":"2023-10-14T12:34:45.766013+0000","last_fullsized":"2023-10-14T12:34:45.766013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758262+0000","last_change":"2023-10-14T12:34:43.738818+0000","last_active":"2023-10-14T12:34:44.758262+0000","last_peered":"2023-10-14T12:34:44.758262+0000","last_clean":"2023-10-14T12:34:44.758262+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:34:44.758262+0000","last_undegraded":"2023-10-14T12:34:44.758262+0000","last_fullsized":"2023-10-14T12:34:44.758262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:21.861042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765067+0000","last_change":"2023-10-14T12:34:44.764824+0000","last_active":"2023-10-14T12:34:45.765067+0000","last_peered":"2023-10-14T12:34:45.765067+0000","last_clean":"2023-10-14T12:34:45.765067+0000","last_became_active":"2023-10-14T12:34:44.764567+0000","last_became_peered":"2023-10-14T12:34:44.764567+0000","last_unstale":"2023-10-14T12:34:45.765067+0000","last_undegraded":"2023-10-14T12:34:45.765067+0000","last_fullsized":"2023-10-14T12:34:45.765067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:53.725438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752091+0000","last_change":"2023-10-14T12:34:43.733187+0000","last_active":"2023-10-14T12:34:44.752091+0000","last_peered":"2023-10-14T12:34:44.752091+0000","last_clean":"2023-10-14T12:34:44.752091+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:34:44.752091+0000","last_undegraded":"2023-10-14T12:34:44.752091+0000","last_fullsized":"2023-10-14T12:34:44.752091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765866+0000","last_change":"2023-10-14T12:34:44.767412+0000","last_active":"2023-10-14T12:34:45.765866+0000","last_peered":"2023-10-14T12:34:45.765866+0000","last_clean":"2023-10-14T12:34:45.765866+0000","last_became_active":"2023-10-14T12:34:44.766080+0000","last_became_peered":"2023-10-14T12:34:44.766080+0000","last_unstale":"2023-10-14T12:34:45.765866+0000","last_undegraded":"2023-10-14T12:34:45.765866+0000","last_fullsized":"2023-10-14T12:34:45.765866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:41.477384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752465+0000","last_change":"2023-10-14T12:34:43.744939+0000","last_active":"2023-10-14T12:34:44.752465+0000","last_peered":"2023-10-14T12:34:44.752465+0000","last_clean":"2023-10-14T12:34:44.752465+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:34:44.752465+0000","last_undegraded":"2023-10-14T12:34:44.752465+0000","last_fullsized":"2023-10-14T12:34:44.752465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:42.271784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750684+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:34:44.750684+0000","last_peered":"2023-10-14T12:34:44.750684+0000","last_clean":"2023-10-14T12:34:44.750684+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:34:44.750684+0000","last_undegraded":"2023-10-14T12:34:44.750684+0000","last_fullsized":"2023-10-14T12:34:44.750684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.626}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67800000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.45700000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46999999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.34799999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.37},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45200000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.434},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.379}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":779658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.37}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.437}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.26100000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":190902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.64400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.44700000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.48399999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.623},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.71799999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54300000000000004}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:34:57.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:34:57.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.810+0000 7f936220a700 1 Processor -- start 2023-10-14T12:34:57.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.810+0000 7f936220a700 1 -- start start 2023-10-14T12:34:57.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.811+0000 7f936220a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c15dbf0 0x7f935c0af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.811+0000 7f936220a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935c0caee0 con 0x7f935c0af030 2023-10-14T12:34:57.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.811+0000 7f936220a700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935c0cfc30 con 0x7f935c15d810 2023-10-14T12:34:57.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.811+0000 7f936220a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0cf990 con 0x7f935c15dbf0 2023-10-14T12:34:57.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.811+0000 7f935bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f935c0af030 0x7f935c161560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55194/0 (socket says 172.21.15.72:55194) 2023-10-14T12:34:57.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.811+0000 7f935bfff700 1 -- 172.21.15.72:0/173628594 learned_addr learned my addr 172.21.15.72:0/173628594 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:57.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548733866 0 0) 0x7f935c0caee0 con 0x7f935c0af030 2023-10-14T12:34:57.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935affd700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c15dbf0 0x7f935c0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93440035b0 con 0x7f935c0af030 2023-10-14T12:34:57.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521648178 0 0) 0x7f93440035b0 con 0x7f935c0af030 2023-10-14T12:34:57.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c15dbf0 msgr2=0x7f935c0af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:57.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c15dbf0 0x7f935c0af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 >> v1:172.21.15.123:6789/0 conn(0x7f935c15d810 legacy=0x7f935c0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c0cff10 con 0x7f935c0af030 2023-10-14T12:34:57.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f93540019f0 con 0x7f935c0af030 2023-10-14T12:34:57.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 >> v1:172.21.15.72:6789/0 conn(0x7f935c0af030 legacy=0x7f935c161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c15dbf0 0x7f9344003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9344003fb0 0x7f9344004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9344004d90 0x7f9344005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0cf990 con 0x7f9344004d90 2023-10-14T12:34:57.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934400baf0 con 0x7f9344003fb0 2023-10-14T12:34:57.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934400bcb0 con 0x7f935c15dbf0 2023-10-14T12:34:57.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935bfff700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9344004d90 0x7f9344005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935affd700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9344003fb0 0x7f9344004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935b7fe700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c15dbf0 0x7f9344003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935bfff700 1 -- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c15dbf0 msgr2=0x7f9344003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:57.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935bfff700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c15dbf0 0x7f9344003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935bfff700 1 -- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9344003fb0 msgr2=0x7f9344004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:57.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935bfff700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9344003fb0 0x7f9344004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.812+0000 7f935bfff700 1 -- 172.21.15.72:0/173628594 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440035b0 con 0x7f9344004d90 2023-10-14T12:34:57.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f935bfff700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9344004d90 0x7f9344005210 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f93540013d0 tx=0x7f9344005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1764fbff7024f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:57.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354012600 con 0x7f9344004d90 2023-10-14T12:34:57.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93540127a0 con 0x7f9344004d90 2023-10-14T12:34:57.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f935a7fc700 1 -- 172.21.15.72:0/173628594 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354012b50 con 0x7f9344004d90 2023-10-14T12:34:57.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f936220a700 1 -- 172.21.15.72:0/173628594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9344004d90 msgr2=0x7f9344005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f936220a700 1 --2- 172.21.15.72:0/173628594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9344004d90 0x7f9344005210 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f93540013d0 tx=0x7f9344005880 comp rx=0 tx=0).stop 2023-10-14T12:34:57.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f935bfff700 1 -- 172.21.15.72:0/173628594 reap_dead start 2023-10-14T12:34:57.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f936220a700 1 -- 172.21.15.72:0/173628594 shutdown_connections 2023-10-14T12:34:57.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f936220a700 1 -- 172.21.15.72:0/173628594 >> 172.21.15.72:0/173628594 conn(0x7f935c0d0180 msgr2=0x7f935c0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:57.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f936220a700 1 -- 172.21.15.72:0/173628594 shutdown_connections 2023-10-14T12:34:57.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.813+0000 7f936220a700 1 -- 172.21.15.72:0/173628594 wait complete. 2023-10-14T12:34:57.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.814+0000 7f936220a700 1 Processor -- start 2023-10-14T12:34:57.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f936220a700 1 -- start start 2023-10-14T12:34:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f936220a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9344004d90 0x7f935c15f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f936220a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c1f68f0 0x7f935c160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f936220a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935c1521f0 0x7f935c0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f936220a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c15ec50 con 0x7f935c1521f0 2023-10-14T12:34:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f936220a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c15f5b0 con 0x7f9344004d90 2023-10-14T12:34:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f936220a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c15e060 con 0x7f935c1f68f0 2023-10-14T12:34:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f935bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935c1521f0 0x7f935c0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f935bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935c1521f0 0x7f935c0b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48906/0 (socket says 172.21.15.72:48906) 2023-10-14T12:34:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f935bfff700 1 -- 172.21.15.72:0/1956771462 learned_addr learned my addr 172.21.15.72:0/1956771462 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.815+0000 7f935b7fe700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9344004d90 0x7f935c15f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f935affd700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c1f68f0 0x7f935c160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f935bfff700 1 -- 172.21.15.72:0/1956771462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c1f68f0 msgr2=0x7f935c160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f935bfff700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c1f68f0 0x7f935c160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f935bfff700 1 -- 172.21.15.72:0/1956771462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9344004d90 msgr2=0x7f935c15f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:57.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f935bfff700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9344004d90 0x7f935c15f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:57.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f935bfff700 1 -- 172.21.15.72:0/1956771462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c1f6d70 con 0x7f935c1521f0 2023-10-14T12:34:57.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f935bfff700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935c1521f0 0x7f935c0b3f60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9354012000 tx=0x7f9354001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:57.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f9343fff700 1 -- 172.21.15.72:0/1956771462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935401e430 con 0x7f935c1521f0 2023-10-14T12:34:57.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f9343fff700 1 -- 172.21.15.72:0/1956771462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935401e5b0 con 0x7f935c1521f0 2023-10-14T12:34:57.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f9343fff700 1 -- 172.21.15.72:0/1956771462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935401e960 con 0x7f935c1521f0 2023-10-14T12:34:57.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935c15e2b0 con 0x7f935c1521f0 2023-10-14T12:34:57.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.816+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935c15e870 con 0x7f935c1521f0 2023-10-14T12:34:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.817+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935c15ed90 con 0x7f935c1521f0 2023-10-14T12:34:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.817+0000 7f9343fff700 1 -- 172.21.15.72:0/1956771462 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f935401eac0 con 0x7f935c1521f0 2023-10-14T12:34:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.818+0000 7f9343fff700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f934806af00 0x7f934806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.818+0000 7f9343fff700 1 -- 172.21.15.72:0/1956771462 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f935408b4e0 con 0x7f935c1521f0 2023-10-14T12:34:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.818+0000 7f935b7fe700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f934806af00 0x7f934806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.818+0000 7f935b7fe700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f934806af00 0x7f934806d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9350000c00 tx=0x7f9350009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:57.822+0000 7f9343fff700 1 -- 172.21.15.72:0/1956771462 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f935c15ed90 con 0x7f935c1521f0 2023-10-14T12:34:58.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.007+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f935c072570 con 0x7f934806af00 2023-10-14T12:34:58.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.015+0000 7f9343fff700 1 -- 172.21.15.72:0/1956771462 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288747 (secure 0 0 0) 0x7f9350001640 con 0x7f934806af00 2023-10-14T12:34:58.019 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:58.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f934806af00 msgr2=0x7f934806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f934806af00 0x7f934806d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9350000c00 tx=0x7f9350009040 comp rx=0 tx=0).stop 2023-10-14T12:34:58.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935c1521f0 msgr2=0x7f935c0b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935c1521f0 0x7f935c0b3f60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9354012000 tx=0x7f9354001360 comp rx=0 tx=0).stop 2023-10-14T12:34:58.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 shutdown_connections 2023-10-14T12:34:58.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f934806af00 0x7f934806d3c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f935c1521f0 0x7f935c0b3f60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9344004d90 0x7f935c15f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 --2- 172.21.15.72:0/1956771462 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f935c1f68f0 0x7f935c160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 >> 172.21.15.72:0/1956771462 conn(0x7f935c0d0180 msgr2=0x7f935c0b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:58.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 shutdown_connections 2023-10-14T12:34:58.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.018+0000 7f936220a700 1 -- 172.21.15.72:0/1956771462 wait complete. 2023-10-14T12:34:58.026 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:34:58.031 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-14T12:34:57.402496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220856,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753864,"statfs":{"total":773094113280,"available":772867956736,"internally_reserved":0,"allocated":4759552,"data_stored":2699604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.640399"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836180+0000","last_change":"2023-10-14T12:34:44.773258+0000","last_active":"2023-10-14T12:34:45.836180+0000","last_peered":"2023-10-14T12:34:45.836180+0000","last_clean":"2023-10-14T12:34:45.836180+0000","last_became_active":"2023-10-14T12:34:44.772874+0000","last_became_peered":"2023-10-14T12:34:44.772874+0000","last_unstale":"2023-10-14T12:34:45.836180+0000","last_undegraded":"2023-10-14T12:34:45.836180+0000","last_fullsized":"2023-10-14T12:34:45.836180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835866+0000","last_change":"2023-10-14T12:34:44.766065+0000","last_active":"2023-10-14T12:34:45.835866+0000","last_peered":"2023-10-14T12:34:45.835866+0000","last_clean":"2023-10-14T12:34:45.835866+0000","last_became_active":"2023-10-14T12:34:44.765783+0000","last_became_peered":"2023-10-14T12:34:44.765783+0000","last_unstale":"2023-10-14T12:34:45.835866+0000","last_undegraded":"2023-10-14T12:34:45.835866+0000","last_fullsized":"2023-10-14T12:34:45.835866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836798+0000","last_change":"2023-10-14T12:34:44.766216+0000","last_active":"2023-10-14T12:34:45.836798+0000","last_peered":"2023-10-14T12:34:45.836798+0000","last_clean":"2023-10-14T12:34:45.836798+0000","last_became_active":"2023-10-14T12:34:44.765915+0000","last_became_peered":"2023-10-14T12:34:44.765915+0000","last_unstale":"2023-10-14T12:34:45.836798+0000","last_undegraded":"2023-10-14T12:34:45.836798+0000","last_fullsized":"2023-10-14T12:34:45.836798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835634+0000","last_change":"2023-10-14T12:34:44.776783+0000","last_active":"2023-10-14T12:34:45.835634+0000","last_peered":"2023-10-14T12:34:45.835634+0000","last_clean":"2023-10-14T12:34:45.835634+0000","last_became_active":"2023-10-14T12:34:44.776527+0000","last_became_peered":"2023-10-14T12:34:44.776527+0000","last_unstale":"2023-10-14T12:34:45.835634+0000","last_undegraded":"2023-10-14T12:34:45.835634+0000","last_fullsized":"2023-10-14T12:34:45.835634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:10.476396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835368+0000","last_change":"2023-10-14T12:34:44.774798+0000","last_active":"2023-10-14T12:34:45.835368+0000","last_peered":"2023-10-14T12:34:45.835368+0000","last_clean":"2023-10-14T12:34:45.835368+0000","last_became_active":"2023-10-14T12:34:44.774508+0000","last_became_peered":"2023-10-14T12:34:44.774508+0000","last_unstale":"2023-10-14T12:34:45.835368+0000","last_undegraded":"2023-10-14T12:34:45.835368+0000","last_fullsized":"2023-10-14T12:34:45.835368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.842813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835002+0000","last_change":"2023-10-14T12:34:44.771286+0000","last_active":"2023-10-14T12:34:45.835002+0000","last_peered":"2023-10-14T12:34:45.835002+0000","last_clean":"2023-10-14T12:34:45.835002+0000","last_became_active":"2023-10-14T12:34:44.768717+0000","last_became_peered":"2023-10-14T12:34:44.768717+0000","last_unstale":"2023-10-14T12:34:45.835002+0000","last_undegraded":"2023-10-14T12:34:45.835002+0000","last_fullsized":"2023-10-14T12:34:45.835002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764118+0000","last_change":"2023-10-14T12:34:44.771173+0000","last_active":"2023-10-14T12:34:45.764118+0000","last_peered":"2023-10-14T12:34:45.764118+0000","last_clean":"2023-10-14T12:34:45.764118+0000","last_became_active":"2023-10-14T12:34:44.770869+0000","last_became_peered":"2023-10-14T12:34:44.770869+0000","last_unstale":"2023-10-14T12:34:45.764118+0000","last_undegraded":"2023-10-14T12:34:45.764118+0000","last_fullsized":"2023-10-14T12:34:45.764118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835912+0000","last_change":"2023-10-14T12:34:44.766306+0000","last_active":"2023-10-14T12:34:45.835912+0000","last_peered":"2023-10-14T12:34:45.835912+0000","last_clean":"2023-10-14T12:34:45.835912+0000","last_became_active":"2023-10-14T12:34:44.765917+0000","last_became_peered":"2023-10-14T12:34:44.765917+0000","last_unstale":"2023-10-14T12:34:45.835912+0000","last_undegraded":"2023-10-14T12:34:45.835912+0000","last_fullsized":"2023-10-14T12:34:45.835912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836985+0000","last_change":"2023-10-14T12:34:44.769040+0000","last_active":"2023-10-14T12:34:45.836985+0000","last_peered":"2023-10-14T12:34:45.836985+0000","last_clean":"2023-10-14T12:34:45.836985+0000","last_became_active":"2023-10-14T12:34:44.768514+0000","last_became_peered":"2023-10-14T12:34:44.768514+0000","last_unstale":"2023-10-14T12:34:45.836985+0000","last_undegraded":"2023-10-14T12:34:45.836985+0000","last_fullsized":"2023-10-14T12:34:45.836985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765522+0000","last_change":"2023-10-14T12:34:44.764554+0000","last_active":"2023-10-14T12:34:45.765522+0000","last_peered":"2023-10-14T12:34:45.765522+0000","last_clean":"2023-10-14T12:34:45.765522+0000","last_became_active":"2023-10-14T12:34:44.764252+0000","last_became_peered":"2023-10-14T12:34:44.764252+0000","last_unstale":"2023-10-14T12:34:45.765522+0000","last_undegraded":"2023-10-14T12:34:45.765522+0000","last_fullsized":"2023-10-14T12:34:45.765522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:36.689643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764651+0000","last_change":"2023-10-14T12:34:44.776394+0000","last_active":"2023-10-14T12:34:45.764651+0000","last_peered":"2023-10-14T12:34:45.764651+0000","last_clean":"2023-10-14T12:34:45.764651+0000","last_became_active":"2023-10-14T12:34:44.775897+0000","last_became_peered":"2023-10-14T12:34:44.775897+0000","last_unstale":"2023-10-14T12:34:45.764651+0000","last_undegraded":"2023-10-14T12:34:45.764651+0000","last_fullsized":"2023-10-14T12:34:45.764651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836748+0000","last_change":"2023-10-14T12:34:44.766520+0000","last_active":"2023-10-14T12:34:45.836748+0000","last_peered":"2023-10-14T12:34:45.836748+0000","last_clean":"2023-10-14T12:34:45.836748+0000","last_became_active":"2023-10-14T12:34:44.766208+0000","last_became_peered":"2023-10-14T12:34:44.766208+0000","last_unstale":"2023-10-14T12:34:45.836748+0000","last_undegraded":"2023-10-14T12:34:45.836748+0000","last_fullsized":"2023-10-14T12:34:45.836748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764453+0000","last_change":"2023-10-14T12:34:44.767161+0000","last_active":"2023-10-14T12:34:45.764453+0000","last_peered":"2023-10-14T12:34:45.764453+0000","last_clean":"2023-10-14T12:34:45.764453+0000","last_became_active":"2023-10-14T12:34:44.766602+0000","last_became_peered":"2023-10-14T12:34:44.766602+0000","last_unstale":"2023-10-14T12:34:45.764453+0000","last_undegraded":"2023-10-14T12:34:45.764453+0000","last_fullsized":"2023-10-14T12:34:45.764453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765845+0000","last_change":"2023-10-14T12:34:44.770652+0000","last_active":"2023-10-14T12:34:45.765845+0000","last_peered":"2023-10-14T12:34:45.765845+0000","last_clean":"2023-10-14T12:34:45.765845+0000","last_became_active":"2023-10-14T12:34:44.770368+0000","last_became_peered":"2023-10-14T12:34:44.770368+0000","last_unstale":"2023-10-14T12:34:45.765845+0000","last_undegraded":"2023-10-14T12:34:45.765845+0000","last_fullsized":"2023-10-14T12:34:45.765845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.763799+0000","last_change":"2023-10-14T12:34:44.764695+0000","last_active":"2023-10-14T12:34:45.763799+0000","last_peered":"2023-10-14T12:34:45.763799+0000","last_clean":"2023-10-14T12:34:45.763799+0000","last_became_active":"2023-10-14T12:34:44.763083+0000","last_became_peered":"2023-10-14T12:34:44.763083+0000","last_unstale":"2023-10-14T12:34:45.763799+0000","last_undegraded":"2023-10-14T12:34:45.763799+0000","last_fullsized":"2023-10-14T12:34:45.763799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765533+0000","last_change":"2023-10-14T12:34:44.768707+0000","last_active":"2023-10-14T12:34:45.765533+0000","last_peered":"2023-10-14T12:34:45.765533+0000","last_clean":"2023-10-14T12:34:45.765533+0000","last_became_active":"2023-10-14T12:34:44.768474+0000","last_became_peered":"2023-10-14T12:34:44.768474+0000","last_unstale":"2023-10-14T12:34:45.765533+0000","last_undegraded":"2023-10-14T12:34:45.765533+0000","last_fullsized":"2023-10-14T12:34:45.765533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765794+0000","last_change":"2023-10-14T12:34:44.771432+0000","last_active":"2023-10-14T12:34:45.765794+0000","last_peered":"2023-10-14T12:34:45.765794+0000","last_clean":"2023-10-14T12:34:45.765794+0000","last_became_active":"2023-10-14T12:34:44.771158+0000","last_became_peered":"2023-10-14T12:34:44.771158+0000","last_unstale":"2023-10-14T12:34:45.765794+0000","last_undegraded":"2023-10-14T12:34:45.765794+0000","last_fullsized":"2023-10-14T12:34:45.765794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835519+0000","last_change":"2023-10-14T12:34:44.776578+0000","last_active":"2023-10-14T12:34:45.835519+0000","last_peered":"2023-10-14T12:34:45.835519+0000","last_clean":"2023-10-14T12:34:45.835519+0000","last_became_active":"2023-10-14T12:34:44.776263+0000","last_became_peered":"2023-10-14T12:34:44.776263+0000","last_unstale":"2023-10-14T12:34:45.835519+0000","last_undegraded":"2023-10-14T12:34:45.835519+0000","last_fullsized":"2023-10-14T12:34:45.835519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835662+0000","last_change":"2023-10-14T12:34:44.767374+0000","last_active":"2023-10-14T12:34:45.835662+0000","last_peered":"2023-10-14T12:34:45.835662+0000","last_clean":"2023-10-14T12:34:45.835662+0000","last_became_active":"2023-10-14T12:34:44.767035+0000","last_became_peered":"2023-10-14T12:34:44.767035+0000","last_unstale":"2023-10-14T12:34:45.835662+0000","last_undegraded":"2023-10-14T12:34:45.835662+0000","last_fullsized":"2023-10-14T12:34:45.835662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:06.799411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835300+0000","last_change":"2023-10-14T12:34:44.775911+0000","last_active":"2023-10-14T12:34:45.835300+0000","last_peered":"2023-10-14T12:34:45.835300+0000","last_clean":"2023-10-14T12:34:45.835300+0000","last_became_active":"2023-10-14T12:34:44.775453+0000","last_became_peered":"2023-10-14T12:34:44.775453+0000","last_unstale":"2023-10-14T12:34:45.835300+0000","last_undegraded":"2023-10-14T12:34:45.835300+0000","last_fullsized":"2023-10-14T12:34:45.835300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:37.110615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764577+0000","last_change":"2023-10-14T12:34:44.766571+0000","last_active":"2023-10-14T12:34:45.764577+0000","last_peered":"2023-10-14T12:34:45.764577+0000","last_clean":"2023-10-14T12:34:45.764577+0000","last_became_active":"2023-10-14T12:34:44.766299+0000","last_became_peered":"2023-10-14T12:34:44.766299+0000","last_unstale":"2023-10-14T12:34:45.764577+0000","last_undegraded":"2023-10-14T12:34:45.764577+0000","last_fullsized":"2023-10-14T12:34:45.764577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765865+0000","last_change":"2023-10-14T12:34:44.770392+0000","last_active":"2023-10-14T12:34:45.765865+0000","last_peered":"2023-10-14T12:34:45.765865+0000","last_clean":"2023-10-14T12:34:45.765865+0000","last_became_active":"2023-10-14T12:34:44.770033+0000","last_became_peered":"2023-10-14T12:34:44.770033+0000","last_unstale":"2023-10-14T12:34:45.765865+0000","last_undegraded":"2023-10-14T12:34:45.765865+0000","last_fullsized":"2023-10-14T12:34:45.765865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765576+0000","last_change":"2023-10-14T12:34:44.768259+0000","last_active":"2023-10-14T12:34:45.765576+0000","last_peered":"2023-10-14T12:34:45.765576+0000","last_clean":"2023-10-14T12:34:45.765576+0000","last_became_active":"2023-10-14T12:34:44.767967+0000","last_became_peered":"2023-10-14T12:34:44.767967+0000","last_unstale":"2023-10-14T12:34:45.765576+0000","last_undegraded":"2023-10-14T12:34:45.765576+0000","last_fullsized":"2023-10-14T12:34:45.765576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835233+0000","last_change":"2023-10-14T12:34:44.770347+0000","last_active":"2023-10-14T12:34:45.835233+0000","last_peered":"2023-10-14T12:34:45.835233+0000","last_clean":"2023-10-14T12:34:45.835233+0000","last_became_active":"2023-10-14T12:34:44.768304+0000","last_became_peered":"2023-10-14T12:34:44.768304+0000","last_unstale":"2023-10-14T12:34:45.835233+0000","last_undegraded":"2023-10-14T12:34:45.835233+0000","last_fullsized":"2023-10-14T12:34:45.835233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:27:07.068125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835441+0000","last_change":"2023-10-14T12:34:44.764335+0000","last_active":"2023-10-14T12:34:45.835441+0000","last_peered":"2023-10-14T12:34:45.835441+0000","last_clean":"2023-10-14T12:34:45.835441+0000","last_became_active":"2023-10-14T12:34:44.764072+0000","last_became_peered":"2023-10-14T12:34:44.764072+0000","last_unstale":"2023-10-14T12:34:45.835441+0000","last_undegraded":"2023-10-14T12:34:45.835441+0000","last_fullsized":"2023-10-14T12:34:45.835441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835405+0000","last_change":"2023-10-14T12:34:44.768012+0000","last_active":"2023-10-14T12:34:45.835405+0000","last_peered":"2023-10-14T12:34:45.835405+0000","last_clean":"2023-10-14T12:34:45.835405+0000","last_became_active":"2023-10-14T12:34:44.767743+0000","last_became_peered":"2023-10-14T12:34:44.767743+0000","last_unstale":"2023-10-14T12:34:45.835405+0000","last_undegraded":"2023-10-14T12:34:45.835405+0000","last_fullsized":"2023-10-14T12:34:45.835405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835418+0000","last_change":"2023-10-14T12:34:44.766816+0000","last_active":"2023-10-14T12:34:45.835418+0000","last_peered":"2023-10-14T12:34:45.835418+0000","last_clean":"2023-10-14T12:34:45.835418+0000","last_became_active":"2023-10-14T12:34:44.766309+0000","last_became_peered":"2023-10-14T12:34:44.766309+0000","last_unstale":"2023-10-14T12:34:45.835418+0000","last_undegraded":"2023-10-14T12:34:45.835418+0000","last_fullsized":"2023-10-14T12:34:45.835418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764364+0000","last_change":"2023-10-14T12:34:44.766262+0000","last_active":"2023-10-14T12:34:45.764364+0000","last_peered":"2023-10-14T12:34:45.764364+0000","last_clean":"2023-10-14T12:34:45.764364+0000","last_became_active":"2023-10-14T12:34:44.765904+0000","last_became_peered":"2023-10-14T12:34:44.765904+0000","last_unstale":"2023-10-14T12:34:45.764364+0000","last_undegraded":"2023-10-14T12:34:45.764364+0000","last_fullsized":"2023-10-14T12:34:45.764364+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835345+0000","last_change":"2023-10-14T12:34:44.764983+0000","last_active":"2023-10-14T12:34:45.835345+0000","last_peered":"2023-10-14T12:34:45.835345+0000","last_clean":"2023-10-14T12:34:45.835345+0000","last_became_active":"2023-10-14T12:34:44.764719+0000","last_became_peered":"2023-10-14T12:34:44.764719+0000","last_unstale":"2023-10-14T12:34:45.835345+0000","last_undegraded":"2023-10-14T12:34:45.835345+0000","last_fullsized":"2023-10-14T12:34:45.835345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835251+0000","last_change":"2023-10-14T12:34:44.769030+0000","last_active":"2023-10-14T12:34:45.835251+0000","last_peered":"2023-10-14T12:34:45.835251+0000","last_clean":"2023-10-14T12:34:45.835251+0000","last_became_active":"2023-10-14T12:34:44.768729+0000","last_became_peered":"2023-10-14T12:34:44.768729+0000","last_unstale":"2023-10-14T12:34:45.835251+0000","last_undegraded":"2023-10-14T12:34:45.835251+0000","last_fullsized":"2023-10-14T12:34:45.835251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:36.593887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765428+0000","last_change":"2023-10-14T12:34:44.768972+0000","last_active":"2023-10-14T12:34:45.765428+0000","last_peered":"2023-10-14T12:34:45.765428+0000","last_clean":"2023-10-14T12:34:45.765428+0000","last_became_active":"2023-10-14T12:34:44.768243+0000","last_became_peered":"2023-10-14T12:34:44.768243+0000","last_unstale":"2023-10-14T12:34:45.765428+0000","last_undegraded":"2023-10-14T12:34:45.765428+0000","last_fullsized":"2023-10-14T12:34:45.765428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835003+0000","last_change":"2023-10-14T12:34:44.768827+0000","last_active":"2023-10-14T12:34:45.835003+0000","last_peered":"2023-10-14T12:34:45.835003+0000","last_clean":"2023-10-14T12:34:45.835003+0000","last_became_active":"2023-10-14T12:34:44.768423+0000","last_became_peered":"2023-10-14T12:34:44.768423+0000","last_unstale":"2023-10-14T12:34:45.835003+0000","last_undegraded":"2023-10-14T12:34:45.835003+0000","last_fullsized":"2023-10-14T12:34:45.835003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765078+0000","last_change":"2023-10-14T12:34:44.771115+0000","last_active":"2023-10-14T12:34:45.765078+0000","last_peered":"2023-10-14T12:34:45.765078+0000","last_clean":"2023-10-14T12:34:45.765078+0000","last_became_active":"2023-10-14T12:34:44.770846+0000","last_became_peered":"2023-10-14T12:34:44.770846+0000","last_unstale":"2023-10-14T12:34:45.765078+0000","last_undegraded":"2023-10-14T12:34:45.765078+0000","last_fullsized":"2023-10-14T12:34:45.765078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:18.644528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775649+0000","last_change":"2023-10-14T12:34:43.742439+0000","last_active":"2023-10-14T12:34:44.775649+0000","last_peered":"2023-10-14T12:34:44.775649+0000","last_clean":"2023-10-14T12:34:44.775649+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:34:44.775649+0000","last_undegraded":"2023-10-14T12:34:44.775649+0000","last_fullsized":"2023-10-14T12:34:44.775649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835738+0000","last_change":"2023-10-14T12:34:44.772445+0000","last_active":"2023-10-14T12:34:45.835738+0000","last_peered":"2023-10-14T12:34:45.835738+0000","last_clean":"2023-10-14T12:34:45.835738+0000","last_became_active":"2023-10-14T12:34:44.772093+0000","last_became_peered":"2023-10-14T12:34:44.772093+0000","last_unstale":"2023-10-14T12:34:45.835738+0000","last_undegraded":"2023-10-14T12:34:45.835738+0000","last_fullsized":"2023-10-14T12:34:45.835738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773796+0000","last_change":"2023-10-14T12:34:43.740875+0000","last_active":"2023-10-14T12:34:44.773796+0000","last_peered":"2023-10-14T12:34:44.773796+0000","last_clean":"2023-10-14T12:34:44.773796+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:34:44.773796+0000","last_undegraded":"2023-10-14T12:34:44.773796+0000","last_fullsized":"2023-10-14T12:34:44.773796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765494+0000","last_change":"2023-10-14T12:34:44.775914+0000","last_active":"2023-10-14T12:34:45.765494+0000","last_peered":"2023-10-14T12:34:45.765494+0000","last_clean":"2023-10-14T12:34:45.765494+0000","last_became_active":"2023-10-14T12:34:44.775648+0000","last_became_peered":"2023-10-14T12:34:44.775648+0000","last_unstale":"2023-10-14T12:34:45.765494+0000","last_undegraded":"2023-10-14T12:34:45.765494+0000","last_fullsized":"2023-10-14T12:34:45.765494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.774951+0000","last_change":"2023-10-14T12:34:43.737909+0000","last_active":"2023-10-14T12:34:44.774951+0000","last_peered":"2023-10-14T12:34:44.774951+0000","last_clean":"2023-10-14T12:34:44.774951+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:34:44.774951+0000","last_undegraded":"2023-10-14T12:34:44.774951+0000","last_fullsized":"2023-10-14T12:34:44.774951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:21.264726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836154+0000","last_change":"2023-10-14T12:34:44.765349+0000","last_active":"2023-10-14T12:34:45.836154+0000","last_peered":"2023-10-14T12:34:45.836154+0000","last_clean":"2023-10-14T12:34:45.836154+0000","last_became_active":"2023-10-14T12:34:44.765043+0000","last_became_peered":"2023-10-14T12:34:44.765043+0000","last_unstale":"2023-10-14T12:34:45.836154+0000","last_undegraded":"2023-10-14T12:34:45.836154+0000","last_fullsized":"2023-10-14T12:34:45.836154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775771+0000","last_change":"2023-10-14T12:34:43.738060+0000","last_active":"2023-10-14T12:34:44.775771+0000","last_peered":"2023-10-14T12:34:44.775771+0000","last_clean":"2023-10-14T12:34:44.775771+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:34:44.775771+0000","last_undegraded":"2023-10-14T12:34:44.775771+0000","last_fullsized":"2023-10-14T12:34:44.775771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836764+0000","last_change":"2023-10-14T12:34:44.763674+0000","last_active":"2023-10-14T12:34:45.836764+0000","last_peered":"2023-10-14T12:34:45.836764+0000","last_clean":"2023-10-14T12:34:45.836764+0000","last_became_active":"2023-10-14T12:34:44.763356+0000","last_became_peered":"2023-10-14T12:34:44.763356+0000","last_unstale":"2023-10-14T12:34:45.836764+0000","last_undegraded":"2023-10-14T12:34:45.836764+0000","last_fullsized":"2023-10-14T12:34:45.836764+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.772744+0000","last_change":"2023-10-14T12:34:43.738857+0000","last_active":"2023-10-14T12:34:44.772744+0000","last_peered":"2023-10-14T12:34:44.772744+0000","last_clean":"2023-10-14T12:34:44.772744+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:34:44.772744+0000","last_undegraded":"2023-10-14T12:34:44.772744+0000","last_fullsized":"2023-10-14T12:34:44.772744+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:47.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764009+0000","last_change":"2023-10-14T12:34:44.767242+0000","last_active":"2023-10-14T12:34:45.764009+0000","last_peered":"2023-10-14T12:34:45.764009+0000","last_clean":"2023-10-14T12:34:45.764009+0000","last_became_active":"2023-10-14T12:34:44.766961+0000","last_became_peered":"2023-10-14T12:34:44.766961+0000","last_unstale":"2023-10-14T12:34:45.764009+0000","last_undegraded":"2023-10-14T12:34:45.764009+0000","last_fullsized":"2023-10-14T12:34:45.764009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775710+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:44.775710+0000","last_peered":"2023-10-14T12:34:44.775710+0000","last_clean":"2023-10-14T12:34:44.775710+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:44.775710+0000","last_undegraded":"2023-10-14T12:34:44.775710+0000","last_fullsized":"2023-10-14T12:34:44.775710+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765983+0000","last_change":"2023-10-14T12:34:44.770562+0000","last_active":"2023-10-14T12:34:45.765983+0000","last_peered":"2023-10-14T12:34:45.765983+0000","last_clean":"2023-10-14T12:34:45.765983+0000","last_became_active":"2023-10-14T12:34:44.770030+0000","last_became_peered":"2023-10-14T12:34:44.770030+0000","last_unstale":"2023-10-14T12:34:45.765983+0000","last_undegraded":"2023-10-14T12:34:45.765983+0000","last_fullsized":"2023-10-14T12:34:45.765983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757619+0000","last_change":"2023-10-14T12:34:43.738248+0000","last_active":"2023-10-14T12:34:44.757619+0000","last_peered":"2023-10-14T12:34:44.757619+0000","last_clean":"2023-10-14T12:34:44.757619+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:34:44.757619+0000","last_undegraded":"2023-10-14T12:34:44.757619+0000","last_fullsized":"2023-10-14T12:34:44.757619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836002+0000","last_change":"2023-10-14T12:34:44.762002+0000","last_active":"2023-10-14T12:34:45.836002+0000","last_peered":"2023-10-14T12:34:45.836002+0000","last_clean":"2023-10-14T12:34:45.836002+0000","last_became_active":"2023-10-14T12:34:44.761308+0000","last_became_peered":"2023-10-14T12:34:44.761308+0000","last_unstale":"2023-10-14T12:34:45.836002+0000","last_undegraded":"2023-10-14T12:34:45.836002+0000","last_fullsized":"2023-10-14T12:34:45.836002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.754851+0000","last_change":"2023-10-14T12:34:43.737450+0000","last_active":"2023-10-14T12:34:44.754851+0000","last_peered":"2023-10-14T12:34:44.754851+0000","last_clean":"2023-10-14T12:34:44.754851+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:34:44.754851+0000","last_undegraded":"2023-10-14T12:34:44.754851+0000","last_fullsized":"2023-10-14T12:34:44.754851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:27.820010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835759+0000","last_change":"2023-10-14T12:34:44.776821+0000","last_active":"2023-10-14T12:34:45.835759+0000","last_peered":"2023-10-14T12:34:45.835759+0000","last_clean":"2023-10-14T12:34:45.835759+0000","last_became_active":"2023-10-14T12:34:44.776592+0000","last_became_peered":"2023-10-14T12:34:44.776592+0000","last_unstale":"2023-10-14T12:34:45.835759+0000","last_undegraded":"2023-10-14T12:34:45.835759+0000","last_fullsized":"2023-10-14T12:34:45.835759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:31.333285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.753775+0000","last_change":"2023-10-14T12:34:43.733989+0000","last_active":"2023-10-14T12:34:44.753775+0000","last_peered":"2023-10-14T12:34:44.753775+0000","last_clean":"2023-10-14T12:34:44.753775+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:34:44.753775+0000","last_undegraded":"2023-10-14T12:34:44.753775+0000","last_fullsized":"2023-10-14T12:34:44.753775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:52.723651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765232+0000","last_change":"2023-10-14T12:34:44.763705+0000","last_active":"2023-10-14T12:34:45.765232+0000","last_peered":"2023-10-14T12:34:45.765232+0000","last_clean":"2023-10-14T12:34:45.765232+0000","last_became_active":"2023-10-14T12:34:44.763408+0000","last_became_peered":"2023-10-14T12:34:44.763408+0000","last_unstale":"2023-10-14T12:34:45.765232+0000","last_undegraded":"2023-10-14T12:34:45.765232+0000","last_fullsized":"2023-10-14T12:34:45.765232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:02.756175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750731+0000","last_change":"2023-10-14T12:34:43.734905+0000","last_active":"2023-10-14T12:34:44.750731+0000","last_peered":"2023-10-14T12:34:44.750731+0000","last_clean":"2023-10-14T12:34:44.750731+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:34:44.750731+0000","last_undegraded":"2023-10-14T12:34:44.750731+0000","last_fullsized":"2023-10-14T12:34:44.750731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836842+0000","last_change":"2023-10-14T12:34:44.764740+0000","last_active":"2023-10-14T12:34:45.836842+0000","last_peered":"2023-10-14T12:34:45.836842+0000","last_clean":"2023-10-14T12:34:45.836842+0000","last_became_active":"2023-10-14T12:34:44.764455+0000","last_became_peered":"2023-10-14T12:34:44.764455+0000","last_unstale":"2023-10-14T12:34:45.836842+0000","last_undegraded":"2023-10-14T12:34:45.836842+0000","last_fullsized":"2023-10-14T12:34:45.836842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779891+0000","last_change":"2023-10-14T12:34:43.735967+0000","last_active":"2023-10-14T12:34:44.779891+0000","last_peered":"2023-10-14T12:34:44.779891+0000","last_clean":"2023-10-14T12:34:44.779891+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:34:44.779891+0000","last_undegraded":"2023-10-14T12:34:44.779891+0000","last_fullsized":"2023-10-14T12:34:44.779891+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765386+0000","last_change":"2023-10-14T12:34:44.774548+0000","last_active":"2023-10-14T12:34:45.765386+0000","last_peered":"2023-10-14T12:34:45.765386+0000","last_clean":"2023-10-14T12:34:45.765386+0000","last_became_active":"2023-10-14T12:34:44.774253+0000","last_became_peered":"2023-10-14T12:34:44.774253+0000","last_unstale":"2023-10-14T12:34:45.765386+0000","last_undegraded":"2023-10-14T12:34:45.765386+0000","last_fullsized":"2023-10-14T12:34:45.765386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779429+0000","last_change":"2023-10-14T12:34:43.741443+0000","last_active":"2023-10-14T12:34:44.779429+0000","last_peered":"2023-10-14T12:34:44.779429+0000","last_clean":"2023-10-14T12:34:44.779429+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:34:44.779429+0000","last_undegraded":"2023-10-14T12:34:44.779429+0000","last_fullsized":"2023-10-14T12:34:44.779429+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:17.642741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836528+0000","last_change":"2023-10-14T12:34:44.766187+0000","last_active":"2023-10-14T12:34:45.836528+0000","last_peered":"2023-10-14T12:34:45.836528+0000","last_clean":"2023-10-14T12:34:45.836528+0000","last_became_active":"2023-10-14T12:34:44.765932+0000","last_became_peered":"2023-10-14T12:34:44.765932+0000","last_unstale":"2023-10-14T12:34:45.836528+0000","last_undegraded":"2023-10-14T12:34:45.836528+0000","last_fullsized":"2023-10-14T12:34:45.836528+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773813+0000","last_change":"2023-10-14T12:34:43.738642+0000","last_active":"2023-10-14T12:34:44.773813+0000","last_peered":"2023-10-14T12:34:44.773813+0000","last_clean":"2023-10-14T12:34:44.773813+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:34:44.773813+0000","last_undegraded":"2023-10-14T12:34:44.773813+0000","last_fullsized":"2023-10-14T12:34:44.773813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835518+0000","last_change":"2023-10-14T12:34:44.773042+0000","last_active":"2023-10-14T12:34:45.835518+0000","last_peered":"2023-10-14T12:34:45.835518+0000","last_clean":"2023-10-14T12:34:45.835518+0000","last_became_active":"2023-10-14T12:34:44.772662+0000","last_became_peered":"2023-10-14T12:34:44.772662+0000","last_unstale":"2023-10-14T12:34:45.835518+0000","last_undegraded":"2023-10-14T12:34:45.835518+0000","last_fullsized":"2023-10-14T12:34:45.835518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758499+0000","last_change":"2023-10-14T12:34:43.738291+0000","last_active":"2023-10-14T12:34:44.758499+0000","last_peered":"2023-10-14T12:34:44.758499+0000","last_clean":"2023-10-14T12:34:44.758499+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:34:44.758499+0000","last_undegraded":"2023-10-14T12:34:44.758499+0000","last_fullsized":"2023-10-14T12:34:44.758499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:28.347591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764881+0000","last_change":"2023-10-14T12:34:44.761488+0000","last_active":"2023-10-14T12:34:45.764881+0000","last_peered":"2023-10-14T12:34:45.764881+0000","last_clean":"2023-10-14T12:34:45.764881+0000","last_became_active":"2023-10-14T12:34:44.761153+0000","last_became_peered":"2023-10-14T12:34:44.761153+0000","last_unstale":"2023-10-14T12:34:45.764881+0000","last_undegraded":"2023-10-14T12:34:45.764881+0000","last_fullsized":"2023-10-14T12:34:45.764881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.755992+0000","last_change":"2023-10-14T12:34:43.742416+0000","last_active":"2023-10-14T12:34:44.755992+0000","last_peered":"2023-10-14T12:34:44.755992+0000","last_clean":"2023-10-14T12:34:44.755992+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:34:44.755992+0000","last_undegraded":"2023-10-14T12:34:44.755992+0000","last_fullsized":"2023-10-14T12:34:44.755992+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835631+0000","last_change":"2023-10-14T12:34:44.762671+0000","last_active":"2023-10-14T12:34:45.835631+0000","last_peered":"2023-10-14T12:34:45.835631+0000","last_clean":"2023-10-14T12:34:45.835631+0000","last_became_active":"2023-10-14T12:34:44.762396+0000","last_became_peered":"2023-10-14T12:34:44.762396+0000","last_unstale":"2023-10-14T12:34:45.835631+0000","last_undegraded":"2023-10-14T12:34:45.835631+0000","last_fullsized":"2023-10-14T12:34:45.835631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.777137+0000","last_change":"2023-10-14T12:34:43.745867+0000","last_active":"2023-10-14T12:34:44.777137+0000","last_peered":"2023-10-14T12:34:44.777137+0000","last_clean":"2023-10-14T12:34:44.777137+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:34:44.777137+0000","last_undegraded":"2023-10-14T12:34:44.777137+0000","last_fullsized":"2023-10-14T12:34:44.777137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835643+0000","last_change":"2023-10-14T12:34:44.761814+0000","last_active":"2023-10-14T12:34:45.835643+0000","last_peered":"2023-10-14T12:34:45.835643+0000","last_clean":"2023-10-14T12:34:45.835643+0000","last_became_active":"2023-10-14T12:34:44.761558+0000","last_became_peered":"2023-10-14T12:34:44.761558+0000","last_unstale":"2023-10-14T12:34:45.835643+0000","last_undegraded":"2023-10-14T12:34:45.835643+0000","last_fullsized":"2023-10-14T12:34:45.835643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775988+0000","last_change":"2023-10-14T12:34:43.743560+0000","last_active":"2023-10-14T12:34:44.775988+0000","last_peered":"2023-10-14T12:34:44.775988+0000","last_clean":"2023-10-14T12:34:44.775988+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:34:44.775988+0000","last_undegraded":"2023-10-14T12:34:44.775988+0000","last_fullsized":"2023-10-14T12:34:44.775988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:26.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764518+0000","last_change":"2023-10-14T12:34:44.766417+0000","last_active":"2023-10-14T12:34:45.764518+0000","last_peered":"2023-10-14T12:34:45.764518+0000","last_clean":"2023-10-14T12:34:45.764518+0000","last_became_active":"2023-10-14T12:34:44.766119+0000","last_became_peered":"2023-10-14T12:34:44.766119+0000","last_unstale":"2023-10-14T12:34:45.764518+0000","last_undegraded":"2023-10-14T12:34:45.764518+0000","last_fullsized":"2023-10-14T12:34:45.764518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775467+0000","last_change":"2023-10-14T12:34:43.738033+0000","last_active":"2023-10-14T12:34:44.775467+0000","last_peered":"2023-10-14T12:34:44.775467+0000","last_clean":"2023-10-14T12:34:44.775467+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:34:44.775467+0000","last_undegraded":"2023-10-14T12:34:44.775467+0000","last_fullsized":"2023-10-14T12:34:44.775467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765588+0000","last_change":"2023-10-14T12:34:44.775797+0000","last_active":"2023-10-14T12:34:45.765588+0000","last_peered":"2023-10-14T12:34:45.765588+0000","last_clean":"2023-10-14T12:34:45.765588+0000","last_became_active":"2023-10-14T12:34:44.775417+0000","last_became_peered":"2023-10-14T12:34:44.775417+0000","last_unstale":"2023-10-14T12:34:45.765588+0000","last_undegraded":"2023-10-14T12:34:45.765588+0000","last_fullsized":"2023-10-14T12:34:45.765588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775680+0000","last_change":"2023-10-14T12:34:43.744197+0000","last_active":"2023-10-14T12:34:44.775680+0000","last_peered":"2023-10-14T12:34:44.775680+0000","last_clean":"2023-10-14T12:34:44.775680+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:34:44.775680+0000","last_undegraded":"2023-10-14T12:34:44.775680+0000","last_fullsized":"2023-10-14T12:34:44.775680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:53.838278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836010+0000","last_change":"2023-10-14T12:34:44.770567+0000","last_active":"2023-10-14T12:34:45.836010+0000","last_peered":"2023-10-14T12:34:45.836010+0000","last_clean":"2023-10-14T12:34:45.836010+0000","last_became_active":"2023-10-14T12:34:44.768157+0000","last_became_peered":"2023-10-14T12:34:44.768157+0000","last_unstale":"2023-10-14T12:34:45.836010+0000","last_undegraded":"2023-10-14T12:34:45.836010+0000","last_fullsized":"2023-10-14T12:34:45.836010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:05.274311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756934+0000","last_change":"2023-10-14T12:34:43.739053+0000","last_active":"2023-10-14T12:34:44.756934+0000","last_peered":"2023-10-14T12:34:44.756934+0000","last_clean":"2023-10-14T12:34:44.756934+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:34:44.756934+0000","last_undegraded":"2023-10-14T12:34:44.756934+0000","last_fullsized":"2023-10-14T12:34:44.756934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765656+0000","last_change":"2023-10-14T12:34:44.768620+0000","last_active":"2023-10-14T12:34:45.765656+0000","last_peered":"2023-10-14T12:34:45.765656+0000","last_clean":"2023-10-14T12:34:45.765656+0000","last_became_active":"2023-10-14T12:34:44.768087+0000","last_became_peered":"2023-10-14T12:34:44.768087+0000","last_unstale":"2023-10-14T12:34:45.765656+0000","last_undegraded":"2023-10-14T12:34:45.765656+0000","last_fullsized":"2023-10-14T12:34:45.765656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.769614+0000","last_change":"2023-10-14T12:34:43.739027+0000","last_active":"2023-10-14T12:34:44.769614+0000","last_peered":"2023-10-14T12:34:44.769614+0000","last_clean":"2023-10-14T12:34:44.769614+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:34:44.769614+0000","last_undegraded":"2023-10-14T12:34:44.769614+0000","last_fullsized":"2023-10-14T12:34:44.769614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:18.085129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836679+0000","last_change":"2023-10-14T12:34:44.761072+0000","last_active":"2023-10-14T12:34:45.836679+0000","last_peered":"2023-10-14T12:34:45.836679+0000","last_clean":"2023-10-14T12:34:45.836679+0000","last_became_active":"2023-10-14T12:34:44.760736+0000","last_became_peered":"2023-10-14T12:34:44.760736+0000","last_unstale":"2023-10-14T12:34:45.836679+0000","last_undegraded":"2023-10-14T12:34:45.836679+0000","last_fullsized":"2023-10-14T12:34:45.836679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.759860+0000","last_change":"2023-10-14T12:34:43.739164+0000","last_active":"2023-10-14T12:34:44.759860+0000","last_peered":"2023-10-14T12:34:44.759860+0000","last_clean":"2023-10-14T12:34:44.759860+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:34:44.759860+0000","last_undegraded":"2023-10-14T12:34:44.759860+0000","last_fullsized":"2023-10-14T12:34:44.759860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:58.156116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764254+0000","last_change":"2023-10-14T12:34:44.764345+0000","last_active":"2023-10-14T12:34:45.764254+0000","last_peered":"2023-10-14T12:34:45.764254+0000","last_clean":"2023-10-14T12:34:45.764254+0000","last_became_active":"2023-10-14T12:34:44.764069+0000","last_became_peered":"2023-10-14T12:34:44.764069+0000","last_unstale":"2023-10-14T12:34:45.764254+0000","last_undegraded":"2023-10-14T12:34:45.764254+0000","last_fullsized":"2023-10-14T12:34:45.764254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.751773+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:44.751773+0000","last_peered":"2023-10-14T12:34:44.751773+0000","last_clean":"2023-10-14T12:34:44.751773+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:44.751773+0000","last_undegraded":"2023-10-14T12:34:44.751773+0000","last_fullsized":"2023-10-14T12:34:44.751773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835883+0000","last_change":"2023-10-14T12:34:44.768053+0000","last_active":"2023-10-14T12:34:45.835883+0000","last_peered":"2023-10-14T12:34:45.835883+0000","last_clean":"2023-10-14T12:34:45.835883+0000","last_became_active":"2023-10-14T12:34:44.767802+0000","last_became_peered":"2023-10-14T12:34:44.767802+0000","last_unstale":"2023-10-14T12:34:45.835883+0000","last_undegraded":"2023-10-14T12:34:45.835883+0000","last_fullsized":"2023-10-14T12:34:45.835883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757835+0000","last_change":"2023-10-14T12:34:43.737529+0000","last_active":"2023-10-14T12:34:44.757835+0000","last_peered":"2023-10-14T12:34:44.757835+0000","last_clean":"2023-10-14T12:34:44.757835+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:34:44.757835+0000","last_undegraded":"2023-10-14T12:34:44.757835+0000","last_fullsized":"2023-10-14T12:34:44.757835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:30:56.810287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835146+0000","last_change":"2023-10-14T12:34:44.768491+0000","last_active":"2023-10-14T12:34:45.835146+0000","last_peered":"2023-10-14T12:34:45.835146+0000","last_clean":"2023-10-14T12:34:45.835146+0000","last_became_active":"2023-10-14T12:34:44.768177+0000","last_became_peered":"2023-10-14T12:34:44.768177+0000","last_unstale":"2023-10-14T12:34:45.835146+0000","last_undegraded":"2023-10-14T12:34:45.835146+0000","last_fullsized":"2023-10-14T12:34:45.835146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779481+0000","last_change":"2023-10-14T12:34:43.735693+0000","last_active":"2023-10-14T12:34:44.779481+0000","last_peered":"2023-10-14T12:34:44.779481+0000","last_clean":"2023-10-14T12:34:44.779481+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:34:44.779481+0000","last_undegraded":"2023-10-14T12:34:44.779481+0000","last_fullsized":"2023-10-14T12:34:44.779481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765390+0000","last_change":"2023-10-14T12:34:44.761812+0000","last_active":"2023-10-14T12:34:45.765390+0000","last_peered":"2023-10-14T12:34:45.765390+0000","last_clean":"2023-10-14T12:34:45.765390+0000","last_became_active":"2023-10-14T12:34:44.761519+0000","last_became_peered":"2023-10-14T12:34:44.761519+0000","last_unstale":"2023-10-14T12:34:45.765390+0000","last_undegraded":"2023-10-14T12:34:45.765390+0000","last_fullsized":"2023-10-14T12:34:45.765390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835973+0000","last_change":"2023-10-14T12:34:43.735820+0000","last_active":"2023-10-14T12:34:45.835973+0000","last_peered":"2023-10-14T12:34:45.835973+0000","last_clean":"2023-10-14T12:34:45.835973+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:34:45.835973+0000","last_undegraded":"2023-10-14T12:34:45.835973+0000","last_fullsized":"2023-10-14T12:34:45.835973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:56.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835989+0000","last_change":"2023-10-14T12:34:44.776057+0000","last_active":"2023-10-14T12:34:45.835989+0000","last_peered":"2023-10-14T12:34:45.835989+0000","last_clean":"2023-10-14T12:34:45.835989+0000","last_became_active":"2023-10-14T12:34:44.775820+0000","last_became_peered":"2023-10-14T12:34:44.775820+0000","last_unstale":"2023-10-14T12:34:45.835989+0000","last_undegraded":"2023-10-14T12:34:45.835989+0000","last_fullsized":"2023-10-14T12:34:45.835989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758094+0000","last_change":"2023-10-14T12:34:43.736834+0000","last_active":"2023-10-14T12:34:44.758094+0000","last_peered":"2023-10-14T12:34:44.758094+0000","last_clean":"2023-10-14T12:34:44.758094+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:34:44.758094+0000","last_undegraded":"2023-10-14T12:34:44.758094+0000","last_fullsized":"2023-10-14T12:34:44.758094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:43.074134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836529+0000","last_change":"2023-10-14T12:34:44.769426+0000","last_active":"2023-10-14T12:34:45.836529+0000","last_peered":"2023-10-14T12:34:45.836529+0000","last_clean":"2023-10-14T12:34:45.836529+0000","last_became_active":"2023-10-14T12:34:44.769173+0000","last_became_peered":"2023-10-14T12:34:44.769173+0000","last_unstale":"2023-10-14T12:34:45.836529+0000","last_undegraded":"2023-10-14T12:34:45.836529+0000","last_fullsized":"2023-10-14T12:34:45.836529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757464+0000","last_change":"2023-10-14T12:34:43.737030+0000","last_active":"2023-10-14T12:34:44.757464+0000","last_peered":"2023-10-14T12:34:44.757464+0000","last_clean":"2023-10-14T12:34:44.757464+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:34:44.757464+0000","last_undegraded":"2023-10-14T12:34:44.757464+0000","last_fullsized":"2023-10-14T12:34:44.757464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835225+0000","last_change":"2023-10-14T12:34:44.763379+0000","last_active":"2023-10-14T12:34:45.835225+0000","last_peered":"2023-10-14T12:34:45.835225+0000","last_clean":"2023-10-14T12:34:45.835225+0000","last_became_active":"2023-10-14T12:34:44.763069+0000","last_became_peered":"2023-10-14T12:34:44.763069+0000","last_unstale":"2023-10-14T12:34:45.835225+0000","last_undegraded":"2023-10-14T12:34:45.835225+0000","last_fullsized":"2023-10-14T12:34:45.835225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756075+0000","last_change":"2023-10-14T12:34:43.740716+0000","last_active":"2023-10-14T12:34:44.756075+0000","last_peered":"2023-10-14T12:34:44.756075+0000","last_clean":"2023-10-14T12:34:44.756075+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:34:44.756075+0000","last_undegraded":"2023-10-14T12:34:44.756075+0000","last_fullsized":"2023-10-14T12:34:44.756075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.766013+0000","last_change":"2023-10-14T12:34:44.769837+0000","last_active":"2023-10-14T12:34:45.766013+0000","last_peered":"2023-10-14T12:34:45.766013+0000","last_clean":"2023-10-14T12:34:45.766013+0000","last_became_active":"2023-10-14T12:34:44.769543+0000","last_became_peered":"2023-10-14T12:34:44.769543+0000","last_unstale":"2023-10-14T12:34:45.766013+0000","last_undegraded":"2023-10-14T12:34:45.766013+0000","last_fullsized":"2023-10-14T12:34:45.766013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758262+0000","last_change":"2023-10-14T12:34:43.738818+0000","last_active":"2023-10-14T12:34:44.758262+0000","last_peered":"2023-10-14T12:34:44.758262+0000","last_clean":"2023-10-14T12:34:44.758262+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:34:44.758262+0000","last_undegraded":"2023-10-14T12:34:44.758262+0000","last_fullsized":"2023-10-14T12:34:44.758262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:21.861042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765067+0000","last_change":"2023-10-14T12:34:44.764824+0000","last_active":"2023-10-14T12:34:45.765067+0000","last_peered":"2023-10-14T12:34:45.765067+0000","last_clean":"2023-10-14T12:34:45.765067+0000","last_became_active":"2023-10-14T12:34:44.764567+0000","last_became_peered":"2023-10-14T12:34:44.764567+0000","last_unstale":"2023-10-14T12:34:45.765067+0000","last_undegraded":"2023-10-14T12:34:45.765067+0000","last_fullsized":"2023-10-14T12:34:45.765067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:53.725438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752091+0000","last_change":"2023-10-14T12:34:43.733187+0000","last_active":"2023-10-14T12:34:44.752091+0000","last_peered":"2023-10-14T12:34:44.752091+0000","last_clean":"2023-10-14T12:34:44.752091+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:34:44.752091+0000","last_undegraded":"2023-10-14T12:34:44.752091+0000","last_fullsized":"2023-10-14T12:34:44.752091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765866+0000","last_change":"2023-10-14T12:34:44.767412+0000","last_active":"2023-10-14T12:34:45.765866+0000","last_peered":"2023-10-14T12:34:45.765866+0000","last_clean":"2023-10-14T12:34:45.765866+0000","last_became_active":"2023-10-14T12:34:44.766080+0000","last_became_peered":"2023-10-14T12:34:44.766080+0000","last_unstale":"2023-10-14T12:34:45.765866+0000","last_undegraded":"2023-10-14T12:34:45.765866+0000","last_fullsized":"2023-10-14T12:34:45.765866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:41.477384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752465+0000","last_change":"2023-10-14T12:34:43.744939+0000","last_active":"2023-10-14T12:34:44.752465+0000","last_peered":"2023-10-14T12:34:44.752465+0000","last_clean":"2023-10-14T12:34:44.752465+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:34:44.752465+0000","last_undegraded":"2023-10-14T12:34:44.752465+0000","last_fullsized":"2023-10-14T12:34:44.752465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:42.271784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750684+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:34:44.750684+0000","last_peered":"2023-10-14T12:34:44.750684+0000","last_clean":"2023-10-14T12:34:44.750684+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:34:44.750684+0000","last_undegraded":"2023-10-14T12:34:44.750684+0000","last_fullsized":"2023-10-14T12:34:44.750684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.626}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67800000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.45700000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46999999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.34799999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.37},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45200000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.434},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.379}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":779658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.37}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.437}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.26100000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":190902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.64400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.44700000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.48399999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.623},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.71799999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54300000000000004}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:34:58.038 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T12:34:58.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:34:58.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.190+0000 7f3bfd149700 1 Processor -- start 2023-10-14T12:34:58.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.190+0000 7f3bfd149700 1 -- start start 2023-10-14T12:34:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.190+0000 7f3bfd149700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf815a240 0x7f3bf815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.190+0000 7f3bfd149700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bf80b1bd0 0x7f3bf80b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.190+0000 7f3bfd149700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf815e830 con 0x7f3bf815e390 2023-10-14T12:34:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.190+0000 7f3bfd149700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf815edf0 con 0x7f3bf80b1bd0 2023-10-14T12:34:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.190+0000 7f3bfd149700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80b2580 con 0x7f3bf815a240 2023-10-14T12:34:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bf80b1bd0 0x7f3bf80b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bf80b1bd0 0x7f3bf80b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48914/0 (socket says 172.21.15.72:48914) 2023-10-14T12:34:58.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf759e700 1 -- 172.21.15.72:0/2561756432 learned_addr learned my addr 172.21.15.72:0/2561756432 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:58.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf6d9d700 1 --2- 172.21.15.72:0/2561756432 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf815a240 0x7f3bf815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf759e700 1 -- 172.21.15.72:0/2561756432 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf815a240 msgr2=0x7f3bf815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:58.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf759e700 1 --2- 172.21.15.72:0/2561756432 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf815a240 0x7f3bf815de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf759e700 1 -- 172.21.15.72:0/2561756432 >> v1:172.21.15.123:6789/0 conn(0x7f3bf815e390 legacy=0x7f3bf80724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:58.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf759e700 1 -- 172.21.15.72:0/2561756432 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf815eb10 con 0x7f3bf80b1bd0 2023-10-14T12:34:58.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf759e700 1 --2- 172.21.15.72:0/2561756432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf80b1bd0 0x7f3bf80b2040 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009e80 tx=0x7f3bf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0394f64a43518af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:58.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf5d9b700 1 -- 172.21.15.72:0/2561756432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000e070 con 0x7f3bf80b1bd0 2023-10-14T12:34:58.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf5d9b700 1 -- 172.21.15.72:0/2561756432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf0003a20 con 0x7f3bf80b1bd0 2023-10-14T12:34:58.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.191+0000 7f3bf5d9b700 1 -- 172.21.15.72:0/2561756432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0003dd0 con 0x7f3bf80b1bd0 2023-10-14T12:34:58.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.192+0000 7f3bfd149700 1 -- 172.21.15.72:0/2561756432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf80b1bd0 msgr2=0x7f3bf80b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.192+0000 7f3bfd149700 1 --2- 172.21.15.72:0/2561756432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf80b1bd0 0x7f3bf80b2040 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0009e80 tx=0x7f3bf000b330 comp rx=0 tx=0).stop 2023-10-14T12:34:58.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.192+0000 7f3bfd149700 1 -- 172.21.15.72:0/2561756432 shutdown_connections 2023-10-14T12:34:58.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.192+0000 7f3bfd149700 1 --2- 172.21.15.72:0/2561756432 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf815a240 0x7f3bf815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.192+0000 7f3bfd149700 1 --2- 172.21.15.72:0/2561756432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf80b1bd0 0x7f3bf80b2040 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.192+0000 7f3bfd149700 1 -- 172.21.15.72:0/2561756432 >> 172.21.15.72:0/2561756432 conn(0x7f3bf806bd50 msgr2=0x7f3bf806c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:58.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.192+0000 7f3bfd149700 1 -- 172.21.15.72:0/2561756432 shutdown_connections 2023-10-14T12:34:58.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.192+0000 7f3bfd149700 1 -- 172.21.15.72:0/2561756432 wait complete. 2023-10-14T12:34:58.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.193+0000 7f3bfd149700 1 Processor -- start 2023-10-14T12:34:58.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.193+0000 7f3bfd149700 1 -- start start 2023-10-14T12:34:58.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bfd149700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf80b1bd0 0x7f3bf8155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bfd149700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bf815a240 0x7f3bf80d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bfd149700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf815e390 0x7f3bf80d0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bfd149700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80c7330 con 0x7f3bf815e390 2023-10-14T12:34:58.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bfd149700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80c7610 con 0x7f3bf815a240 2023-10-14T12:34:58.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bfd149700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80c78f0 con 0x7f3bf80b1bd0 2023-10-14T12:34:58.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf815e390 0x7f3bf80d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf815e390 0x7f3bf80d0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48918/0 (socket says 172.21.15.72:48918) 2023-10-14T12:34:58.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf759e700 1 -- 172.21.15.72:0/1830684493 learned_addr learned my addr 172.21.15.72:0/1830684493 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:58.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf659c700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bf815a240 0x7f3bf80d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf6d9d700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf80b1bd0 0x7f3bf8155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf759e700 1 -- 172.21.15.72:0/1830684493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf80b1bd0 msgr2=0x7f3bf8155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf759e700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf80b1bd0 0x7f3bf8155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf759e700 1 -- 172.21.15.72:0/1830684493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bf815a240 msgr2=0x7f3bf80d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf759e700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bf815a240 0x7f3bf80d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf759e700 1 -- 172.21.15.72:0/1830684493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf0009b30 con 0x7f3bf815e390 2023-10-14T12:34:58.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf6d9d700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf80b1bd0 0x7f3bf8155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:34:58.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.194+0000 7f3bf759e700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf815e390 0x7f3bf80d0590 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0015040 tx=0x7f3bf0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:58.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.195+0000 7f3bdf7fe700 1 -- 172.21.15.72:0/1830684493 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0004440 con 0x7f3bf815e390 2023-10-14T12:34:58.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.195+0000 7f3bdf7fe700 1 -- 172.21.15.72:0/1830684493 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf00045a0 con 0x7f3bf815e390 2023-10-14T12:34:58.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.195+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf80c7bd0 con 0x7f3bf815e390 2023-10-14T12:34:58.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.195+0000 7f3bdf7fe700 1 -- 172.21.15.72:0/1830684493 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0004950 con 0x7f3bf815e390 2023-10-14T12:34:58.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.195+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf80b54f0 con 0x7f3bf815e390 2023-10-14T12:34:58.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.196+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf80c8090 con 0x7f3bf815e390 2023-10-14T12:34:58.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.196+0000 7f3bdf7fe700 1 -- 172.21.15.72:0/1830684493 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3bf0012430 con 0x7f3bf815e390 2023-10-14T12:34:58.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.197+0000 7f3bdf7fe700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3be406af00 0x7f3be406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.197+0000 7f3bf6d9d700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3be406af00 0x7f3be406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.197+0000 7f3bdf7fe700 1 -- 172.21.15.72:0/1830684493 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f3bf008abb0 con 0x7f3bf815e390 2023-10-14T12:34:58.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.197+0000 7f3bf6d9d700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3be406af00 0x7f3be406d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3be800aa50 tx=0x7f3be8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:58.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.201+0000 7f3bdf7fe700 1 -- 172.21.15.72:0/1830684493 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3bf0059620 con 0x7f3bf815e390 2023-10-14T12:34:58.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.384+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3bf8071f80 con 0x7f3be406af00 2023-10-14T12:34:58.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.392+0000 7f3bdf7fe700 1 -- 172.21.15.72:0/1830684493 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288747 (secure 0 0 0) 0x7f3be800a720 con 0x7f3be406af00 2023-10-14T12:34:58.396 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3be406af00 msgr2=0x7f3be406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3be406af00 0x7f3be406d3c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3be800aa50 tx=0x7f3be8008040 comp rx=0 tx=0).stop 2023-10-14T12:34:58.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf815e390 msgr2=0x7f3bf80d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf815e390 0x7f3bf80d0590 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0015040 tx=0x7f3bf0004ad0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 shutdown_connections 2023-10-14T12:34:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3be406af00 0x7f3be406d3c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bf815e390 0x7f3bf80d0590 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3bf80b1bd0 0x7f3bf8155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 --2- 172.21.15.72:0/1830684493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bf815a240 0x7f3bf80d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 >> 172.21.15.72:0/1830684493 conn(0x7f3bf806bd50 msgr2=0x7f3bf80cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:58.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 shutdown_connections 2023-10-14T12:34:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.395+0000 7f3bfd149700 1 -- 172.21.15.72:0/1830684493 wait complete. 2023-10-14T12:34:58.402 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:34:58.408 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2023-10-14T12:34:57.402496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220856,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753864,"statfs":{"total":773094113280,"available":772867956736,"internally_reserved":0,"allocated":4759552,"data_stored":2699604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.640399"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836180+0000","last_change":"2023-10-14T12:34:44.773258+0000","last_active":"2023-10-14T12:34:45.836180+0000","last_peered":"2023-10-14T12:34:45.836180+0000","last_clean":"2023-10-14T12:34:45.836180+0000","last_became_active":"2023-10-14T12:34:44.772874+0000","last_became_peered":"2023-10-14T12:34:44.772874+0000","last_unstale":"2023-10-14T12:34:45.836180+0000","last_undegraded":"2023-10-14T12:34:45.836180+0000","last_fullsized":"2023-10-14T12:34:45.836180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835866+0000","last_change":"2023-10-14T12:34:44.766065+0000","last_active":"2023-10-14T12:34:45.835866+0000","last_peered":"2023-10-14T12:34:45.835866+0000","last_clean":"2023-10-14T12:34:45.835866+0000","last_became_active":"2023-10-14T12:34:44.765783+0000","last_became_peered":"2023-10-14T12:34:44.765783+0000","last_unstale":"2023-10-14T12:34:45.835866+0000","last_undegraded":"2023-10-14T12:34:45.835866+0000","last_fullsized":"2023-10-14T12:34:45.835866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836798+0000","last_change":"2023-10-14T12:34:44.766216+0000","last_active":"2023-10-14T12:34:45.836798+0000","last_peered":"2023-10-14T12:34:45.836798+0000","last_clean":"2023-10-14T12:34:45.836798+0000","last_became_active":"2023-10-14T12:34:44.765915+0000","last_became_peered":"2023-10-14T12:34:44.765915+0000","last_unstale":"2023-10-14T12:34:45.836798+0000","last_undegraded":"2023-10-14T12:34:45.836798+0000","last_fullsized":"2023-10-14T12:34:45.836798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835634+0000","last_change":"2023-10-14T12:34:44.776783+0000","last_active":"2023-10-14T12:34:45.835634+0000","last_peered":"2023-10-14T12:34:45.835634+0000","last_clean":"2023-10-14T12:34:45.835634+0000","last_became_active":"2023-10-14T12:34:44.776527+0000","last_became_peered":"2023-10-14T12:34:44.776527+0000","last_unstale":"2023-10-14T12:34:45.835634+0000","last_undegraded":"2023-10-14T12:34:45.835634+0000","last_fullsized":"2023-10-14T12:34:45.835634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:10.476396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835368+0000","last_change":"2023-10-14T12:34:44.774798+0000","last_active":"2023-10-14T12:34:45.835368+0000","last_peered":"2023-10-14T12:34:45.835368+0000","last_clean":"2023-10-14T12:34:45.835368+0000","last_became_active":"2023-10-14T12:34:44.774508+0000","last_became_peered":"2023-10-14T12:34:44.774508+0000","last_unstale":"2023-10-14T12:34:45.835368+0000","last_undegraded":"2023-10-14T12:34:45.835368+0000","last_fullsized":"2023-10-14T12:34:45.835368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.842813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835002+0000","last_change":"2023-10-14T12:34:44.771286+0000","last_active":"2023-10-14T12:34:45.835002+0000","last_peered":"2023-10-14T12:34:45.835002+0000","last_clean":"2023-10-14T12:34:45.835002+0000","last_became_active":"2023-10-14T12:34:44.768717+0000","last_became_peered":"2023-10-14T12:34:44.768717+0000","last_unstale":"2023-10-14T12:34:45.835002+0000","last_undegraded":"2023-10-14T12:34:45.835002+0000","last_fullsized":"2023-10-14T12:34:45.835002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764118+0000","last_change":"2023-10-14T12:34:44.771173+0000","last_active":"2023-10-14T12:34:45.764118+0000","last_peered":"2023-10-14T12:34:45.764118+0000","last_clean":"2023-10-14T12:34:45.764118+0000","last_became_active":"2023-10-14T12:34:44.770869+0000","last_became_peered":"2023-10-14T12:34:44.770869+0000","last_unstale":"2023-10-14T12:34:45.764118+0000","last_undegraded":"2023-10-14T12:34:45.764118+0000","last_fullsized":"2023-10-14T12:34:45.764118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835912+0000","last_change":"2023-10-14T12:34:44.766306+0000","last_active":"2023-10-14T12:34:45.835912+0000","last_peered":"2023-10-14T12:34:45.835912+0000","last_clean":"2023-10-14T12:34:45.835912+0000","last_became_active":"2023-10-14T12:34:44.765917+0000","last_became_peered":"2023-10-14T12:34:44.765917+0000","last_unstale":"2023-10-14T12:34:45.835912+0000","last_undegraded":"2023-10-14T12:34:45.835912+0000","last_fullsized":"2023-10-14T12:34:45.835912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836985+0000","last_change":"2023-10-14T12:34:44.769040+0000","last_active":"2023-10-14T12:34:45.836985+0000","last_peered":"2023-10-14T12:34:45.836985+0000","last_clean":"2023-10-14T12:34:45.836985+0000","last_became_active":"2023-10-14T12:34:44.768514+0000","last_became_peered":"2023-10-14T12:34:44.768514+0000","last_unstale":"2023-10-14T12:34:45.836985+0000","last_undegraded":"2023-10-14T12:34:45.836985+0000","last_fullsized":"2023-10-14T12:34:45.836985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765522+0000","last_change":"2023-10-14T12:34:44.764554+0000","last_active":"2023-10-14T12:34:45.765522+0000","last_peered":"2023-10-14T12:34:45.765522+0000","last_clean":"2023-10-14T12:34:45.765522+0000","last_became_active":"2023-10-14T12:34:44.764252+0000","last_became_peered":"2023-10-14T12:34:44.764252+0000","last_unstale":"2023-10-14T12:34:45.765522+0000","last_undegraded":"2023-10-14T12:34:45.765522+0000","last_fullsized":"2023-10-14T12:34:45.765522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:36.689643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764651+0000","last_change":"2023-10-14T12:34:44.776394+0000","last_active":"2023-10-14T12:34:45.764651+0000","last_peered":"2023-10-14T12:34:45.764651+0000","last_clean":"2023-10-14T12:34:45.764651+0000","last_became_active":"2023-10-14T12:34:44.775897+0000","last_became_peered":"2023-10-14T12:34:44.775897+0000","last_unstale":"2023-10-14T12:34:45.764651+0000","last_undegraded":"2023-10-14T12:34:45.764651+0000","last_fullsized":"2023-10-14T12:34:45.764651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836748+0000","last_change":"2023-10-14T12:34:44.766520+0000","last_active":"2023-10-14T12:34:45.836748+0000","last_peered":"2023-10-14T12:34:45.836748+0000","last_clean":"2023-10-14T12:34:45.836748+0000","last_became_active":"2023-10-14T12:34:44.766208+0000","last_became_peered":"2023-10-14T12:34:44.766208+0000","last_unstale":"2023-10-14T12:34:45.836748+0000","last_undegraded":"2023-10-14T12:34:45.836748+0000","last_fullsized":"2023-10-14T12:34:45.836748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764453+0000","last_change":"2023-10-14T12:34:44.767161+0000","last_active":"2023-10-14T12:34:45.764453+0000","last_peered":"2023-10-14T12:34:45.764453+0000","last_clean":"2023-10-14T12:34:45.764453+0000","last_became_active":"2023-10-14T12:34:44.766602+0000","last_became_peered":"2023-10-14T12:34:44.766602+0000","last_unstale":"2023-10-14T12:34:45.764453+0000","last_undegraded":"2023-10-14T12:34:45.764453+0000","last_fullsized":"2023-10-14T12:34:45.764453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765845+0000","last_change":"2023-10-14T12:34:44.770652+0000","last_active":"2023-10-14T12:34:45.765845+0000","last_peered":"2023-10-14T12:34:45.765845+0000","last_clean":"2023-10-14T12:34:45.765845+0000","last_became_active":"2023-10-14T12:34:44.770368+0000","last_became_peered":"2023-10-14T12:34:44.770368+0000","last_unstale":"2023-10-14T12:34:45.765845+0000","last_undegraded":"2023-10-14T12:34:45.765845+0000","last_fullsized":"2023-10-14T12:34:45.765845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.763799+0000","last_change":"2023-10-14T12:34:44.764695+0000","last_active":"2023-10-14T12:34:45.763799+0000","last_peered":"2023-10-14T12:34:45.763799+0000","last_clean":"2023-10-14T12:34:45.763799+0000","last_became_active":"2023-10-14T12:34:44.763083+0000","last_became_peered":"2023-10-14T12:34:44.763083+0000","last_unstale":"2023-10-14T12:34:45.763799+0000","last_undegraded":"2023-10-14T12:34:45.763799+0000","last_fullsized":"2023-10-14T12:34:45.763799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765533+0000","last_change":"2023-10-14T12:34:44.768707+0000","last_active":"2023-10-14T12:34:45.765533+0000","last_peered":"2023-10-14T12:34:45.765533+0000","last_clean":"2023-10-14T12:34:45.765533+0000","last_became_active":"2023-10-14T12:34:44.768474+0000","last_became_peered":"2023-10-14T12:34:44.768474+0000","last_unstale":"2023-10-14T12:34:45.765533+0000","last_undegraded":"2023-10-14T12:34:45.765533+0000","last_fullsized":"2023-10-14T12:34:45.765533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765794+0000","last_change":"2023-10-14T12:34:44.771432+0000","last_active":"2023-10-14T12:34:45.765794+0000","last_peered":"2023-10-14T12:34:45.765794+0000","last_clean":"2023-10-14T12:34:45.765794+0000","last_became_active":"2023-10-14T12:34:44.771158+0000","last_became_peered":"2023-10-14T12:34:44.771158+0000","last_unstale":"2023-10-14T12:34:45.765794+0000","last_undegraded":"2023-10-14T12:34:45.765794+0000","last_fullsized":"2023-10-14T12:34:45.765794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835519+0000","last_change":"2023-10-14T12:34:44.776578+0000","last_active":"2023-10-14T12:34:45.835519+0000","last_peered":"2023-10-14T12:34:45.835519+0000","last_clean":"2023-10-14T12:34:45.835519+0000","last_became_active":"2023-10-14T12:34:44.776263+0000","last_became_peered":"2023-10-14T12:34:44.776263+0000","last_unstale":"2023-10-14T12:34:45.835519+0000","last_undegraded":"2023-10-14T12:34:45.835519+0000","last_fullsized":"2023-10-14T12:34:45.835519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835662+0000","last_change":"2023-10-14T12:34:44.767374+0000","last_active":"2023-10-14T12:34:45.835662+0000","last_peered":"2023-10-14T12:34:45.835662+0000","last_clean":"2023-10-14T12:34:45.835662+0000","last_became_active":"2023-10-14T12:34:44.767035+0000","last_became_peered":"2023-10-14T12:34:44.767035+0000","last_unstale":"2023-10-14T12:34:45.835662+0000","last_undegraded":"2023-10-14T12:34:45.835662+0000","last_fullsized":"2023-10-14T12:34:45.835662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:06.799411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835300+0000","last_change":"2023-10-14T12:34:44.775911+0000","last_active":"2023-10-14T12:34:45.835300+0000","last_peered":"2023-10-14T12:34:45.835300+0000","last_clean":"2023-10-14T12:34:45.835300+0000","last_became_active":"2023-10-14T12:34:44.775453+0000","last_became_peered":"2023-10-14T12:34:44.775453+0000","last_unstale":"2023-10-14T12:34:45.835300+0000","last_undegraded":"2023-10-14T12:34:45.835300+0000","last_fullsized":"2023-10-14T12:34:45.835300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:37.110615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764577+0000","last_change":"2023-10-14T12:34:44.766571+0000","last_active":"2023-10-14T12:34:45.764577+0000","last_peered":"2023-10-14T12:34:45.764577+0000","last_clean":"2023-10-14T12:34:45.764577+0000","last_became_active":"2023-10-14T12:34:44.766299+0000","last_became_peered":"2023-10-14T12:34:44.766299+0000","last_unstale":"2023-10-14T12:34:45.764577+0000","last_undegraded":"2023-10-14T12:34:45.764577+0000","last_fullsized":"2023-10-14T12:34:45.764577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765865+0000","last_change":"2023-10-14T12:34:44.770392+0000","last_active":"2023-10-14T12:34:45.765865+0000","last_peered":"2023-10-14T12:34:45.765865+0000","last_clean":"2023-10-14T12:34:45.765865+0000","last_became_active":"2023-10-14T12:34:44.770033+0000","last_became_peered":"2023-10-14T12:34:44.770033+0000","last_unstale":"2023-10-14T12:34:45.765865+0000","last_undegraded":"2023-10-14T12:34:45.765865+0000","last_fullsized":"2023-10-14T12:34:45.765865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765576+0000","last_change":"2023-10-14T12:34:44.768259+0000","last_active":"2023-10-14T12:34:45.765576+0000","last_peered":"2023-10-14T12:34:45.765576+0000","last_clean":"2023-10-14T12:34:45.765576+0000","last_became_active":"2023-10-14T12:34:44.767967+0000","last_became_peered":"2023-10-14T12:34:44.767967+0000","last_unstale":"2023-10-14T12:34:45.765576+0000","last_undegraded":"2023-10-14T12:34:45.765576+0000","last_fullsized":"2023-10-14T12:34:45.765576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835233+0000","last_change":"2023-10-14T12:34:44.770347+0000","last_active":"2023-10-14T12:34:45.835233+0000","last_peered":"2023-10-14T12:34:45.835233+0000","last_clean":"2023-10-14T12:34:45.835233+0000","last_became_active":"2023-10-14T12:34:44.768304+0000","last_became_peered":"2023-10-14T12:34:44.768304+0000","last_unstale":"2023-10-14T12:34:45.835233+0000","last_undegraded":"2023-10-14T12:34:45.835233+0000","last_fullsized":"2023-10-14T12:34:45.835233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:27:07.068125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835441+0000","last_change":"2023-10-14T12:34:44.764335+0000","last_active":"2023-10-14T12:34:45.835441+0000","last_peered":"2023-10-14T12:34:45.835441+0000","last_clean":"2023-10-14T12:34:45.835441+0000","last_became_active":"2023-10-14T12:34:44.764072+0000","last_became_peered":"2023-10-14T12:34:44.764072+0000","last_unstale":"2023-10-14T12:34:45.835441+0000","last_undegraded":"2023-10-14T12:34:45.835441+0000","last_fullsized":"2023-10-14T12:34:45.835441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835405+0000","last_change":"2023-10-14T12:34:44.768012+0000","last_active":"2023-10-14T12:34:45.835405+0000","last_peered":"2023-10-14T12:34:45.835405+0000","last_clean":"2023-10-14T12:34:45.835405+0000","last_became_active":"2023-10-14T12:34:44.767743+0000","last_became_peered":"2023-10-14T12:34:44.767743+0000","last_unstale":"2023-10-14T12:34:45.835405+0000","last_undegraded":"2023-10-14T12:34:45.835405+0000","last_fullsized":"2023-10-14T12:34:45.835405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835418+0000","last_change":"2023-10-14T12:34:44.766816+0000","last_active":"2023-10-14T12:34:45.835418+0000","last_peered":"2023-10-14T12:34:45.835418+0000","last_clean":"2023-10-14T12:34:45.835418+0000","last_became_active":"2023-10-14T12:34:44.766309+0000","last_became_peered":"2023-10-14T12:34:44.766309+0000","last_unstale":"2023-10-14T12:34:45.835418+0000","last_undegraded":"2023-10-14T12:34:45.835418+0000","last_fullsized":"2023-10-14T12:34:45.835418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764364+0000","last_change":"2023-10-14T12:34:44.766262+0000","last_active":"2023-10-14T12:34:45.764364+0000","last_peered":"2023-10-14T12:34:45.764364+0000","last_clean":"2023-10-14T12:34:45.764364+0000","last_became_active":"2023-10-14T12:34:44.765904+0000","last_became_peered":"2023-10-14T12:34:44.765904+0000","last_unstale":"2023-10-14T12:34:45.764364+0000","last_undegraded":"2023-10-14T12:34:45.764364+0000","last_fullsized":"2023-10-14T12:34:45.764364+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835345+0000","last_change":"2023-10-14T12:34:44.764983+0000","last_active":"2023-10-14T12:34:45.835345+0000","last_peered":"2023-10-14T12:34:45.835345+0000","last_clean":"2023-10-14T12:34:45.835345+0000","last_became_active":"2023-10-14T12:34:44.764719+0000","last_became_peered":"2023-10-14T12:34:44.764719+0000","last_unstale":"2023-10-14T12:34:45.835345+0000","last_undegraded":"2023-10-14T12:34:45.835345+0000","last_fullsized":"2023-10-14T12:34:45.835345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835251+0000","last_change":"2023-10-14T12:34:44.769030+0000","last_active":"2023-10-14T12:34:45.835251+0000","last_peered":"2023-10-14T12:34:45.835251+0000","last_clean":"2023-10-14T12:34:45.835251+0000","last_became_active":"2023-10-14T12:34:44.768729+0000","last_became_peered":"2023-10-14T12:34:44.768729+0000","last_unstale":"2023-10-14T12:34:45.835251+0000","last_undegraded":"2023-10-14T12:34:45.835251+0000","last_fullsized":"2023-10-14T12:34:45.835251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:36.593887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765428+0000","last_change":"2023-10-14T12:34:44.768972+0000","last_active":"2023-10-14T12:34:45.765428+0000","last_peered":"2023-10-14T12:34:45.765428+0000","last_clean":"2023-10-14T12:34:45.765428+0000","last_became_active":"2023-10-14T12:34:44.768243+0000","last_became_peered":"2023-10-14T12:34:44.768243+0000","last_unstale":"2023-10-14T12:34:45.765428+0000","last_undegraded":"2023-10-14T12:34:45.765428+0000","last_fullsized":"2023-10-14T12:34:45.765428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835003+0000","last_change":"2023-10-14T12:34:44.768827+0000","last_active":"2023-10-14T12:34:45.835003+0000","last_peered":"2023-10-14T12:34:45.835003+0000","last_clean":"2023-10-14T12:34:45.835003+0000","last_became_active":"2023-10-14T12:34:44.768423+0000","last_became_peered":"2023-10-14T12:34:44.768423+0000","last_unstale":"2023-10-14T12:34:45.835003+0000","last_undegraded":"2023-10-14T12:34:45.835003+0000","last_fullsized":"2023-10-14T12:34:45.835003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765078+0000","last_change":"2023-10-14T12:34:44.771115+0000","last_active":"2023-10-14T12:34:45.765078+0000","last_peered":"2023-10-14T12:34:45.765078+0000","last_clean":"2023-10-14T12:34:45.765078+0000","last_became_active":"2023-10-14T12:34:44.770846+0000","last_became_peered":"2023-10-14T12:34:44.770846+0000","last_unstale":"2023-10-14T12:34:45.765078+0000","last_undegraded":"2023-10-14T12:34:45.765078+0000","last_fullsized":"2023-10-14T12:34:45.765078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:18.644528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775649+0000","last_change":"2023-10-14T12:34:43.742439+0000","last_active":"2023-10-14T12:34:44.775649+0000","last_peered":"2023-10-14T12:34:44.775649+0000","last_clean":"2023-10-14T12:34:44.775649+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:34:44.775649+0000","last_undegraded":"2023-10-14T12:34:44.775649+0000","last_fullsized":"2023-10-14T12:34:44.775649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835738+0000","last_change":"2023-10-14T12:34:44.772445+0000","last_active":"2023-10-14T12:34:45.835738+0000","last_peered":"2023-10-14T12:34:45.835738+0000","last_clean":"2023-10-14T12:34:45.835738+0000","last_became_active":"2023-10-14T12:34:44.772093+0000","last_became_peered":"2023-10-14T12:34:44.772093+0000","last_unstale":"2023-10-14T12:34:45.835738+0000","last_undegraded":"2023-10-14T12:34:45.835738+0000","last_fullsized":"2023-10-14T12:34:45.835738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773796+0000","last_change":"2023-10-14T12:34:43.740875+0000","last_active":"2023-10-14T12:34:44.773796+0000","last_peered":"2023-10-14T12:34:44.773796+0000","last_clean":"2023-10-14T12:34:44.773796+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:34:44.773796+0000","last_undegraded":"2023-10-14T12:34:44.773796+0000","last_fullsized":"2023-10-14T12:34:44.773796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765494+0000","last_change":"2023-10-14T12:34:44.775914+0000","last_active":"2023-10-14T12:34:45.765494+0000","last_peered":"2023-10-14T12:34:45.765494+0000","last_clean":"2023-10-14T12:34:45.765494+0000","last_became_active":"2023-10-14T12:34:44.775648+0000","last_became_peered":"2023-10-14T12:34:44.775648+0000","last_unstale":"2023-10-14T12:34:45.765494+0000","last_undegraded":"2023-10-14T12:34:45.765494+0000","last_fullsized":"2023-10-14T12:34:45.765494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.774951+0000","last_change":"2023-10-14T12:34:43.737909+0000","last_active":"2023-10-14T12:34:44.774951+0000","last_peered":"2023-10-14T12:34:44.774951+0000","last_clean":"2023-10-14T12:34:44.774951+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:34:44.774951+0000","last_undegraded":"2023-10-14T12:34:44.774951+0000","last_fullsized":"2023-10-14T12:34:44.774951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:21.264726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836154+0000","last_change":"2023-10-14T12:34:44.765349+0000","last_active":"2023-10-14T12:34:45.836154+0000","last_peered":"2023-10-14T12:34:45.836154+0000","last_clean":"2023-10-14T12:34:45.836154+0000","last_became_active":"2023-10-14T12:34:44.765043+0000","last_became_peered":"2023-10-14T12:34:44.765043+0000","last_unstale":"2023-10-14T12:34:45.836154+0000","last_undegraded":"2023-10-14T12:34:45.836154+0000","last_fullsized":"2023-10-14T12:34:45.836154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775771+0000","last_change":"2023-10-14T12:34:43.738060+0000","last_active":"2023-10-14T12:34:44.775771+0000","last_peered":"2023-10-14T12:34:44.775771+0000","last_clean":"2023-10-14T12:34:44.775771+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:34:44.775771+0000","last_undegraded":"2023-10-14T12:34:44.775771+0000","last_fullsized":"2023-10-14T12:34:44.775771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836764+0000","last_change":"2023-10-14T12:34:44.763674+0000","last_active":"2023-10-14T12:34:45.836764+0000","last_peered":"2023-10-14T12:34:45.836764+0000","last_clean":"2023-10-14T12:34:45.836764+0000","last_became_active":"2023-10-14T12:34:44.763356+0000","last_became_peered":"2023-10-14T12:34:44.763356+0000","last_unstale":"2023-10-14T12:34:45.836764+0000","last_undegraded":"2023-10-14T12:34:45.836764+0000","last_fullsized":"2023-10-14T12:34:45.836764+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.772744+0000","last_change":"2023-10-14T12:34:43.738857+0000","last_active":"2023-10-14T12:34:44.772744+0000","last_peered":"2023-10-14T12:34:44.772744+0000","last_clean":"2023-10-14T12:34:44.772744+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:34:44.772744+0000","last_undegraded":"2023-10-14T12:34:44.772744+0000","last_fullsized":"2023-10-14T12:34:44.772744+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:47.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764009+0000","last_change":"2023-10-14T12:34:44.767242+0000","last_active":"2023-10-14T12:34:45.764009+0000","last_peered":"2023-10-14T12:34:45.764009+0000","last_clean":"2023-10-14T12:34:45.764009+0000","last_became_active":"2023-10-14T12:34:44.766961+0000","last_became_peered":"2023-10-14T12:34:44.766961+0000","last_unstale":"2023-10-14T12:34:45.764009+0000","last_undegraded":"2023-10-14T12:34:45.764009+0000","last_fullsized":"2023-10-14T12:34:45.764009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775710+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:44.775710+0000","last_peered":"2023-10-14T12:34:44.775710+0000","last_clean":"2023-10-14T12:34:44.775710+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:44.775710+0000","last_undegraded":"2023-10-14T12:34:44.775710+0000","last_fullsized":"2023-10-14T12:34:44.775710+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765983+0000","last_change":"2023-10-14T12:34:44.770562+0000","last_active":"2023-10-14T12:34:45.765983+0000","last_peered":"2023-10-14T12:34:45.765983+0000","last_clean":"2023-10-14T12:34:45.765983+0000","last_became_active":"2023-10-14T12:34:44.770030+0000","last_became_peered":"2023-10-14T12:34:44.770030+0000","last_unstale":"2023-10-14T12:34:45.765983+0000","last_undegraded":"2023-10-14T12:34:45.765983+0000","last_fullsized":"2023-10-14T12:34:45.765983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757619+0000","last_change":"2023-10-14T12:34:43.738248+0000","last_active":"2023-10-14T12:34:44.757619+0000","last_peered":"2023-10-14T12:34:44.757619+0000","last_clean":"2023-10-14T12:34:44.757619+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:34:44.757619+0000","last_undegraded":"2023-10-14T12:34:44.757619+0000","last_fullsized":"2023-10-14T12:34:44.757619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836002+0000","last_change":"2023-10-14T12:34:44.762002+0000","last_active":"2023-10-14T12:34:45.836002+0000","last_peered":"2023-10-14T12:34:45.836002+0000","last_clean":"2023-10-14T12:34:45.836002+0000","last_became_active":"2023-10-14T12:34:44.761308+0000","last_became_peered":"2023-10-14T12:34:44.761308+0000","last_unstale":"2023-10-14T12:34:45.836002+0000","last_undegraded":"2023-10-14T12:34:45.836002+0000","last_fullsized":"2023-10-14T12:34:45.836002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.754851+0000","last_change":"2023-10-14T12:34:43.737450+0000","last_active":"2023-10-14T12:34:44.754851+0000","last_peered":"2023-10-14T12:34:44.754851+0000","last_clean":"2023-10-14T12:34:44.754851+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:34:44.754851+0000","last_undegraded":"2023-10-14T12:34:44.754851+0000","last_fullsized":"2023-10-14T12:34:44.754851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:27.820010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835759+0000","last_change":"2023-10-14T12:34:44.776821+0000","last_active":"2023-10-14T12:34:45.835759+0000","last_peered":"2023-10-14T12:34:45.835759+0000","last_clean":"2023-10-14T12:34:45.835759+0000","last_became_active":"2023-10-14T12:34:44.776592+0000","last_became_peered":"2023-10-14T12:34:44.776592+0000","last_unstale":"2023-10-14T12:34:45.835759+0000","last_undegraded":"2023-10-14T12:34:45.835759+0000","last_fullsized":"2023-10-14T12:34:45.835759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:31.333285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.753775+0000","last_change":"2023-10-14T12:34:43.733989+0000","last_active":"2023-10-14T12:34:44.753775+0000","last_peered":"2023-10-14T12:34:44.753775+0000","last_clean":"2023-10-14T12:34:44.753775+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:34:44.753775+0000","last_undegraded":"2023-10-14T12:34:44.753775+0000","last_fullsized":"2023-10-14T12:34:44.753775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:52.723651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765232+0000","last_change":"2023-10-14T12:34:44.763705+0000","last_active":"2023-10-14T12:34:45.765232+0000","last_peered":"2023-10-14T12:34:45.765232+0000","last_clean":"2023-10-14T12:34:45.765232+0000","last_became_active":"2023-10-14T12:34:44.763408+0000","last_became_peered":"2023-10-14T12:34:44.763408+0000","last_unstale":"2023-10-14T12:34:45.765232+0000","last_undegraded":"2023-10-14T12:34:45.765232+0000","last_fullsized":"2023-10-14T12:34:45.765232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:02.756175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750731+0000","last_change":"2023-10-14T12:34:43.734905+0000","last_active":"2023-10-14T12:34:44.750731+0000","last_peered":"2023-10-14T12:34:44.750731+0000","last_clean":"2023-10-14T12:34:44.750731+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:34:44.750731+0000","last_undegraded":"2023-10-14T12:34:44.750731+0000","last_fullsized":"2023-10-14T12:34:44.750731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836842+0000","last_change":"2023-10-14T12:34:44.764740+0000","last_active":"2023-10-14T12:34:45.836842+0000","last_peered":"2023-10-14T12:34:45.836842+0000","last_clean":"2023-10-14T12:34:45.836842+0000","last_became_active":"2023-10-14T12:34:44.764455+0000","last_became_peered":"2023-10-14T12:34:44.764455+0000","last_unstale":"2023-10-14T12:34:45.836842+0000","last_undegraded":"2023-10-14T12:34:45.836842+0000","last_fullsized":"2023-10-14T12:34:45.836842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779891+0000","last_change":"2023-10-14T12:34:43.735967+0000","last_active":"2023-10-14T12:34:44.779891+0000","last_peered":"2023-10-14T12:34:44.779891+0000","last_clean":"2023-10-14T12:34:44.779891+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:34:44.779891+0000","last_undegraded":"2023-10-14T12:34:44.779891+0000","last_fullsized":"2023-10-14T12:34:44.779891+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765386+0000","last_change":"2023-10-14T12:34:44.774548+0000","last_active":"2023-10-14T12:34:45.765386+0000","last_peered":"2023-10-14T12:34:45.765386+0000","last_clean":"2023-10-14T12:34:45.765386+0000","last_became_active":"2023-10-14T12:34:44.774253+0000","last_became_peered":"2023-10-14T12:34:44.774253+0000","last_unstale":"2023-10-14T12:34:45.765386+0000","last_undegraded":"2023-10-14T12:34:45.765386+0000","last_fullsized":"2023-10-14T12:34:45.765386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779429+0000","last_change":"2023-10-14T12:34:43.741443+0000","last_active":"2023-10-14T12:34:44.779429+0000","last_peered":"2023-10-14T12:34:44.779429+0000","last_clean":"2023-10-14T12:34:44.779429+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:34:44.779429+0000","last_undegraded":"2023-10-14T12:34:44.779429+0000","last_fullsized":"2023-10-14T12:34:44.779429+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:17.642741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836528+0000","last_change":"2023-10-14T12:34:44.766187+0000","last_active":"2023-10-14T12:34:45.836528+0000","last_peered":"2023-10-14T12:34:45.836528+0000","last_clean":"2023-10-14T12:34:45.836528+0000","last_became_active":"2023-10-14T12:34:44.765932+0000","last_became_peered":"2023-10-14T12:34:44.765932+0000","last_unstale":"2023-10-14T12:34:45.836528+0000","last_undegraded":"2023-10-14T12:34:45.836528+0000","last_fullsized":"2023-10-14T12:34:45.836528+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773813+0000","last_change":"2023-10-14T12:34:43.738642+0000","last_active":"2023-10-14T12:34:44.773813+0000","last_peered":"2023-10-14T12:34:44.773813+0000","last_clean":"2023-10-14T12:34:44.773813+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:34:44.773813+0000","last_undegraded":"2023-10-14T12:34:44.773813+0000","last_fullsized":"2023-10-14T12:34:44.773813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835518+0000","last_change":"2023-10-14T12:34:44.773042+0000","last_active":"2023-10-14T12:34:45.835518+0000","last_peered":"2023-10-14T12:34:45.835518+0000","last_clean":"2023-10-14T12:34:45.835518+0000","last_became_active":"2023-10-14T12:34:44.772662+0000","last_became_peered":"2023-10-14T12:34:44.772662+0000","last_unstale":"2023-10-14T12:34:45.835518+0000","last_undegraded":"2023-10-14T12:34:45.835518+0000","last_fullsized":"2023-10-14T12:34:45.835518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758499+0000","last_change":"2023-10-14T12:34:43.738291+0000","last_active":"2023-10-14T12:34:44.758499+0000","last_peered":"2023-10-14T12:34:44.758499+0000","last_clean":"2023-10-14T12:34:44.758499+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:34:44.758499+0000","last_undegraded":"2023-10-14T12:34:44.758499+0000","last_fullsized":"2023-10-14T12:34:44.758499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:28.347591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764881+0000","last_change":"2023-10-14T12:34:44.761488+0000","last_active":"2023-10-14T12:34:45.764881+0000","last_peered":"2023-10-14T12:34:45.764881+0000","last_clean":"2023-10-14T12:34:45.764881+0000","last_became_active":"2023-10-14T12:34:44.761153+0000","last_became_peered":"2023-10-14T12:34:44.761153+0000","last_unstale":"2023-10-14T12:34:45.764881+0000","last_undegraded":"2023-10-14T12:34:45.764881+0000","last_fullsized":"2023-10-14T12:34:45.764881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.755992+0000","last_change":"2023-10-14T12:34:43.742416+0000","last_active":"2023-10-14T12:34:44.755992+0000","last_peered":"2023-10-14T12:34:44.755992+0000","last_clean":"2023-10-14T12:34:44.755992+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:34:44.755992+0000","last_undegraded":"2023-10-14T12:34:44.755992+0000","last_fullsized":"2023-10-14T12:34:44.755992+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835631+0000","last_change":"2023-10-14T12:34:44.762671+0000","last_active":"2023-10-14T12:34:45.835631+0000","last_peered":"2023-10-14T12:34:45.835631+0000","last_clean":"2023-10-14T12:34:45.835631+0000","last_became_active":"2023-10-14T12:34:44.762396+0000","last_became_peered":"2023-10-14T12:34:44.762396+0000","last_unstale":"2023-10-14T12:34:45.835631+0000","last_undegraded":"2023-10-14T12:34:45.835631+0000","last_fullsized":"2023-10-14T12:34:45.835631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.777137+0000","last_change":"2023-10-14T12:34:43.745867+0000","last_active":"2023-10-14T12:34:44.777137+0000","last_peered":"2023-10-14T12:34:44.777137+0000","last_clean":"2023-10-14T12:34:44.777137+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:34:44.777137+0000","last_undegraded":"2023-10-14T12:34:44.777137+0000","last_fullsized":"2023-10-14T12:34:44.777137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835643+0000","last_change":"2023-10-14T12:34:44.761814+0000","last_active":"2023-10-14T12:34:45.835643+0000","last_peered":"2023-10-14T12:34:45.835643+0000","last_clean":"2023-10-14T12:34:45.835643+0000","last_became_active":"2023-10-14T12:34:44.761558+0000","last_became_peered":"2023-10-14T12:34:44.761558+0000","last_unstale":"2023-10-14T12:34:45.835643+0000","last_undegraded":"2023-10-14T12:34:45.835643+0000","last_fullsized":"2023-10-14T12:34:45.835643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775988+0000","last_change":"2023-10-14T12:34:43.743560+0000","last_active":"2023-10-14T12:34:44.775988+0000","last_peered":"2023-10-14T12:34:44.775988+0000","last_clean":"2023-10-14T12:34:44.775988+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:34:44.775988+0000","last_undegraded":"2023-10-14T12:34:44.775988+0000","last_fullsized":"2023-10-14T12:34:44.775988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:26.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764518+0000","last_change":"2023-10-14T12:34:44.766417+0000","last_active":"2023-10-14T12:34:45.764518+0000","last_peered":"2023-10-14T12:34:45.764518+0000","last_clean":"2023-10-14T12:34:45.764518+0000","last_became_active":"2023-10-14T12:34:44.766119+0000","last_became_peered":"2023-10-14T12:34:44.766119+0000","last_unstale":"2023-10-14T12:34:45.764518+0000","last_undegraded":"2023-10-14T12:34:45.764518+0000","last_fullsized":"2023-10-14T12:34:45.764518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775467+0000","last_change":"2023-10-14T12:34:43.738033+0000","last_active":"2023-10-14T12:34:44.775467+0000","last_peered":"2023-10-14T12:34:44.775467+0000","last_clean":"2023-10-14T12:34:44.775467+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:34:44.775467+0000","last_undegraded":"2023-10-14T12:34:44.775467+0000","last_fullsized":"2023-10-14T12:34:44.775467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765588+0000","last_change":"2023-10-14T12:34:44.775797+0000","last_active":"2023-10-14T12:34:45.765588+0000","last_peered":"2023-10-14T12:34:45.765588+0000","last_clean":"2023-10-14T12:34:45.765588+0000","last_became_active":"2023-10-14T12:34:44.775417+0000","last_became_peered":"2023-10-14T12:34:44.775417+0000","last_unstale":"2023-10-14T12:34:45.765588+0000","last_undegraded":"2023-10-14T12:34:45.765588+0000","last_fullsized":"2023-10-14T12:34:45.765588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775680+0000","last_change":"2023-10-14T12:34:43.744197+0000","last_active":"2023-10-14T12:34:44.775680+0000","last_peered":"2023-10-14T12:34:44.775680+0000","last_clean":"2023-10-14T12:34:44.775680+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:34:44.775680+0000","last_undegraded":"2023-10-14T12:34:44.775680+0000","last_fullsized":"2023-10-14T12:34:44.775680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:53.838278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836010+0000","last_change":"2023-10-14T12:34:44.770567+0000","last_active":"2023-10-14T12:34:45.836010+0000","last_peered":"2023-10-14T12:34:45.836010+0000","last_clean":"2023-10-14T12:34:45.836010+0000","last_became_active":"2023-10-14T12:34:44.768157+0000","last_became_peered":"2023-10-14T12:34:44.768157+0000","last_unstale":"2023-10-14T12:34:45.836010+0000","last_undegraded":"2023-10-14T12:34:45.836010+0000","last_fullsized":"2023-10-14T12:34:45.836010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:05.274311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756934+0000","last_change":"2023-10-14T12:34:43.739053+0000","last_active":"2023-10-14T12:34:44.756934+0000","last_peered":"2023-10-14T12:34:44.756934+0000","last_clean":"2023-10-14T12:34:44.756934+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:34:44.756934+0000","last_undegraded":"2023-10-14T12:34:44.756934+0000","last_fullsized":"2023-10-14T12:34:44.756934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765656+0000","last_change":"2023-10-14T12:34:44.768620+0000","last_active":"2023-10-14T12:34:45.765656+0000","last_peered":"2023-10-14T12:34:45.765656+0000","last_clean":"2023-10-14T12:34:45.765656+0000","last_became_active":"2023-10-14T12:34:44.768087+0000","last_became_peered":"2023-10-14T12:34:44.768087+0000","last_unstale":"2023-10-14T12:34:45.765656+0000","last_undegraded":"2023-10-14T12:34:45.765656+0000","last_fullsized":"2023-10-14T12:34:45.765656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.769614+0000","last_change":"2023-10-14T12:34:43.739027+0000","last_active":"2023-10-14T12:34:44.769614+0000","last_peered":"2023-10-14T12:34:44.769614+0000","last_clean":"2023-10-14T12:34:44.769614+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:34:44.769614+0000","last_undegraded":"2023-10-14T12:34:44.769614+0000","last_fullsized":"2023-10-14T12:34:44.769614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:18.085129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836679+0000","last_change":"2023-10-14T12:34:44.761072+0000","last_active":"2023-10-14T12:34:45.836679+0000","last_peered":"2023-10-14T12:34:45.836679+0000","last_clean":"2023-10-14T12:34:45.836679+0000","last_became_active":"2023-10-14T12:34:44.760736+0000","last_became_peered":"2023-10-14T12:34:44.760736+0000","last_unstale":"2023-10-14T12:34:45.836679+0000","last_undegraded":"2023-10-14T12:34:45.836679+0000","last_fullsized":"2023-10-14T12:34:45.836679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.759860+0000","last_change":"2023-10-14T12:34:43.739164+0000","last_active":"2023-10-14T12:34:44.759860+0000","last_peered":"2023-10-14T12:34:44.759860+0000","last_clean":"2023-10-14T12:34:44.759860+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:34:44.759860+0000","last_undegraded":"2023-10-14T12:34:44.759860+0000","last_fullsized":"2023-10-14T12:34:44.759860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:58.156116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764254+0000","last_change":"2023-10-14T12:34:44.764345+0000","last_active":"2023-10-14T12:34:45.764254+0000","last_peered":"2023-10-14T12:34:45.764254+0000","last_clean":"2023-10-14T12:34:45.764254+0000","last_became_active":"2023-10-14T12:34:44.764069+0000","last_became_peered":"2023-10-14T12:34:44.764069+0000","last_unstale":"2023-10-14T12:34:45.764254+0000","last_undegraded":"2023-10-14T12:34:45.764254+0000","last_fullsized":"2023-10-14T12:34:45.764254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.751773+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:44.751773+0000","last_peered":"2023-10-14T12:34:44.751773+0000","last_clean":"2023-10-14T12:34:44.751773+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:44.751773+0000","last_undegraded":"2023-10-14T12:34:44.751773+0000","last_fullsized":"2023-10-14T12:34:44.751773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835883+0000","last_change":"2023-10-14T12:34:44.768053+0000","last_active":"2023-10-14T12:34:45.835883+0000","last_peered":"2023-10-14T12:34:45.835883+0000","last_clean":"2023-10-14T12:34:45.835883+0000","last_became_active":"2023-10-14T12:34:44.767802+0000","last_became_peered":"2023-10-14T12:34:44.767802+0000","last_unstale":"2023-10-14T12:34:45.835883+0000","last_undegraded":"2023-10-14T12:34:45.835883+0000","last_fullsized":"2023-10-14T12:34:45.835883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757835+0000","last_change":"2023-10-14T12:34:43.737529+0000","last_active":"2023-10-14T12:34:44.757835+0000","last_peered":"2023-10-14T12:34:44.757835+0000","last_clean":"2023-10-14T12:34:44.757835+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:34:44.757835+0000","last_undegraded":"2023-10-14T12:34:44.757835+0000","last_fullsized":"2023-10-14T12:34:44.757835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:30:56.810287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835146+0000","last_change":"2023-10-14T12:34:44.768491+0000","last_active":"2023-10-14T12:34:45.835146+0000","last_peered":"2023-10-14T12:34:45.835146+0000","last_clean":"2023-10-14T12:34:45.835146+0000","last_became_active":"2023-10-14T12:34:44.768177+0000","last_became_peered":"2023-10-14T12:34:44.768177+0000","last_unstale":"2023-10-14T12:34:45.835146+0000","last_undegraded":"2023-10-14T12:34:45.835146+0000","last_fullsized":"2023-10-14T12:34:45.835146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779481+0000","last_change":"2023-10-14T12:34:43.735693+0000","last_active":"2023-10-14T12:34:44.779481+0000","last_peered":"2023-10-14T12:34:44.779481+0000","last_clean":"2023-10-14T12:34:44.779481+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:34:44.779481+0000","last_undegraded":"2023-10-14T12:34:44.779481+0000","last_fullsized":"2023-10-14T12:34:44.779481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765390+0000","last_change":"2023-10-14T12:34:44.761812+0000","last_active":"2023-10-14T12:34:45.765390+0000","last_peered":"2023-10-14T12:34:45.765390+0000","last_clean":"2023-10-14T12:34:45.765390+0000","last_became_active":"2023-10-14T12:34:44.761519+0000","last_became_peered":"2023-10-14T12:34:44.761519+0000","last_unstale":"2023-10-14T12:34:45.765390+0000","last_undegraded":"2023-10-14T12:34:45.765390+0000","last_fullsized":"2023-10-14T12:34:45.765390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835973+0000","last_change":"2023-10-14T12:34:43.735820+0000","last_active":"2023-10-14T12:34:45.835973+0000","last_peered":"2023-10-14T12:34:45.835973+0000","last_clean":"2023-10-14T12:34:45.835973+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:34:45.835973+0000","last_undegraded":"2023-10-14T12:34:45.835973+0000","last_fullsized":"2023-10-14T12:34:45.835973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:56.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835989+0000","last_change":"2023-10-14T12:34:44.776057+0000","last_active":"2023-10-14T12:34:45.835989+0000","last_peered":"2023-10-14T12:34:45.835989+0000","last_clean":"2023-10-14T12:34:45.835989+0000","last_became_active":"2023-10-14T12:34:44.775820+0000","last_became_peered":"2023-10-14T12:34:44.775820+0000","last_unstale":"2023-10-14T12:34:45.835989+0000","last_undegraded":"2023-10-14T12:34:45.835989+0000","last_fullsized":"2023-10-14T12:34:45.835989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758094+0000","last_change":"2023-10-14T12:34:43.736834+0000","last_active":"2023-10-14T12:34:44.758094+0000","last_peered":"2023-10-14T12:34:44.758094+0000","last_clean":"2023-10-14T12:34:44.758094+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:34:44.758094+0000","last_undegraded":"2023-10-14T12:34:44.758094+0000","last_fullsized":"2023-10-14T12:34:44.758094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:43.074134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836529+0000","last_change":"2023-10-14T12:34:44.769426+0000","last_active":"2023-10-14T12:34:45.836529+0000","last_peered":"2023-10-14T12:34:45.836529+0000","last_clean":"2023-10-14T12:34:45.836529+0000","last_became_active":"2023-10-14T12:34:44.769173+0000","last_became_peered":"2023-10-14T12:34:44.769173+0000","last_unstale":"2023-10-14T12:34:45.836529+0000","last_undegraded":"2023-10-14T12:34:45.836529+0000","last_fullsized":"2023-10-14T12:34:45.836529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757464+0000","last_change":"2023-10-14T12:34:43.737030+0000","last_active":"2023-10-14T12:34:44.757464+0000","last_peered":"2023-10-14T12:34:44.757464+0000","last_clean":"2023-10-14T12:34:44.757464+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:34:44.757464+0000","last_undegraded":"2023-10-14T12:34:44.757464+0000","last_fullsized":"2023-10-14T12:34:44.757464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835225+0000","last_change":"2023-10-14T12:34:44.763379+0000","last_active":"2023-10-14T12:34:45.835225+0000","last_peered":"2023-10-14T12:34:45.835225+0000","last_clean":"2023-10-14T12:34:45.835225+0000","last_became_active":"2023-10-14T12:34:44.763069+0000","last_became_peered":"2023-10-14T12:34:44.763069+0000","last_unstale":"2023-10-14T12:34:45.835225+0000","last_undegraded":"2023-10-14T12:34:45.835225+0000","last_fullsized":"2023-10-14T12:34:45.835225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756075+0000","last_change":"2023-10-14T12:34:43.740716+0000","last_active":"2023-10-14T12:34:44.756075+0000","last_peered":"2023-10-14T12:34:44.756075+0000","last_clean":"2023-10-14T12:34:44.756075+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:34:44.756075+0000","last_undegraded":"2023-10-14T12:34:44.756075+0000","last_fullsized":"2023-10-14T12:34:44.756075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.766013+0000","last_change":"2023-10-14T12:34:44.769837+0000","last_active":"2023-10-14T12:34:45.766013+0000","last_peered":"2023-10-14T12:34:45.766013+0000","last_clean":"2023-10-14T12:34:45.766013+0000","last_became_active":"2023-10-14T12:34:44.769543+0000","last_became_peered":"2023-10-14T12:34:44.769543+0000","last_unstale":"2023-10-14T12:34:45.766013+0000","last_undegraded":"2023-10-14T12:34:45.766013+0000","last_fullsized":"2023-10-14T12:34:45.766013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758262+0000","last_change":"2023-10-14T12:34:43.738818+0000","last_active":"2023-10-14T12:34:44.758262+0000","last_peered":"2023-10-14T12:34:44.758262+0000","last_clean":"2023-10-14T12:34:44.758262+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:34:44.758262+0000","last_undegraded":"2023-10-14T12:34:44.758262+0000","last_fullsized":"2023-10-14T12:34:44.758262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:21.861042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765067+0000","last_change":"2023-10-14T12:34:44.764824+0000","last_active":"2023-10-14T12:34:45.765067+0000","last_peered":"2023-10-14T12:34:45.765067+0000","last_clean":"2023-10-14T12:34:45.765067+0000","last_became_active":"2023-10-14T12:34:44.764567+0000","last_became_peered":"2023-10-14T12:34:44.764567+0000","last_unstale":"2023-10-14T12:34:45.765067+0000","last_undegraded":"2023-10-14T12:34:45.765067+0000","last_fullsized":"2023-10-14T12:34:45.765067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:53.725438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752091+0000","last_change":"2023-10-14T12:34:43.733187+0000","last_active":"2023-10-14T12:34:44.752091+0000","last_peered":"2023-10-14T12:34:44.752091+0000","last_clean":"2023-10-14T12:34:44.752091+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:34:44.752091+0000","last_undegraded":"2023-10-14T12:34:44.752091+0000","last_fullsized":"2023-10-14T12:34:44.752091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765866+0000","last_change":"2023-10-14T12:34:44.767412+0000","last_active":"2023-10-14T12:34:45.765866+0000","last_peered":"2023-10-14T12:34:45.765866+0000","last_clean":"2023-10-14T12:34:45.765866+0000","last_became_active":"2023-10-14T12:34:44.766080+0000","last_became_peered":"2023-10-14T12:34:44.766080+0000","last_unstale":"2023-10-14T12:34:45.765866+0000","last_undegraded":"2023-10-14T12:34:45.765866+0000","last_fullsized":"2023-10-14T12:34:45.765866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:41.477384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752465+0000","last_change":"2023-10-14T12:34:43.744939+0000","last_active":"2023-10-14T12:34:44.752465+0000","last_peered":"2023-10-14T12:34:44.752465+0000","last_clean":"2023-10-14T12:34:44.752465+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:34:44.752465+0000","last_undegraded":"2023-10-14T12:34:44.752465+0000","last_fullsized":"2023-10-14T12:34:44.752465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:42.271784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750684+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:34:44.750684+0000","last_peered":"2023-10-14T12:34:44.750684+0000","last_clean":"2023-10-14T12:34:44.750684+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:34:44.750684+0000","last_undegraded":"2023-10-14T12:34:44.750684+0000","last_fullsized":"2023-10-14T12:34:44.750684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.626}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.63800000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67800000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.45700000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.49199999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46999999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.34799999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.37},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.45200000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.55700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.434},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.379}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":779658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.37}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.437}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.48799999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.51200000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.58899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.26100000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":190902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.498}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.64400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.44700000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.48399999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.46700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.623},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.71799999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55600000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54300000000000004}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52400000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:34:58.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:34:58.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.569+0000 7fb20a628700 1 Processor -- start 2023-10-14T12:34:58.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.569+0000 7fb20a628700 1 -- start start 2023-10-14T12:34:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.569+0000 7fb20a628700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb20415d810 0x7fb2040af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.569+0000 7fb20a628700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2040af030 0x7fb204161560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.569+0000 7fb20a628700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040caee0 con 0x7fb20415dbf0 2023-10-14T12:34:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.569+0000 7fb20a628700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040cf990 con 0x7fb2040af030 2023-10-14T12:34:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.569+0000 7fb20a628700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040cfc30 con 0x7fb20415d810 2023-10-14T12:34:58.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb208bc5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2040af030 0x7fb204161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb2037fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb20415dbf0 0x7fb2040ca7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55222/0 (socket says 172.21.15.72:55222) 2023-10-14T12:34:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb2037fe700 1 -- 172.21.15.72:0/3329344630 learned_addr learned my addr 172.21.15.72:0/3329344630 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:34:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb208bc5700 1 -- 172.21.15.72:0/3329344630 >> v2:172.21.15.123:3300/0 conn(0x7fb20415d810 msgr2=0x7fb2040af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:58.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb208bc5700 1 --2- 172.21.15.72:0/3329344630 >> v2:172.21.15.123:3300/0 conn(0x7fb20415d810 0x7fb2040af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb208bc5700 1 -- 172.21.15.72:0/3329344630 >> v1:172.21.15.72:6789/0 conn(0x7fb20415dbf0 legacy=0x7fb2040ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb208bc5700 1 -- 172.21.15.72:0/3329344630 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2040cff10 con 0x7fb2040af030 2023-10-14T12:34:58.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb208bc5700 1 --2- 172.21.15.72:0/3329344630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 0x7fb204161560 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb204067640 tx=0x7fb1fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea95e236824c53c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb202ffd700 1 -- 172.21.15.72:0/3329344630 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00e070 con 0x7fb2040af030 2023-10-14T12:34:58.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb202ffd700 1 -- 172.21.15.72:0/3329344630 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc00bbd0 con 0x7fb2040af030 2023-10-14T12:34:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.570+0000 7fb202ffd700 1 -- 172.21.15.72:0/3329344630 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc012430 con 0x7fb2040af030 2023-10-14T12:34:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.571+0000 7fb20a628700 1 -- 172.21.15.72:0/3329344630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 msgr2=0x7fb204161560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.571+0000 7fb20a628700 1 --2- 172.21.15.72:0/3329344630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 0x7fb204161560 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb204067640 tx=0x7fb1fc00b330 comp rx=0 tx=0).stop 2023-10-14T12:34:58.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.571+0000 7fb20a628700 1 -- 172.21.15.72:0/3329344630 shutdown_connections 2023-10-14T12:34:58.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.571+0000 7fb20a628700 1 --2- 172.21.15.72:0/3329344630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 0x7fb204161560 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.571+0000 7fb20a628700 1 --2- 172.21.15.72:0/3329344630 >> v2:172.21.15.123:3300/0 conn(0x7fb20415d810 0x7fb2040af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.571+0000 7fb20a628700 1 -- 172.21.15.72:0/3329344630 >> 172.21.15.72:0/3329344630 conn(0x7fb2040d0180 msgr2=0x7fb2040d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:58.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.571+0000 7fb20a628700 1 -- 172.21.15.72:0/3329344630 shutdown_connections 2023-10-14T12:34:58.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.571+0000 7fb20a628700 1 -- 172.21.15.72:0/3329344630 wait complete. 2023-10-14T12:34:58.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.572+0000 7fb20a628700 1 Processor -- start 2023-10-14T12:34:58.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.572+0000 7fb20a628700 1 -- start start 2023-10-14T12:34:58.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb20a628700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 0x7fb2040b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb20a628700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb20415d810 0x7fb2040b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb20a628700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb20415dbf0 0x7fb2040b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb20a628700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041f3120 con 0x7fb2040af030 2023-10-14T12:34:58.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb20a628700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041f3400 con 0x7fb20415dbf0 2023-10-14T12:34:58.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb20a628700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041f36e0 con 0x7fb20415d810 2023-10-14T12:34:58.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb203fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 0x7fb2040b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb203fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 0x7fb2040b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48928/0 (socket says 172.21.15.72:48928) 2023-10-14T12:34:58.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb203fff700 1 -- 172.21.15.72:0/1251204985 learned_addr learned my addr 172.21.15.72:0/1251204985 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:58.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb208bc5700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb20415dbf0 0x7fb2040b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb2037fe700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb20415d810 0x7fb2040b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb203fff700 1 -- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb20415d810 msgr2=0x7fb2040b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb203fff700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb20415d810 0x7fb2040b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb203fff700 1 -- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb20415dbf0 msgr2=0x7fb2040b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb203fff700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb20415dbf0 0x7fb2040b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb203fff700 1 -- 172.21.15.72:0/1251204985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc009a70 con 0x7fb2040af030 2023-10-14T12:34:58.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb208bc5700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb20415dbf0 0x7fb2040b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:58.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb2037fe700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb20415d810 0x7fb2040b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:34:58.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb203fff700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 0x7fb2040b07d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400b530 tx=0x7fb1f400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:58.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.573+0000 7fb200ff9700 1 -- 172.21.15.72:0/1251204985 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4011830 con 0x7fb2040af030 2023-10-14T12:34:58.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.574+0000 7fb200ff9700 1 -- 172.21.15.72:0/1251204985 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f40119b0 con 0x7fb2040af030 2023-10-14T12:34:58.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.574+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2041f39c0 con 0x7fb2040af030 2023-10-14T12:34:58.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.574+0000 7fb200ff9700 1 -- 172.21.15.72:0/1251204985 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4011d60 con 0x7fb2040af030 2023-10-14T12:34:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.574+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2040c5290 con 0x7fb2040af030 2023-10-14T12:34:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.574+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2041f3260 con 0x7fb2040af030 2023-10-14T12:34:58.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.575+0000 7fb200ff9700 1 -- 172.21.15.72:0/1251204985 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1f401a400 con 0x7fb2040af030 2023-10-14T12:34:58.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.575+0000 7fb200ff9700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1e406af00 0x7fb1e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:58.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.575+0000 7fb200ff9700 1 -- 172.21.15.72:0/1251204985 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb1f40898a0 con 0x7fb2040af030 2023-10-14T12:34:58.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.575+0000 7fb2037fe700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1e406af00 0x7fb1e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:58.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.576+0000 7fb2037fe700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1e406af00 0x7fb1e406d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb20406f1d0 tx=0x7fb1ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:58.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.580+0000 7fb200ff9700 1 -- 172.21.15.72:0/1251204985 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb2041f3260 con 0x7fb2040af030 2023-10-14T12:34:58.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.772+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2041f3260 con 0x7fb2040af030 2023-10-14T12:34:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.773+0000 7fb200ff9700 1 -- 172.21.15.72:0/1251204985 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16794 (secure 0 0 0) 0x7fb2041f3260 con 0x7fb2040af030 2023-10-14T12:34:58.775 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:34:58.775 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":38,"fsid":"76c1c46f-7ec8-4c6d-b32e-0adf818f1cb8","created":"2023-10-14T12:33:13.733569+0000","modified":"2023-10-14T12:34:45.755666+0000","last_up_change":"2023-10-14T12:33:24.501229+0000","last_in_change":"2023-10-14T12:33:16.205452+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:33:25.420931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:34:42.048622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:34:43.090751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aad67034-de37-4ef6-87ca-dccb9878deaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6801","nonce":608326575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6803","nonce":608326575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6807","nonce":608326575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":608326575},{"type":"v1","addr":"172.21.15.72:6805","nonce":608326575}]},"public_addr":"172.21.15.72:6801/608326575","cluster_addr":"172.21.15.72:6803/608326575","heartbeat_back_addr":"172.21.15.72:6807/608326575","heartbeat_front_addr":"172.21.15.72:6805/608326575","state":["exists","up"]},{"osd":1,"uuid":"fc897685-c4a3-4298-aa8a-f4b2cd75378e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6809","nonce":1445654978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6811","nonce":1445654978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6815","nonce":1445654978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1445654978},{"type":"v1","addr":"172.21.15.72:6813","nonce":1445654978}]},"public_addr":"172.21.15.72:6809/1445654978","cluster_addr":"172.21.15.72:6811/1445654978","heartbeat_back_addr":"172.21.15.72:6815/1445654978","heartbeat_front_addr":"172.21.15.72:6813/1445654978","state":["exists","up"]},{"osd":2,"uuid":"15cb2503-e92a-47e3-8869-a8f8af67f0dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6817","nonce":1435036879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6819","nonce":1435036879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6823","nonce":1435036879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":1435036879},{"type":"v1","addr":"172.21.15.72:6821","nonce":1435036879}]},"public_addr":"172.21.15.72:6817/1435036879","cluster_addr":"172.21.15.72:6819/1435036879","heartbeat_back_addr":"172.21.15.72:6823/1435036879","heartbeat_front_addr":"172.21.15.72:6821/1435036879","state":["exists","up"]},{"osd":3,"uuid":"0b24a761-4c74-4d3d-b9cd-ee1988066154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6825","nonce":2591734444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6827","nonce":2591734444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6831","nonce":2591734444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":2591734444},{"type":"v1","addr":"172.21.15.72:6829","nonce":2591734444}]},"public_addr":"172.21.15.72:6825/2591734444","cluster_addr":"172.21.15.72:6827/2591734444","heartbeat_back_addr":"172.21.15.72:6831/2591734444","heartbeat_front_addr":"172.21.15.72:6829/2591734444","state":["exists","up"]},{"osd":4,"uuid":"dc36583e-d434-4fc9-a666-e1dcaee5a548","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6801","nonce":2822863008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6803","nonce":2822863008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6807","nonce":2822863008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2822863008},{"type":"v1","addr":"172.21.15.123:6805","nonce":2822863008}]},"public_addr":"172.21.15.123:6801/2822863008","cluster_addr":"172.21.15.123:6803/2822863008","heartbeat_back_addr":"172.21.15.123:6807/2822863008","heartbeat_front_addr":"172.21.15.123:6805/2822863008","state":["exists","up"]},{"osd":5,"uuid":"1a649928-b273-427d-bfaf-b9e603647d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6809","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6811","nonce":1151915294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6813","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6815","nonce":1151915294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6823","nonce":1151915294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6817","nonce":1151915294},{"type":"v1","addr":"172.21.15.123:6819","nonce":1151915294}]},"public_addr":"172.21.15.123:6811/1151915294","cluster_addr":"172.21.15.123:6815/1151915294","heartbeat_back_addr":"172.21.15.123:6823/1151915294","heartbeat_front_addr":"172.21.15.123:6819/1151915294","state":["exists","up"]},{"osd":6,"uuid":"49ad0825-b198-49f9-844f-300dbb4a95a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6810","nonce":3866020482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6814","nonce":3866020482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6822","nonce":3866020482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":3866020482},{"type":"v1","addr":"172.21.15.123:6818","nonce":3866020482}]},"public_addr":"172.21.15.123:6810/3866020482","cluster_addr":"172.21.15.123:6814/3866020482","heartbeat_back_addr":"172.21.15.123:6822/3866020482","heartbeat_front_addr":"172.21.15.123:6818/3866020482","state":["exists","up"]},{"osd":7,"uuid":"fd405b85-8c7b-480f-873c-19728fe5f160","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6825","nonce":4045319468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6827","nonce":4045319468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6831","nonce":4045319468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":4045319468},{"type":"v1","addr":"172.21.15.123:6829","nonce":4045319468}]},"public_addr":"172.21.15.123:6825/4045319468","cluster_addr":"172.21.15.123:6827/4045319468","heartbeat_back_addr":"172.21.15.123:6831/4045319468","heartbeat_front_addr":"172.21.15.123:6829/4045319468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.433207+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.337930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.400608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.415746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.444024+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.460294+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.447742+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:33:21.376836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:34:58.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1e406af00 msgr2=0x7fb1e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1e406af00 0x7fb1e406d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb20406f1d0 tx=0x7fb1ec009040 comp rx=0 tx=0).stop 2023-10-14T12:34:58.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 msgr2=0x7fb2040b07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:58.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 0x7fb2040b07d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1f400b530 tx=0x7fb1f400b8f0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 shutdown_connections 2023-10-14T12:34:58.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb1e406af00 0x7fb1e406d3c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb20415dbf0 0x7fb2040b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2040af030 0x7fb2040b07d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 --2- 172.21.15.72:0/1251204985 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb20415d810 0x7fb2040b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:58.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 >> 172.21.15.72:0/1251204985 conn(0x7fb2040d0180 msgr2=0x7fb2040d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:58.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 shutdown_connections 2023-10-14T12:34:58.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:58.775+0000 7fb20a628700 1 -- 172.21.15.72:0/1251204985 wait complete. 2023-10-14T12:34:59.792 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T12:34:59.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:34:59.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.929+0000 7f097972b700 1 Processor -- start 2023-10-14T12:34:59.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.930+0000 7f097972b700 1 -- start start 2023-10-14T12:34:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.930+0000 7f097972b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09740ca530 0x7f097406ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:59.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.930+0000 7f097972b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09740c9720 0x7f0974071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:59.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.930+0000 7f097972b700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0974071d50 con 0x7f0974159cf0 2023-10-14T12:34:59.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.930+0000 7f097972b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0974072260 con 0x7f09740c9720 2023-10-14T12:34:59.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.930+0000 7f097972b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0974071f80 con 0x7f09740ca530 2023-10-14T12:34:59.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f09737fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09740c9720 0x7f0974071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:59.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f09737fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09740c9720 0x7f0974071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48940/0 (socket says 172.21.15.72:48940) 2023-10-14T12:34:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f09737fe700 1 -- 172.21.15.72:0/24641820 learned_addr learned my addr 172.21.15.72:0/24641820 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f09727fc700 1 --2- 172.21.15.72:0/24641820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09740ca530 0x7f097406ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:59.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f09737fe700 1 -- 172.21.15.72:0/24641820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09740ca530 msgr2=0x7f097406ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:34:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f09737fe700 1 --2- 172.21.15.72:0/24641820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09740ca530 0x7f097406ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f09737fe700 1 -- 172.21.15.72:0/24641820 >> v1:172.21.15.123:6789/0 conn(0x7f0974159cf0 legacy=0x7f09740c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:59.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f09737fe700 1 -- 172.21.15.72:0/24641820 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09740cd170 con 0x7f09740c9720 2023-10-14T12:34:59.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f09737fe700 1 --2- 172.21.15.72:0/24641820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740c9720 0x7f0974071810 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f096c00d180 tx=0x7f096c00d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bf0cc000c34ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:59.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f0971ffb700 1 -- 172.21.15.72:0/24641820 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c010070 con 0x7f09740c9720 2023-10-14T12:34:59.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f0971ffb700 1 -- 172.21.15.72:0/24641820 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c00daf0 con 0x7f09740c9720 2023-10-14T12:34:59.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.931+0000 7f0971ffb700 1 -- 172.21.15.72:0/24641820 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00dea0 con 0x7f09740c9720 2023-10-14T12:34:59.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.932+0000 7f097972b700 1 -- 172.21.15.72:0/24641820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740c9720 msgr2=0x7f0974071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:59.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.932+0000 7f097972b700 1 --2- 172.21.15.72:0/24641820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740c9720 0x7f0974071810 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f096c00d180 tx=0x7f096c00d490 comp rx=0 tx=0).stop 2023-10-14T12:34:59.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.932+0000 7f097972b700 1 -- 172.21.15.72:0/24641820 shutdown_connections 2023-10-14T12:34:59.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.932+0000 7f097972b700 1 --2- 172.21.15.72:0/24641820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740c9720 0x7f0974071810 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:59.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.932+0000 7f097972b700 1 --2- 172.21.15.72:0/24641820 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f09740ca530 0x7f097406ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:59.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.932+0000 7f097972b700 1 -- 172.21.15.72:0/24641820 >> 172.21.15.72:0/24641820 conn(0x7f09740cbb50 msgr2=0x7f09740cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:59.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.932+0000 7f097972b700 1 -- 172.21.15.72:0/24641820 shutdown_connections 2023-10-14T12:34:59.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.932+0000 7f097972b700 1 -- 172.21.15.72:0/24641820 wait complete. 2023-10-14T12:34:59.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.933+0000 7f097972b700 1 Processor -- start 2023-10-14T12:34:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.933+0000 7f097972b700 1 -- start start 2023-10-14T12:34:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f097972b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09740c9720 0x7f0974151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:59.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f097972b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740ca530 0x7f0974154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:59.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f097972b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0974159cf0 0x7f09741577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:59.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f097972b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097415a1e0 con 0x7f09740ca530 2023-10-14T12:34:59.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f097972b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09741f3580 con 0x7f09740c9720 2023-10-14T12:34:59.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f097972b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0974151c60 con 0x7f0974159cf0 2023-10-14T12:34:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f09727fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740ca530 0x7f0974154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f09727fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740ca530 0x7f0974154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48944/0 (socket says 172.21.15.72:48944) 2023-10-14T12:34:59.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f09727fc700 1 -- 172.21.15.72:0/364222924 learned_addr learned my addr 172.21.15.72:0/364222924 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:34:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f0972ffd700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09740c9720 0x7f0974151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f09737fe700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0974159cf0 0x7f09741577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:59.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f09727fc700 1 -- 172.21.15.72:0/364222924 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0974159cf0 msgr2=0x7f09741577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f09727fc700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f0974159cf0 0x7f09741577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:59.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f09727fc700 1 -- 172.21.15.72:0/364222924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09740c9720 msgr2=0x7f0974151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:59.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f09727fc700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09740c9720 0x7f0974151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.934+0000 7f09727fc700 1 -- 172.21.15.72:0/364222924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c00bd40 con 0x7f09740ca530 2023-10-14T12:34:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.935+0000 7f09727fc700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740ca530 0x7f0974154a30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f096400e9e0 tx=0x7f096400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:59.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.935+0000 7f095b7fe700 1 -- 172.21.15.72:0/364222924 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0964009710 con 0x7f09740ca530 2023-10-14T12:34:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.935+0000 7f095b7fe700 1 -- 172.21.15.72:0/364222924 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096400c850 con 0x7f09740ca530 2023-10-14T12:34:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.935+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09741f2970 con 0x7f09740ca530 2023-10-14T12:34:59.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.935+0000 7f095b7fe700 1 -- 172.21.15.72:0/364222924 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096400cbc0 con 0x7f09740ca530 2023-10-14T12:34:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.935+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09741f2f30 con 0x7f09740ca530 2023-10-14T12:34:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.936+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09740cd730 con 0x7f09740ca530 2023-10-14T12:34:59.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.936+0000 7f095b7fe700 1 -- 172.21.15.72:0/364222924 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f096400cd20 con 0x7f09740ca530 2023-10-14T12:34:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.937+0000 7f095b7fe700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f096006af00 0x7f096006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.937+0000 7f095b7fe700 1 -- 172.21.15.72:0/364222924 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f0964089940 con 0x7f09740ca530 2023-10-14T12:34:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.937+0000 7f0972ffd700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f096006af00 0x7f096006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:59.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.937+0000 7f095b7fe700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7f0960073690 0x7f0960075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:34:59.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.937+0000 7f095b7fe700 1 -- 172.21.15.72:0/364222924 --> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09600761e0 con 0x7f0960073690 2023-10-14T12:34:59.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.937+0000 7f095b7fe700 1 -- 172.21.15.72:0/364222924 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f096408e2a0 con 0x7f09740ca530 2023-10-14T12:34:59.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.937+0000 7f09737fe700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7f0960073690 0x7f0960075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:34:59.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.937+0000 7f0972ffd700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f096006af00 0x7f096006d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0968001620 tx=0x7f0968009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:59.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.937+0000 7f09737fe700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7f0960073690 0x7f0960075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:34:59.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.938+0000 7f095b7fe700 1 -- 172.21.15.72:0/364222924 <== osd.0 v2:172.21.15.72:6800/608326575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f09600761e0 con 0x7f0960073690 2023-10-14T12:34:59.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.952+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 --> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f09740cd450 con 0x7f0960073690 2023-10-14T12:34:59.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f095b7fe700 1 -- 172.21.15.72:0/364222924 <== osd.0 v2:172.21.15.72:6800/608326575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f096c003a20 con 0x7f0960073690 2023-10-14T12:34:59.959 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:34:59.960 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:34:59.960 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:34:59.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7f0960073690 msgr2=0x7f0960075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:59.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6800/608326575,v1:172.21.15.72:6801/608326575] conn(0x7f0960073690 0x7f0960075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:34:59.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f096006af00 msgr2=0x7f096006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:59.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f096006af00 0x7f096006d3c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0968001620 tx=0x7f0968009040 comp rx=0 tx=0).stop 2023-10-14T12:34:59.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740ca530 msgr2=0x7f0974154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:34:59.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 --2- 172.21.15.72:0/364222924 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09740ca530 0x7f0974154a30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f096400e9e0 tx=0x7f096400eda0 comp rx=0 tx=0).stop 2023-10-14T12:34:59.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f09737fe700 1 -- 172.21.15.72:0/364222924 reap_dead start 2023-10-14T12:34:59.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 shutdown_connections 2023-10-14T12:34:59.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 >> 172.21.15.72:0/364222924 conn(0x7f09740cbb50 msgr2=0x7f0974153530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:34:59.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 shutdown_connections 2023-10-14T12:34:59.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:34:59.953+0000 7f097972b700 1 -- 172.21.15.72:0/364222924 wait complete. 2023-10-14T12:34:59.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T12:35:00.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.086+0000 7f5510b10700 1 Processor -- start 2023-10-14T12:35:00.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.086+0000 7f5510b10700 1 -- start start 2023-10-14T12:35:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.087+0000 7f5510b10700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f550c0712e0 0x7f550c15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.087+0000 7f5510b10700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f550c144ea0 0x7f550c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.087+0000 7f5510b10700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c0cd4b0 con 0x7f550c0716c0 2023-10-14T12:35:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.087+0000 7f5510b10700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c0cc150 con 0x7f550c0712e0 2023-10-14T12:35:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.087+0000 7f5510b10700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c15b8f0 con 0x7f550c144ea0 2023-10-14T12:35:00.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.087+0000 7f550a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f550c0712e0 0x7f550c15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.087+0000 7f550ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f550c0716c0 0x7f550c06a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55254/0 (socket says 172.21.15.72:55254) 2023-10-14T12:35:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.087+0000 7f550ad9d700 1 -- 172.21.15.72:0/3490456795 learned_addr learned my addr 172.21.15.72:0/3490456795 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:00.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.087+0000 7f5509d9b700 1 --2- 172.21.15.72:0/3490456795 >> v2:172.21.15.123:3300/0 conn(0x7f550c144ea0 0x7f550c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f550a59c700 1 -- 172.21.15.72:0/3490456795 >> v2:172.21.15.123:3300/0 conn(0x7f550c144ea0 msgr2=0x7f550c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:00.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f550a59c700 1 --2- 172.21.15.72:0/3490456795 >> v2:172.21.15.123:3300/0 conn(0x7f550c144ea0 0x7f550c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f550a59c700 1 -- 172.21.15.72:0/3490456795 >> v1:172.21.15.72:6789/0 conn(0x7f550c0716c0 legacy=0x7f550c06a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f550a59c700 1 -- 172.21.15.72:0/3490456795 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c15fdb0 con 0x7f550c0712e0 2023-10-14T12:35:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f550959a700 1 -- 172.21.15.72:0/3490456795 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767286913 0 0) 0x7f550c0cd4b0 con 0x7f550c0716c0 2023-10-14T12:35:00.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f550a59c700 1 --2- 172.21.15.72:0/3490456795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 0x7f550c15f790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f550c15ef20 tx=0x7f5500009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e072fc31384db187 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f550959a700 1 -- 172.21.15.72:0/3490456795 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500011830 con 0x7f550c0712e0 2023-10-14T12:35:00.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f550959a700 1 -- 172.21.15.72:0/3490456795 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5500011990 con 0x7f550c0712e0 2023-10-14T12:35:00.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f550959a700 1 -- 172.21.15.72:0/3490456795 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500011d20 con 0x7f550c0712e0 2023-10-14T12:35:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f5510b10700 1 -- 172.21.15.72:0/3490456795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 msgr2=0x7f550c15f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f5510b10700 1 --2- 172.21.15.72:0/3490456795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 0x7f550c15f790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f550c15ef20 tx=0x7f5500009b20 comp rx=0 tx=0).stop 2023-10-14T12:35:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f5510b10700 1 -- 172.21.15.72:0/3490456795 shutdown_connections 2023-10-14T12:35:00.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f5510b10700 1 --2- 172.21.15.72:0/3490456795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 0x7f550c15f790 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f5510b10700 1 --2- 172.21.15.72:0/3490456795 >> v2:172.21.15.123:3300/0 conn(0x7f550c144ea0 0x7f550c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.088+0000 7f5510b10700 1 -- 172.21.15.72:0/3490456795 >> 172.21.15.72:0/3490456795 conn(0x7f550c0cfcd0 msgr2=0x7f550c0d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:00.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.089+0000 7f5510b10700 1 -- 172.21.15.72:0/3490456795 shutdown_connections 2023-10-14T12:35:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.089+0000 7f5510b10700 1 -- 172.21.15.72:0/3490456795 wait complete. 2023-10-14T12:35:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.090+0000 7f5510b10700 1 Processor -- start 2023-10-14T12:35:00.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.090+0000 7f5510b10700 1 -- start start 2023-10-14T12:35:00.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f5510b10700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 0x7f550c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f5510b10700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f550c0716c0 0x7f550c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f5510b10700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f550c144ea0 0x7f550c15a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f5510b10700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c1f3e80 con 0x7f550c0712e0 2023-10-14T12:35:00.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f5510b10700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c1f4160 con 0x7f550c144ea0 2023-10-14T12:35:00.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f5510b10700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c1f4440 con 0x7f550c0716c0 2023-10-14T12:35:00.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 0x7f550c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 0x7f550c0c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48956/0 (socket says 172.21.15.72:48956) 2023-10-14T12:35:00.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550a59c700 1 -- 172.21.15.72:0/2258621478 learned_addr learned my addr 172.21.15.72:0/2258621478 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:00.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550ad9d700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f550c144ea0 0x7f550c15a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550a59c700 1 -- 172.21.15.72:0/2258621478 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f550c0716c0 msgr2=0x7f550c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550a59c700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f550c0716c0 0x7f550c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550a59c700 1 -- 172.21.15.72:0/2258621478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f550c144ea0 msgr2=0x7f550c15a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550a59c700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f550c144ea0 0x7f550c15a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550a59c700 1 -- 172.21.15.72:0/2258621478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000094a0 con 0x7f550c0712e0 2023-10-14T12:35:00.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550ad9d700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f550c144ea0 0x7f550c15a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:35:00.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f550a59c700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 0x7f550c0c9620 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5500009b60 tx=0x7f5500004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f54faffd700 1 -- 172.21.15.72:0/2258621478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55000038a0 con 0x7f550c0712e0 2023-10-14T12:35:00.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f54faffd700 1 -- 172.21.15.72:0/2258621478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550001e070 con 0x7f550c0712e0 2023-10-14T12:35:00.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c1f4720 con 0x7f550c0712e0 2023-10-14T12:35:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f54faffd700 1 -- 172.21.15.72:0/2258621478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500003c40 con 0x7f550c0712e0 2023-10-14T12:35:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.091+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c0c9b60 con 0x7f550c0712e0 2023-10-14T12:35:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.092+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c1f4c40 con 0x7f550c0712e0 2023-10-14T12:35:00.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.093+0000 7f54faffd700 1 -- 172.21.15.72:0/2258621478 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f550002d450 con 0x7f550c0712e0 2023-10-14T12:35:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.093+0000 7f54faffd700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ec06af00 0x7f54ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.093+0000 7f54faffd700 1 -- 172.21.15.72:0/2258621478 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f550008a7b0 con 0x7f550c0712e0 2023-10-14T12:35:00.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.093+0000 7f5509d9b700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ec06af00 0x7f54ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.094+0000 7f5509d9b700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ec06af00 0x7f54ec06d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0097f0 tx=0x7f54fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.098+0000 7f54faffd700 1 -- 172.21.15.72:0/2258621478 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f55000556f0 con 0x7f550c0712e0 2023-10-14T12:35:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.285+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f550c1f42d0 con 0x7f54ec06af00 2023-10-14T12:35:00.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.285+0000 7f54faffd700 1 -- 172.21.15.72:0/2258621478 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f550c1f42d0 con 0x7f54ec06af00 2023-10-14T12:35:00.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ec06af00 msgr2=0x7f54ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ec06af00 0x7f54ec06d3c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0097f0 tx=0x7f54fc008040 comp rx=0 tx=0).stop 2023-10-14T12:35:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 msgr2=0x7f550c0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 0x7f550c0c9620 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5500009b60 tx=0x7f5500004750 comp rx=0 tx=0).stop 2023-10-14T12:35:00.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 shutdown_connections 2023-10-14T12:35:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f54ec06af00 0x7f54ec06d3c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f550c144ea0 0x7f550c15a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0712e0 0x7f550c0c9620 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 --2- 172.21.15.72:0/2258621478 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f550c0716c0 0x7f550c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 >> 172.21.15.72:0/2258621478 conn(0x7f550c0cfcd0 msgr2=0x7f550c0b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 shutdown_connections 2023-10-14T12:35:00.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.287+0000 7f5510b10700 1 -- 172.21.15.72:0/2258621478 wait complete. 2023-10-14T12:35:00.292 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T12:35:00.300 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T12:35:00.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:35:00.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.424+0000 7fd56f93a700 1 Processor -- start 2023-10-14T12:35:00.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.424+0000 7fd56f93a700 1 -- start start 2023-10-14T12:35:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56f93a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5680ce540 0x7fd568071b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56f93a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5680cd800 0x7fd5680720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56f93a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56806a9c0 con 0x7fd56815d660 2023-10-14T12:35:00.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56f93a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd568162210 con 0x7fd5680cd800 2023-10-14T12:35:00.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56f93a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56806ac60 con 0x7fd5680ce540 2023-10-14T12:35:00.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56ded7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5680cd800 0x7fd5680720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56d6d6700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd56815d660 0x7fd5680cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55264/0 (socket says 172.21.15.72:55264) 2023-10-14T12:35:00.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56d6d6700 1 -- 172.21.15.72:0/3887836074 learned_addr learned my addr 172.21.15.72:0/3887836074 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:00.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56ced5700 1 --2- 172.21.15.72:0/3887836074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5680ce540 0x7fd568071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56ded7700 1 -- 172.21.15.72:0/3887836074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5680ce540 msgr2=0x7fd568071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56ded7700 1 --2- 172.21.15.72:0/3887836074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5680ce540 0x7fd568071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56ded7700 1 -- 172.21.15.72:0/3887836074 >> v1:172.21.15.72:6789/0 conn(0x7fd56815d660 legacy=0x7fd5680cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56ded7700 1 -- 172.21.15.72:0/3887836074 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56806af40 con 0x7fd5680cd800 2023-10-14T12:35:00.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd55ffff700 1 -- 172.21.15.72:0/3887836074 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417516951 0 0) 0x7fd56806a9c0 con 0x7fd56815d660 2023-10-14T12:35:00.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.425+0000 7fd56ced5700 1 --2- 172.21.15.72:0/3887836074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5680ce540 0x7fd568071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:35:00.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd56ded7700 1 --2- 172.21.15.72:0/3887836074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 0x7fd5680720a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd560009d90 tx=0x7fd56000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afd86e52951e32f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd55ffff700 1 -- 172.21.15.72:0/3887836074 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56000e070 con 0x7fd5680cd800 2023-10-14T12:35:00.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd55ffff700 1 -- 172.21.15.72:0/3887836074 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56000bbd0 con 0x7fd5680cd800 2023-10-14T12:35:00.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd55ffff700 1 -- 172.21.15.72:0/3887836074 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560012430 con 0x7fd5680cd800 2023-10-14T12:35:00.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd56f93a700 1 -- 172.21.15.72:0/3887836074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 msgr2=0x7fd5680720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd56f93a700 1 --2- 172.21.15.72:0/3887836074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 0x7fd5680720a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd560009d90 tx=0x7fd56000b330 comp rx=0 tx=0).stop 2023-10-14T12:35:00.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd56f93a700 1 -- 172.21.15.72:0/3887836074 shutdown_connections 2023-10-14T12:35:00.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd56f93a700 1 --2- 172.21.15.72:0/3887836074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 0x7fd5680720a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd56f93a700 1 --2- 172.21.15.72:0/3887836074 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5680ce540 0x7fd568071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd56f93a700 1 -- 172.21.15.72:0/3887836074 >> 172.21.15.72:0/3887836074 conn(0x7fd5680ccce0 msgr2=0x7fd5680cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:00.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd56f93a700 1 -- 172.21.15.72:0/3887836074 shutdown_connections 2023-10-14T12:35:00.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.426+0000 7fd56f93a700 1 -- 172.21.15.72:0/3887836074 wait complete. 2023-10-14T12:35:00.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56f93a700 1 Processor -- start 2023-10-14T12:35:00.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56f93a700 1 -- start start 2023-10-14T12:35:00.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56f93a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 0x7fd56814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56f93a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5680ce540 0x7fd568152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56f93a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd56815d660 0x7fd568152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56f93a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5681f6860 con 0x7fd5680cd800 2023-10-14T12:35:00.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56f93a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56815ef30 con 0x7fd56815d660 2023-10-14T12:35:00.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56f93a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680ade20 con 0x7fd5680ce540 2023-10-14T12:35:00.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56d6d6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 0x7fd56814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56d6d6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 0x7fd56814d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48970/0 (socket says 172.21.15.72:48970) 2023-10-14T12:35:00.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.428+0000 7fd56d6d6700 1 -- 172.21.15.72:0/2296577176 learned_addr learned my addr 172.21.15.72:0/2296577176 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:00.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd56d6d6700 1 -- 172.21.15.72:0/2296577176 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5680ce540 msgr2=0x7fd568152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd56d6d6700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fd5680ce540 0x7fd568152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd56d6d6700 1 -- 172.21.15.72:0/2296577176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd56815d660 msgr2=0x7fd568152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd56d6d6700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd56815d660 0x7fd568152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd56d6d6700 1 -- 172.21.15.72:0/2296577176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560009a70 con 0x7fd5680cd800 2023-10-14T12:35:00.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd56d6d6700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 0x7fd56814d660 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c550 tx=0x7fd55800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd55dffb700 1 -- 172.21.15.72:0/2296577176 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558004c80 con 0x7fd5680cd800 2023-10-14T12:35:00.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd55dffb700 1 -- 172.21.15.72:0/2296577176 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558004e00 con 0x7fd5680cd800 2023-10-14T12:35:00.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5680ae100 con 0x7fd5680cd800 2023-10-14T12:35:00.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd55dffb700 1 -- 172.21.15.72:0/2296577176 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558007310 con 0x7fd5680cd800 2023-10-14T12:35:00.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.429+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56814dba0 con 0x7fd5680cd800 2023-10-14T12:35:00.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.430+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd56815da40 con 0x7fd5680cd800 2023-10-14T12:35:00.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.430+0000 7fd55dffb700 1 -- 172.21.15.72:0/2296577176 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd558007470 con 0x7fd5680cd800 2023-10-14T12:35:00.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.431+0000 7fd55dffb700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd54c06af00 0x7fd54c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.431+0000 7fd55dffb700 1 -- 172.21.15.72:0/2296577176 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fd558089540 con 0x7fd5680cd800 2023-10-14T12:35:00.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.431+0000 7fd56ced5700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd54c06af00 0x7fd54c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.431+0000 7fd55dffb700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7fd54c073690 0x7fd54c075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.431+0000 7fd55dffb700 1 -- 172.21.15.72:0/2296577176 --> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd54c0761e0 con 0x7fd54c073690 2023-10-14T12:35:00.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.431+0000 7fd55dffb700 1 -- 172.21.15.72:0/2296577176 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd55808bb20 con 0x7fd5680cd800 2023-10-14T12:35:00.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.431+0000 7fd56ded7700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7fd54c073690 0x7fd54c075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.431+0000 7fd56ced5700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd54c06af00 0x7fd54c06d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd564006fd0 tx=0x7fd564008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.431+0000 7fd56ded7700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7fd54c073690 0x7fd54c075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.432+0000 7fd55dffb700 1 -- 172.21.15.72:0/2296577176 <== osd.1 v2:172.21.15.72:6808/1445654978 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd54c0761e0 con 0x7fd54c073690 2023-10-14T12:35:00.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 --> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd5680701f0 con 0x7fd54c073690 2023-10-14T12:35:00.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd55dffb700 1 -- 172.21.15.72:0/2296577176 <== osd.1 v2:172.21.15.72:6808/1445654978 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd56000cdd0 con 0x7fd54c073690 2023-10-14T12:35:00.450 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:35:00.450 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:35:00.450 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:35:00.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7fd54c073690 msgr2=0x7fd54c075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6808/1445654978,v1:172.21.15.72:6809/1445654978] conn(0x7fd54c073690 0x7fd54c075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd54c06af00 msgr2=0x7fd54c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fd54c06af00 0x7fd54c06d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd564006fd0 tx=0x7fd564008040 comp rx=0 tx=0).stop 2023-10-14T12:35:00.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 msgr2=0x7fd56814d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 --2- 172.21.15.72:0/2296577176 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5680cd800 0x7fd56814d660 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c550 tx=0x7fd55800c910 comp rx=0 tx=0).stop 2023-10-14T12:35:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56ded7700 1 -- 172.21.15.72:0/2296577176 reap_dead start 2023-10-14T12:35:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 shutdown_connections 2023-10-14T12:35:00.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 >> 172.21.15.72:0/2296577176 conn(0x7fd5680ccce0 msgr2=0x7fd5680b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:00.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 shutdown_connections 2023-10-14T12:35:00.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.447+0000 7fd56f93a700 1 -- 172.21.15.72:0/2296577176 wait complete. 2023-10-14T12:35:00.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T12:35:00.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.580+0000 7f1705595700 1 Processor -- start 2023-10-14T12:35:00.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.580+0000 7f1705595700 1 -- start start 2023-10-14T12:35:00.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f1705595700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1700160b50 0x7f17000cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f1705595700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17000b5700 0x7f17000ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f1705595700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17000d0010 con 0x7f17000b9000 2023-10-14T12:35:00.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f1705595700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17000d02f0 con 0x7f17000b5700 2023-10-14T12:35:00.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f1705595700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000d05d0 con 0x7f1700160b50 2023-10-14T12:35:00.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f16ff7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17000b5700 0x7f17000ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f16ff7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f17000b5700 0x7f17000ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48982/0 (socket says 172.21.15.72:48982) 2023-10-14T12:35:00.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f16ff7fe700 1 -- 172.21.15.72:0/2457229560 learned_addr learned my addr 172.21.15.72:0/2457229560 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:00.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f16ff7fe700 1 -- 172.21.15.72:0/2457229560 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1700160b50 msgr2=0x7f17000cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:00.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f16feffd700 1 --2- 172.21.15.72:0/2457229560 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1700160b50 0x7f17000cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f16ff7fe700 1 --2- 172.21.15.72:0/2457229560 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1700160b50 0x7f17000cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f16ff7fe700 1 -- 172.21.15.72:0/2457229560 >> v1:172.21.15.123:6789/0 conn(0x7f17000b9000 legacy=0x7f17000b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:00.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.581+0000 7f16ff7fe700 1 -- 172.21.15.72:0/2457229560 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17000ce160 con 0x7f17000b5700 2023-10-14T12:35:00.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f16ff7fe700 1 --2- 172.21.15.72:0/2457229560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17000b5700 0x7f17000ce680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009e50 tx=0x7f16f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d08af87d65fb51 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f16fdffb700 1 -- 172.21.15.72:0/2457229560 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800e070 con 0x7f17000b5700 2023-10-14T12:35:00.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f16fdffb700 1 -- 172.21.15.72:0/2457229560 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8003a20 con 0x7f17000b5700 2023-10-14T12:35:00.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f16fdffb700 1 -- 172.21.15.72:0/2457229560 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8003dd0 con 0x7f17000b5700 2023-10-14T12:35:00.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f1705595700 1 -- 172.21.15.72:0/2457229560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17000b5700 msgr2=0x7f17000ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f1705595700 1 --2- 172.21.15.72:0/2457229560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17000b5700 0x7f17000ce680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009e50 tx=0x7f16f800b330 comp rx=0 tx=0).stop 2023-10-14T12:35:00.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f1705595700 1 -- 172.21.15.72:0/2457229560 shutdown_connections 2023-10-14T12:35:00.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f1705595700 1 --2- 172.21.15.72:0/2457229560 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1700160b50 0x7f17000cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f1705595700 1 --2- 172.21.15.72:0/2457229560 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f17000b5700 0x7f17000ce680 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f1705595700 1 -- 172.21.15.72:0/2457229560 >> 172.21.15.72:0/2457229560 conn(0x7f170006bc70 msgr2=0x7f170006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f1705595700 1 -- 172.21.15.72:0/2457229560 shutdown_connections 2023-10-14T12:35:00.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.582+0000 7f1705595700 1 -- 172.21.15.72:0/2457229560 wait complete. 2023-10-14T12:35:00.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.584+0000 7f1705595700 1 Processor -- start 2023-10-14T12:35:00.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.584+0000 7f1705595700 1 -- start start 2023-10-14T12:35:00.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.584+0000 7f1705595700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17000b5700 0x7f17001548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.584+0000 7f1705595700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17000b9000 0x7f17001599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.584+0000 7f1705595700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1700160b50 0x7f1700156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.584+0000 7f1705595700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c9030 con 0x7f1700160b50 2023-10-14T12:35:00.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.584+0000 7f1705595700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170015a490 con 0x7f17000b5700 2023-10-14T12:35:00.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.584+0000 7f1705595700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c9260 con 0x7f17000b9000 2023-10-14T12:35:00.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1700160b50 0x7f1700156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16ff7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1700160b50 0x7f1700156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48986/0 (socket says 172.21.15.72:48986) 2023-10-14T12:35:00.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16ff7fe700 1 -- 172.21.15.72:0/2269632313 learned_addr learned my addr 172.21.15.72:0/2269632313 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:00.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16ff7fe700 1 -- 172.21.15.72:0/2269632313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17000b9000 msgr2=0x7f17001599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16ff7fe700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17000b9000 0x7f17001599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16ff7fe700 1 -- 172.21.15.72:0/2269632313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17000b5700 msgr2=0x7f17001548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16feffd700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17000b5700 0x7f17001548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16ff7fe700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17000b5700 0x7f17001548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16ff7fe700 1 -- 172.21.15.72:0/2269632313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009b30 con 0x7f1700160b50 2023-10-14T12:35:00.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16feffd700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17000b5700 0x7f17001548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:35:00.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16ff7fe700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1700160b50 0x7f1700156130 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f16f8015040 tx=0x7f16f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16e77fe700 1 -- 172.21.15.72:0/2269632313 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80044c0 con 0x7f1700160b50 2023-10-14T12:35:00.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16e77fe700 1 -- 172.21.15.72:0/2269632313 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8004640 con 0x7f1700160b50 2023-10-14T12:35:00.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17000c9540 con 0x7f1700160b50 2023-10-14T12:35:00.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f16e77fe700 1 -- 172.21.15.72:0/2269632313 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f8012430 con 0x7f1700160b50 2023-10-14T12:35:00.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.585+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17000c9b00 con 0x7f1700160b50 2023-10-14T12:35:00.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.586+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17000b9460 con 0x7f1700160b50 2023-10-14T12:35:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.587+0000 7f16e77fe700 1 -- 172.21.15.72:0/2269632313 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f16f8012590 con 0x7f1700160b50 2023-10-14T12:35:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.587+0000 7f16e77fe700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f16ec06af00 0x7f16ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.587+0000 7f16e77fe700 1 -- 172.21.15.72:0/2269632313 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f16f808abf0 con 0x7f1700160b50 2023-10-14T12:35:00.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.587+0000 7f16feffd700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f16ec06af00 0x7f16ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.587+0000 7f16feffd700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f16ec06af00 0x7f16ec06d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f170015cfd0 tx=0x7f16f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.591+0000 7f16e77fe700 1 -- 172.21.15.72:0/2269632313 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17000b9460 con 0x7f1700160b50 2023-10-14T12:35:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.783+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1700160f30 con 0x7f16ec06af00 2023-10-14T12:35:00.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.784+0000 7f16e77fe700 1 -- 172.21.15.72:0/2269632313 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f16f400c040 con 0x7f16ec06af00 2023-10-14T12:35:00.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f16ec06af00 msgr2=0x7f16ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f16ec06af00 0x7f16ec06d3c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f170015cfd0 tx=0x7f16f4008040 comp rx=0 tx=0).stop 2023-10-14T12:35:00.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1700160b50 msgr2=0x7f1700156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1700160b50 0x7f1700156130 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f16f8015040 tx=0x7f16f8004ad0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 shutdown_connections 2023-10-14T12:35:00.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f16ec06af00 0x7f16ec06d3c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1700160b50 0x7f1700156130 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17000b5700 0x7f17001548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 --2- 172.21.15.72:0/2269632313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f17000b9000 0x7f17001599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 >> 172.21.15.72:0/2269632313 conn(0x7f170006bc70 msgr2=0x7f1700161990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:00.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 shutdown_connections 2023-10-14T12:35:00.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.786+0000 7f1705595700 1 -- 172.21.15.72:0/2269632313 wait complete. 2023-10-14T12:35:00.791 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T12:35:00.799 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T12:35:00.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:35:00.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.923+0000 7f897d099700 1 Processor -- start 2023-10-14T12:35:00.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.923+0000 7f897d099700 1 -- start start 2023-10-14T12:35:00.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f897d099700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f897815ed30 0x7f897815f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f897d099700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89780cad30 con 0x7f897806a820 2023-10-14T12:35:00.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f897d099700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89780cb1c0 con 0x7f897815f6f0 2023-10-14T12:35:00.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f897d099700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89780ca7b0 con 0x7f897815ed30 2023-10-14T12:35:00.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8976d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f897806a820 0x7f897806ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55292/0 (socket says 172.21.15.72:55292) 2023-10-14T12:35:00.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8976d9d700 1 -- 172.21.15.72:0/423841324 learned_addr learned my addr 172.21.15.72:0/423841324 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:00.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f897659c700 1 --2- 172.21.15.72:0/423841324 >> v2:172.21.15.123:3300/0 conn(0x7f897815ed30 0x7f897815f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677458635 0 0) 0x7f89780cad30 con 0x7f897806a820 2023-10-14T12:35:00.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89600035b0 con 0x7f897806a820 2023-10-14T12:35:00.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3625836845 0 0) 0x7f89600035b0 con 0x7f897806a820 2023-10-14T12:35:00.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 >> v2:172.21.15.123:3300/0 conn(0x7f897815ed30 msgr2=0x7f897815f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:00.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 --2- 172.21.15.72:0/423841324 >> v2:172.21.15.123:3300/0 conn(0x7f897815ed30 0x7f897815f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 >> v1:172.21.15.123:6789/0 conn(0x7f897815f6f0 legacy=0x7f8978166240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897806df70 con 0x7f897806a820 2023-10-14T12:35:00.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f896c001670 con 0x7f897806a820 2023-10-14T12:35:00.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 >> v1:172.21.15.72:6789/0 conn(0x7f897806a820 legacy=0x7f897806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8960003a00 0x7f8960003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8960004850 0x7f8960004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.924+0000 7f8975d9b700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8960005210 0x7f896000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89780ca7b0 con 0x7f8960005210 2023-10-14T12:35:00.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896000c1b0 con 0x7f8960004850 2023-10-14T12:35:00.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896000c370 con 0x7f8960003a00 2023-10-14T12:35:00.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f897759e700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8960005210 0x7f896000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f8976d9d700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8960003a00 0x7f8960003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f897659c700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8960004850 0x7f8960004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f897759e700 1 -- 172.21.15.72:0/423841324 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8960003a00 msgr2=0x7f8960003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:00.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f897759e700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f8960003a00 0x7f8960003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f897759e700 1 -- 172.21.15.72:0/423841324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8960004850 msgr2=0x7f8960004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:00.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f897759e700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8960004850 0x7f8960004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f897759e700 1 -- 172.21.15.72:0/423841324 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89600035b0 con 0x7f8960005210 2023-10-14T12:35:00.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f897759e700 1 -- 172.21.15.72:0/423841324 reap_dead start 2023-10-14T12:35:00.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f897759e700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8960005210 0x7f896000ba10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f897000c190 tx=0x7f8960005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb435b5eb93d25cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970001db0 con 0x7f8960005210 2023-10-14T12:35:00.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897000ccd0 con 0x7f8960005210 2023-10-14T12:35:00.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.925+0000 7f8975d9b700 1 -- 172.21.15.72:0/423841324 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970003c40 con 0x7f8960005210 2023-10-14T12:35:00.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.926+0000 7f897d099700 1 -- 172.21.15.72:0/423841324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8960005210 msgr2=0x7f896000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.926+0000 7f897d099700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8960005210 0x7f896000ba10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f897000c190 tx=0x7f8960005880 comp rx=0 tx=0).stop 2023-10-14T12:35:00.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.926+0000 7f897d099700 1 -- 172.21.15.72:0/423841324 shutdown_connections 2023-10-14T12:35:00.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.926+0000 7f897d099700 1 --2- 172.21.15.72:0/423841324 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8960005210 0x7f896000ba10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.926+0000 7f897d099700 1 -- 172.21.15.72:0/423841324 >> 172.21.15.72:0/423841324 conn(0x7f89780ccbe0 msgr2=0x7f89780ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:00.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.926+0000 7f897d099700 1 -- 172.21.15.72:0/423841324 shutdown_connections 2023-10-14T12:35:00.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.926+0000 7f897d099700 1 -- 172.21.15.72:0/423841324 wait complete. 2023-10-14T12:35:00.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.927+0000 7f897d099700 1 Processor -- start 2023-10-14T12:35:00.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.927+0000 7f897d099700 1 -- start start 2023-10-14T12:35:00.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897d099700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8960005210 0x7f8978156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897d099700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89780c8790 0x7f89780c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897d099700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89780b3860 0x7f89780b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897d099700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89780c9150 con 0x7f89780b3860 2023-10-14T12:35:00.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897d099700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89780cde60 con 0x7f8960005210 2023-10-14T12:35:00.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897d099700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89780b45e0 con 0x7f89780c8790 2023-10-14T12:35:00.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89780b3860 0x7f89780b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89780b3860 0x7f89780b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49008/0 (socket says 172.21.15.72:49008) 2023-10-14T12:35:00.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897759e700 1 -- 172.21.15.72:0/479021279 learned_addr learned my addr 172.21.15.72:0/479021279 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:00.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f8976d9d700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8960005210 0x7f8978156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897659c700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89780c8790 0x7f89780c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897759e700 1 -- 172.21.15.72:0/479021279 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89780c8790 msgr2=0x7f89780c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897759e700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f89780c8790 0x7f89780c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897759e700 1 -- 172.21.15.72:0/479021279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8960005210 msgr2=0x7f8978156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897759e700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8960005210 0x7f8978156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897759e700 1 -- 172.21.15.72:0/479021279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780b48c0 con 0x7f89780b3860 2023-10-14T12:35:00.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.928+0000 7f897759e700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89780b3860 0x7f89780b3ce0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f897806e860 tx=0x7f89700014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.929+0000 7f895f7fe700 1 -- 172.21.15.72:0/479021279 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970005070 con 0x7f89780b3860 2023-10-14T12:35:00.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.929+0000 7f895f7fe700 1 -- 172.21.15.72:0/479021279 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89700051d0 con 0x7f89780b3860 2023-10-14T12:35:00.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.929+0000 7f895f7fe700 1 -- 172.21.15.72:0/479021279 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970005380 con 0x7f89780b3860 2023-10-14T12:35:00.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.929+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89780ce100 con 0x7f89780b3860 2023-10-14T12:35:00.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.929+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89780b4ba0 con 0x7f89780b3860 2023-10-14T12:35:00.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.929+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89780ca9c0 con 0x7f89780b3860 2023-10-14T12:35:00.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.930+0000 7f895f7fe700 1 -- 172.21.15.72:0/479021279 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f89700054e0 con 0x7f89780b3860 2023-10-14T12:35:00.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.930+0000 7f895f7fe700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f896406af00 0x7f896406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.931+0000 7f895f7fe700 1 -- 172.21.15.72:0/479021279 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f897008ad50 con 0x7f89780b3860 2023-10-14T12:35:00.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.931+0000 7f8976d9d700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f896406af00 0x7f896406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.931+0000 7f895f7fe700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f8964073690 0x7f8964075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:00.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.931+0000 7f895f7fe700 1 -- 172.21.15.72:0/479021279 --> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89640761e0 con 0x7f8964073690 2023-10-14T12:35:00.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.931+0000 7f895f7fe700 1 -- 172.21.15.72:0/479021279 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f897008b0c0 con 0x7f89780b3860 2023-10-14T12:35:00.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.931+0000 7f897659c700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f8964073690 0x7f8964075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.931+0000 7f8976d9d700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f896406af00 0x7f896406d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f896c000c00 tx=0x7f896c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.931+0000 7f897659c700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f8964073690 0x7f8964075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:00.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.932+0000 7f895f7fe700 1 -- 172.21.15.72:0/479021279 <== osd.2 v2:172.21.15.72:6816/1435036879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f89640761e0 con 0x7f8964073690 2023-10-14T12:35:00.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.946+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 --> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f897806e210 con 0x7f8964073690 2023-10-14T12:35:00.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.946+0000 7f895f7fe700 1 -- 172.21.15.72:0/479021279 <== osd.2 v2:172.21.15.72:6816/1435036879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8968009300 con 0x7f8964073690 2023-10-14T12:35:00.960 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:35:00.961 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:35:00.961 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:35:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f8964073690 msgr2=0x7f8964075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6816/1435036879,v1:172.21.15.72:6817/1435036879] conn(0x7f8964073690 0x7f8964075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f896406af00 msgr2=0x7f896406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f896406af00 0x7f896406d3c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f896c000c00 tx=0x7f896c009040 comp rx=0 tx=0).stop 2023-10-14T12:35:00.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89780b3860 msgr2=0x7f89780b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:00.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 --2- 172.21.15.72:0/479021279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89780b3860 0x7f89780b3ce0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f897806e860 tx=0x7f89700014a0 comp rx=0 tx=0).stop 2023-10-14T12:35:00.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897759e700 1 -- 172.21.15.72:0/479021279 reap_dead start 2023-10-14T12:35:00.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 shutdown_connections 2023-10-14T12:35:00.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 >> 172.21.15.72:0/479021279 conn(0x7f89780ccbe0 msgr2=0x7f897806ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:00.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 shutdown_connections 2023-10-14T12:35:00.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:00.947+0000 7f897d099700 1 -- 172.21.15.72:0/479021279 wait complete. 2023-10-14T12:35:00.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T12:35:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.087+0000 7fca9e35e700 1 Processor -- start 2023-10-14T12:35:01.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.087+0000 7fca9e35e700 1 -- start start 2023-10-14T12:35:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca9e35e700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fca980cd570 0x7fca980cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca9e35e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca980cbe10 con 0x7fca980b3410 2023-10-14T12:35:01.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca9e35e700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca98070d70 con 0x7fca98152470 2023-10-14T12:35:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca9e35e700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca98071200 con 0x7fca980cd570 2023-10-14T12:35:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca977fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca980b3410 0x7fca980b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55314/0 (socket says 172.21.15.72:55314) 2023-10-14T12:35:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca977fe700 1 -- 172.21.15.72:0/1060734313 learned_addr learned my addr 172.21.15.72:0/1060734313 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:01.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642878531 0 0) 0x7fca980cbe10 con 0x7fca980b3410 2023-10-14T12:35:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca800035b0 con 0x7fca980b3410 2023-10-14T12:35:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca9c8fb700 1 --2- 172.21.15.72:0/1060734313 >> v2:172.21.15.123:3300/0 conn(0x7fca980cd570 0x7fca980cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3106481863 0 0) 0x7fca800035b0 con 0x7fca980b3410 2023-10-14T12:35:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 >> v2:172.21.15.123:3300/0 conn(0x7fca980cd570 msgr2=0x7fca980cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 --2- 172.21.15.72:0/1060734313 >> v2:172.21.15.123:3300/0 conn(0x7fca980cd570 0x7fca980cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 >> v1:172.21.15.123:6789/0 conn(0x7fca98152470 legacy=0x7fca980b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9815c990 con 0x7fca980b3410 2023-10-14T12:35:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7fca8c001670 con 0x7fca980b3410 2023-10-14T12:35:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 >> v1:172.21.15.72:6789/0 conn(0x7fca980b3410 legacy=0x7fca980b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80003a00 0x7fca80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca80004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80005330 0x7fca8000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca98071200 con 0x7fca80004850 2023-10-14T12:35:01.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8000c200 con 0x7fca80003a00 2023-10-14T12:35:01.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8000c3c0 con 0x7fca80005330 2023-10-14T12:35:01.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca977fe700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca80004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.088+0000 7fca97fff700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80003a00 0x7fca80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca9c8fb700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80005330 0x7fca8000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca977fe700 1 -- 172.21.15.72:0/1060734313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80005330 msgr2=0x7fca8000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:01.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca977fe700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80005330 0x7fca8000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca977fe700 1 -- 172.21.15.72:0/1060734313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80003a00 msgr2=0x7fca80003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:01.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca977fe700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca80003a00 0x7fca80003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca977fe700 1 -- 172.21.15.72:0/1060734313 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800035b0 con 0x7fca80004850 2023-10-14T12:35:01.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca9c8fb700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca80005330 0x7fca8000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:35:01.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca9c8fb700 1 -- 172.21.15.72:0/1060734313 reap_dead start 2023-10-14T12:35:01.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca977fe700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca80004cd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00c270 tx=0x7fca80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842bd17da0e019e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c007c10 con 0x7fca80004850 2023-10-14T12:35:01.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c00cd90 con 0x7fca80004850 2023-10-14T12:35:01.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.089+0000 7fca96ffd700 1 -- 172.21.15.72:0/1060734313 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c005ba0 con 0x7fca80004850 2023-10-14T12:35:01.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.090+0000 7fca9e35e700 1 -- 172.21.15.72:0/1060734313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 msgr2=0x7fca80004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.090+0000 7fca9e35e700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca80004cd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00c270 tx=0x7fca80005880 comp rx=0 tx=0).stop 2023-10-14T12:35:01.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.090+0000 7fca9e35e700 1 -- 172.21.15.72:0/1060734313 shutdown_connections 2023-10-14T12:35:01.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.090+0000 7fca9e35e700 1 --2- 172.21.15.72:0/1060734313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca80004cd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.090+0000 7fca9e35e700 1 -- 172.21.15.72:0/1060734313 >> 172.21.15.72:0/1060734313 conn(0x7fca980cdd00 msgr2=0x7fca980ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:01.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.090+0000 7fca9e35e700 1 -- 172.21.15.72:0/1060734313 shutdown_connections 2023-10-14T12:35:01.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.090+0000 7fca9e35e700 1 -- 172.21.15.72:0/1060734313 wait complete. 2023-10-14T12:35:01.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.091+0000 7fca9e35e700 1 Processor -- start 2023-10-14T12:35:01.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.091+0000 7fca9e35e700 1 -- start start 2023-10-14T12:35:01.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.092+0000 7fca9e35e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca98157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.092+0000 7fca9e35e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca980c5cb0 0x7fca98151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.092+0000 7fca9e35e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca980c4d90 0x7fca980c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.092+0000 7fca9e35e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca980c6470 con 0x7fca80004850 2023-10-14T12:35:01.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.092+0000 7fca9e35e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca98157bd0 con 0x7fca980c4d90 2023-10-14T12:35:01.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.092+0000 7fca9e35e700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca980c6190 con 0x7fca980c5cb0 2023-10-14T12:35:01.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.092+0000 7fca97fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca98157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.092+0000 7fca97fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca98157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49026/0 (socket says 172.21.15.72:49026) 2023-10-14T12:35:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.092+0000 7fca97fff700 1 -- 172.21.15.72:0/3349356399 learned_addr learned my addr 172.21.15.72:0/3349356399 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca9c8fb700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca980c4d90 0x7fca980c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca97fff700 1 -- 172.21.15.72:0/3349356399 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca980c5cb0 msgr2=0x7fca98151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca977fe700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca980c5cb0 0x7fca98151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca97fff700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca980c5cb0 0x7fca98151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca97fff700 1 -- 172.21.15.72:0/3349356399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca980c4d90 msgr2=0x7fca980c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca97fff700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca980c4d90 0x7fca980c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca97fff700 1 -- 172.21.15.72:0/3349356399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca980c84f0 con 0x7fca80004850 2023-10-14T12:35:01.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca9c8fb700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca980c4d90 0x7fca980c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:35:01.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca97fff700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca98157690 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fca8800f5c0 tx=0x7fca8800f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca94ff9700 1 -- 172.21.15.72:0/3349356399 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88017070 con 0x7fca80004850 2023-10-14T12:35:01.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca94ff9700 1 -- 172.21.15.72:0/3349356399 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880052e0 con 0x7fca80004850 2023-10-14T12:35:01.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca94ff9700 1 -- 172.21.15.72:0/3349356399 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88005490 con 0x7fca80004850 2023-10-14T12:35:01.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca980c87d0 con 0x7fca80004850 2023-10-14T12:35:01.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.093+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca98151780 con 0x7fca80004850 2023-10-14T12:35:01.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.094+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca980c8330 con 0x7fca80004850 2023-10-14T12:35:01.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.095+0000 7fca94ff9700 1 -- 172.21.15.72:0/3349356399 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca88006860 con 0x7fca80004850 2023-10-14T12:35:01.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.095+0000 7fca94ff9700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fca8406af00 0x7fca8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.095+0000 7fca94ff9700 1 -- 172.21.15.72:0/3349356399 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fca88088d70 con 0x7fca80004850 2023-10-14T12:35:01.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.095+0000 7fca977fe700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fca8406af00 0x7fca8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.095+0000 7fca977fe700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fca8406af00 0x7fca8406d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca8c015040 tx=0x7fca8c007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.099+0000 7fca94ff9700 1 -- 172.21.15.72:0/3349356399 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca88053cc0 con 0x7fca80004850 2023-10-14T12:35:01.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.288+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fca980c8c90 con 0x7fca8406af00 2023-10-14T12:35:01.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.289+0000 7fca94ff9700 1 -- 172.21.15.72:0/3349356399 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fca980c8c90 con 0x7fca8406af00 2023-10-14T12:35:01.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fca8406af00 msgr2=0x7fca8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fca8406af00 0x7fca8406d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca8c015040 tx=0x7fca8c007000 comp rx=0 tx=0).stop 2023-10-14T12:35:01.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 msgr2=0x7fca98157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca98157690 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fca8800f5c0 tx=0x7fca8800f980 comp rx=0 tx=0).stop 2023-10-14T12:35:01.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 shutdown_connections 2023-10-14T12:35:01.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fca8406af00 0x7fca8406d3c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca980c4d90 0x7fca980c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca80004850 0x7fca98157690 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 --2- 172.21.15.72:0/3349356399 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fca980c5cb0 0x7fca98151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 >> 172.21.15.72:0/3349356399 conn(0x7fca980cdd00 msgr2=0x7fca981596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:01.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 shutdown_connections 2023-10-14T12:35:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.291+0000 7fca9e35e700 1 -- 172.21.15.72:0/3349356399 wait complete. 2023-10-14T12:35:01.296 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T12:35:01.304 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T12:35:01.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:35:01.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.428+0000 7ff8b6424700 1 Processor -- start 2023-10-14T12:35:01.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.428+0000 7ff8b6424700 1 -- start start 2023-10-14T12:35:01.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.428+0000 7ff8b6424700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff8b006b370 0x7ff8b015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.428+0000 7ff8b6424700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b00cdd30 0x7ff8b00ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8b6424700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b0161360 con 0x7ff8b006a820 2023-10-14T12:35:01.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8b6424700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b00ce720 con 0x7ff8b006b370 2023-10-14T12:35:01.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8b6424700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b006b750 con 0x7ff8b00cdd30 2023-10-14T12:35:01.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8affff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff8b006b370 0x7ff8b015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8af7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff8b006a820 0x7ff8b006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55334/0 (socket says 172.21.15.72:55334) 2023-10-14T12:35:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8af7fe700 1 -- 172.21.15.72:0/2582206799 learned_addr learned my addr 172.21.15.72:0/2582206799 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8b49c1700 1 --2- 172.21.15.72:0/2582206799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b00cdd30 0x7ff8b00ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8affff700 1 -- 172.21.15.72:0/2582206799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b00cdd30 msgr2=0x7ff8b00ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8affff700 1 --2- 172.21.15.72:0/2582206799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b00cdd30 0x7ff8b00ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8affff700 1 -- 172.21.15.72:0/2582206799 >> v1:172.21.15.72:6789/0 conn(0x7ff8b006a820 legacy=0x7ff8b006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8affff700 1 -- 172.21.15.72:0/2582206799 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b006dcc0 con 0x7ff8b006b370 2023-10-14T12:35:01.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8aeffd700 1 -- 172.21.15.72:0/2582206799 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756942714 0 0) 0x7ff8b0161360 con 0x7ff8b006a820 2023-10-14T12:35:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8b49c1700 1 --2- 172.21.15.72:0/2582206799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b00cdd30 0x7ff8b00ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:35:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8affff700 1 --2- 172.21.15.72:0/2582206799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 0x7ff8b015dcb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009840 tx=0x7ff8a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2eb6d4cf0ff6819 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8aeffd700 1 -- 172.21.15.72:0/2582206799 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4011830 con 0x7ff8b006b370 2023-10-14T12:35:01.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8aeffd700 1 -- 172.21.15.72:0/2582206799 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a4011990 con 0x7ff8b006b370 2023-10-14T12:35:01.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.429+0000 7ff8aeffd700 1 -- 172.21.15.72:0/2582206799 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4011d20 con 0x7ff8b006b370 2023-10-14T12:35:01.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.430+0000 7ff8b6424700 1 -- 172.21.15.72:0/2582206799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 msgr2=0x7ff8b015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.430+0000 7ff8b6424700 1 --2- 172.21.15.72:0/2582206799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 0x7ff8b015dcb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009840 tx=0x7ff8a4009b50 comp rx=0 tx=0).stop 2023-10-14T12:35:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.430+0000 7ff8b6424700 1 -- 172.21.15.72:0/2582206799 shutdown_connections 2023-10-14T12:35:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.430+0000 7ff8b6424700 1 --2- 172.21.15.72:0/2582206799 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b00cdd30 0x7ff8b00ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.430+0000 7ff8b6424700 1 --2- 172.21.15.72:0/2582206799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 0x7ff8b015dcb0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.430+0000 7ff8b6424700 1 -- 172.21.15.72:0/2582206799 >> 172.21.15.72:0/2582206799 conn(0x7ff8b00ccbe0 msgr2=0x7ff8b00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.430+0000 7ff8b6424700 1 -- 172.21.15.72:0/2582206799 shutdown_connections 2023-10-14T12:35:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.430+0000 7ff8b6424700 1 -- 172.21.15.72:0/2582206799 wait complete. 2023-10-14T12:35:01.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.431+0000 7ff8b6424700 1 Processor -- start 2023-10-14T12:35:01.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.431+0000 7ff8b6424700 1 -- start start 2023-10-14T12:35:01.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8b6424700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b006a820 0x7ff8b0156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8b6424700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 0x7ff8b00aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8b6424700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8b00cdd30 0x7ff8b00aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8b6424700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00c4630 con 0x7ff8b006b370 2023-10-14T12:35:01.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8b6424700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01f7110 con 0x7ff8b00cdd30 2023-10-14T12:35:01.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8b6424700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01f6590 con 0x7ff8b006a820 2023-10-14T12:35:01.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 0x7ff8b00aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8af7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 0x7ff8b00aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49042/0 (socket says 172.21.15.72:49042) 2023-10-14T12:35:01.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8af7fe700 1 -- 172.21.15.72:0/3815106024 learned_addr learned my addr 172.21.15.72:0/3815106024 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:01.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8affff700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b006a820 0x7ff8b0156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8b49c1700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8b00cdd30 0x7ff8b00aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8af7fe700 1 -- 172.21.15.72:0/3815106024 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b006a820 msgr2=0x7ff8b0156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8af7fe700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7ff8b006a820 0x7ff8b0156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8af7fe700 1 -- 172.21.15.72:0/3815106024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8b00cdd30 msgr2=0x7ff8b00aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8af7fe700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8b00cdd30 0x7ff8b00aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.432+0000 7ff8af7fe700 1 -- 172.21.15.72:0/3815106024 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40094a0 con 0x7ff8b006b370 2023-10-14T12:35:01.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.433+0000 7ff8af7fe700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 0x7ff8b00aeab0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000c520 tx=0x7ff8a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.433+0000 7ff8acff9700 1 -- 172.21.15.72:0/3815106024 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0004c80 con 0x7ff8b006b370 2023-10-14T12:35:01.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.433+0000 7ff8acff9700 1 -- 172.21.15.72:0/3815106024 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0004de0 con 0x7ff8b006b370 2023-10-14T12:35:01.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.433+0000 7ff8acff9700 1 -- 172.21.15.72:0/3815106024 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00072d0 con 0x7ff8b006b370 2023-10-14T12:35:01.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.433+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b01f6870 con 0x7ff8b006b370 2023-10-14T12:35:01.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.433+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b01f6e30 con 0x7ff8b006b370 2023-10-14T12:35:01.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.433+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8b015e5e0 con 0x7ff8b006b370 2023-10-14T12:35:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.434+0000 7ff8acff9700 1 -- 172.21.15.72:0/3815106024 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8a0007430 con 0x7ff8b006b370 2023-10-14T12:35:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.434+0000 7ff8acff9700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff89c06af00 0x7ff89c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.435+0000 7ff8acff9700 1 -- 172.21.15.72:0/3815106024 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7ff8a0089cf0 con 0x7ff8b006b370 2023-10-14T12:35:01.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.435+0000 7ff8affff700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff89c06af00 0x7ff89c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.435+0000 7ff8acff9700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7ff89c073690 0x7ff89c075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.435+0000 7ff8acff9700 1 -- 172.21.15.72:0/3815106024 --> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff89c0761e0 con 0x7ff89c073690 2023-10-14T12:35:01.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.435+0000 7ff8acff9700 1 -- 172.21.15.72:0/3815106024 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8a008a060 con 0x7ff8b006b370 2023-10-14T12:35:01.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.435+0000 7ff8b49c1700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7ff89c073690 0x7ff89c075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.435+0000 7ff8affff700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff89c06af00 0x7ff89c06d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40090b0 tx=0x7ff8a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.435+0000 7ff8b49c1700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7ff89c073690 0x7ff89c075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.436+0000 7ff8acff9700 1 -- 172.21.15.72:0/3815106024 <== osd.3 v2:172.21.15.72:6824/2591734444 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff89c0761e0 con 0x7ff89c073690 2023-10-14T12:35:01.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.450+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 --> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff8b015e300 con 0x7ff89c073690 2023-10-14T12:35:01.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.450+0000 7ff8acff9700 1 -- 172.21.15.72:0/3815106024 <== osd.3 v2:172.21.15.72:6824/2591734444 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff8a80096b0 con 0x7ff89c073690 2023-10-14T12:35:01.455 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:35:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:35:01.456 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:35:01.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.450+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7ff89c073690 msgr2=0x7ff89c075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.450+0000 7ff8b6424700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6824/2591734444,v1:172.21.15.72:6825/2591734444] conn(0x7ff89c073690 0x7ff89c075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.451+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff89c06af00 msgr2=0x7ff89c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.451+0000 7ff8b6424700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7ff89c06af00 0x7ff89c06d3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40090b0 tx=0x7ff8a4008030 comp rx=0 tx=0).stop 2023-10-14T12:35:01.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.451+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 msgr2=0x7ff8b00aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.451+0000 7ff8b6424700 1 --2- 172.21.15.72:0/3815106024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8b006b370 0x7ff8b00aeab0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff8a000c520 tx=0x7ff8a000c8e0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.451+0000 7ff8b49c1700 1 -- 172.21.15.72:0/3815106024 reap_dead start 2023-10-14T12:35:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.451+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 shutdown_connections 2023-10-14T12:35:01.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.451+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 >> 172.21.15.72:0/3815106024 conn(0x7ff8b00ccbe0 msgr2=0x7ff8b015d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:01.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.451+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 shutdown_connections 2023-10-14T12:35:01.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.451+0000 7ff8b6424700 1 -- 172.21.15.72:0/3815106024 wait complete. 2023-10-14T12:35:01.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T12:35:01.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.584+0000 7f7fba630700 1 Processor -- start 2023-10-14T12:35:01.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.584+0000 7f7fba630700 1 -- start start 2023-10-14T12:35:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fba630700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7fb4152470 0x7f7fb40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fba630700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7fb40b3410 0x7f7fb40b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fba630700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb4070d70 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fba630700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb4071200 con 0x7f7fb40b3410 2023-10-14T12:35:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fba630700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40cbd80 con 0x7f7fb4152470 2023-10-14T12:35:01.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb8bcd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7fb40b3410 0x7f7fb40b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7fb40cb8d0 0x7f7fb40b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55350/0 (socket says 172.21.15.72:55350) 2023-10-14T12:35:01.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb37fe700 1 -- 172.21.15.72:0/3508929710 learned_addr learned my addr 172.21.15.72:0/3508929710 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb3fff700 1 --2- 172.21.15.72:0/3508929710 >> v2:172.21.15.123:3300/0 conn(0x7f7fb4152470 0x7f7fb40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb8bcd700 1 -- 172.21.15.72:0/3508929710 >> v2:172.21.15.123:3300/0 conn(0x7f7fb4152470 msgr2=0x7f7fb40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:01.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb8bcd700 1 --2- 172.21.15.72:0/3508929710 >> v2:172.21.15.123:3300/0 conn(0x7f7fb4152470 0x7f7fb40cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb8bcd700 1 -- 172.21.15.72:0/3508929710 >> v1:172.21.15.72:6789/0 conn(0x7f7fb40cb8d0 legacy=0x7f7fb40b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb2ffd700 1 -- 172.21.15.72:0/3508929710 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894125718 0 0) 0x7f7fb4070d70 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb8bcd700 1 -- 172.21.15.72:0/3508929710 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4070440 con 0x7f7fb40b3410 2023-10-14T12:35:01.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.585+0000 7f7fb8bcd700 1 --2- 172.21.15.72:0/3508929710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40b3410 0x7f7fb40b60f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4071460 tx=0x7f7fac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f971e80766fe22 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fb2ffd700 1 -- 172.21.15.72:0/3508929710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00e070 con 0x7f7fb40b3410 2023-10-14T12:35:01.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fb2ffd700 1 -- 172.21.15.72:0/3508929710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00bbd0 con 0x7f7fb40b3410 2023-10-14T12:35:01.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fb2ffd700 1 -- 172.21.15.72:0/3508929710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac012430 con 0x7f7fb40b3410 2023-10-14T12:35:01.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fba630700 1 -- 172.21.15.72:0/3508929710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40b3410 msgr2=0x7f7fb40b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fba630700 1 --2- 172.21.15.72:0/3508929710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40b3410 0x7f7fb40b60f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4071460 tx=0x7f7fac00b330 comp rx=0 tx=0).stop 2023-10-14T12:35:01.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fba630700 1 -- 172.21.15.72:0/3508929710 shutdown_connections 2023-10-14T12:35:01.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fba630700 1 --2- 172.21.15.72:0/3508929710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40b3410 0x7f7fb40b60f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fba630700 1 --2- 172.21.15.72:0/3508929710 >> v2:172.21.15.123:3300/0 conn(0x7f7fb4152470 0x7f7fb40cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fba630700 1 -- 172.21.15.72:0/3508929710 >> 172.21.15.72:0/3508929710 conn(0x7f7fb40cdd00 msgr2=0x7f7fb40ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:01.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fba630700 1 -- 172.21.15.72:0/3508929710 shutdown_connections 2023-10-14T12:35:01.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.586+0000 7f7fba630700 1 -- 172.21.15.72:0/3508929710 wait complete. 2023-10-14T12:35:01.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.587+0000 7f7fba630700 1 Processor -- start 2023-10-14T12:35:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fba630700 1 -- start start 2023-10-14T12:35:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fba630700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fb40b3410 0x7f7fb4150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fba630700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40cb8d0 0x7f7fb40c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fba630700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb4152470 0x7f7fb40c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fba630700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c7790 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fba630700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c7bb0 con 0x7f7fb4152470 2023-10-14T12:35:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fba630700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c6b10 con 0x7f7fb40b3410 2023-10-14T12:35:01.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fb37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40cb8d0 0x7f7fb40c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fb37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40cb8d0 0x7f7fb40c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49058/0 (socket says 172.21.15.72:49058) 2023-10-14T12:35:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fb37fe700 1 -- 172.21.15.72:0/2184013719 learned_addr learned my addr 172.21.15.72:0/2184013719 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fb8bcd700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb4152470 0x7f7fb40c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.588+0000 7f7fb3fff700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fb40b3410 0x7f7fb4150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb37fe700 1 -- 172.21.15.72:0/2184013719 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fb40b3410 msgr2=0x7f7fb4150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb37fe700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fb40b3410 0x7f7fb4150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb37fe700 1 -- 172.21.15.72:0/2184013719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb4152470 msgr2=0x7f7fb40c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb37fe700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb4152470 0x7f7fb40c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb37fe700 1 -- 172.21.15.72:0/2184013719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac009a70 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb3fff700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fb40b3410 0x7f7fb4150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:35:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb37fe700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40cb8d0 0x7f7fb40c5fa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40011e0 tx=0x7f7fa400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb0ff9700 1 -- 172.21.15.72:0/2184013719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4004c80 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb0ff9700 1 -- 172.21.15.72:0/2184013719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4004de0 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fb0ff9700 1 -- 172.21.15.72:0/2184013719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4007310 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb40c6df0 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.589+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb40c73b0 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.590+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb40c78d0 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.590+0000 7f7fb0ff9700 1 -- 172.21.15.72:0/2184013719 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7fa4007470 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.591+0000 7f7fb0ff9700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7f9406af00 0x7f7f9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.591+0000 7f7fb0ff9700 1 -- 172.21.15.72:0/2184013719 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f7fa4089400 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.591+0000 7f7fb3fff700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7f9406af00 0x7f7f9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.591+0000 7f7fb3fff700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7f9406af00 0x7f7f9406d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0099f0 tx=0x7f7f9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.596+0000 7f7fb0ff9700 1 -- 172.21.15.72:0/2184013719 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7fb40c78d0 con 0x7f7fb40cb8d0 2023-10-14T12:35:01.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.785+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fb4070a00 con 0x7f7f9406af00 2023-10-14T12:35:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.785+0000 7f7fb0ff9700 1 -- 172.21.15.72:0/2184013719 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7f9c009680 con 0x7f7f9406af00 2023-10-14T12:35:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7f9406af00 msgr2=0x7f7f9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7f9406af00 0x7f7f9406d3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0099f0 tx=0x7f7f9c008040 comp rx=0 tx=0).stop 2023-10-14T12:35:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40cb8d0 msgr2=0x7f7fb40c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40cb8d0 0x7f7fb40c5fa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40011e0 tx=0x7f7fa400ca30 comp rx=0 tx=0).stop 2023-10-14T12:35:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 shutdown_connections 2023-10-14T12:35:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f7f9406af00 0x7f7f9406d3c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fb4152470 0x7f7fb40c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f7fb40b3410 0x7f7fb4150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 --2- 172.21.15.72:0/2184013719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7fb40cb8d0 0x7f7fb40c5fa0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 >> 172.21.15.72:0/2184013719 conn(0x7f7fb40cdd00 msgr2=0x7f7fb40ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 shutdown_connections 2023-10-14T12:35:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.787+0000 7f7fba630700 1 -- 172.21.15.72:0/2184013719 wait complete. 2023-10-14T12:35:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T12:35:01.801 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T12:35:01.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:35:01.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.923+0000 7f238ab23700 1 Processor -- start 2023-10-14T12:35:01.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.923+0000 7f238ab23700 1 -- start start 2023-10-14T12:35:01.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.924+0000 7f238ab23700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23840b1260 0x7f23840c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.924+0000 7f238ab23700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23840ce7d0 0x7f23840b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.924+0000 7f238ab23700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23840caa90 con 0x7f238415b6c0 2023-10-14T12:35:01.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.924+0000 7f238ab23700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840c9f10 con 0x7f23840ce7d0 2023-10-14T12:35:01.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.924+0000 7f238ab23700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23840ca1f0 con 0x7f23840b1260 2023-10-14T12:35:01.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.924+0000 7f23890c0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23840ce7d0 0x7f23840b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.924+0000 7f23890c0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23840ce7d0 0x7f23840b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49068/0 (socket says 172.21.15.72:49068) 2023-10-14T12:35:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.924+0000 7f23890c0700 1 -- 172.21.15.72:0/1622879849 learned_addr learned my addr 172.21.15.72:0/1622879849 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f23890c0700 1 -- 172.21.15.72:0/1622879849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23840b1260 msgr2=0x7f23840c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f23890c0700 1 --2- 172.21.15.72:0/1622879849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23840b1260 0x7f23840c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f23890c0700 1 -- 172.21.15.72:0/1622879849 >> v1:172.21.15.123:6789/0 conn(0x7f238415b6c0 legacy=0x7f23840b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f23890c0700 1 -- 172.21.15.72:0/1622879849 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23840ca4d0 con 0x7f23840ce7d0 2023-10-14T12:35:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f23890c0700 1 --2- 172.21.15.72:0/1622879849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 0x7f23840b2290 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f237c009e50 tx=0x7f237c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caa333ea16ccebd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f23837fe700 1 -- 172.21.15.72:0/1622879849 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c00e070 con 0x7f23840ce7d0 2023-10-14T12:35:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f23837fe700 1 -- 172.21.15.72:0/1622879849 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c003a20 con 0x7f23840ce7d0 2023-10-14T12:35:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f23837fe700 1 -- 172.21.15.72:0/1622879849 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c003dd0 con 0x7f23840ce7d0 2023-10-14T12:35:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f238ab23700 1 -- 172.21.15.72:0/1622879849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 msgr2=0x7f23840b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f238ab23700 1 --2- 172.21.15.72:0/1622879849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 0x7f23840b2290 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f237c009e50 tx=0x7f237c00b330 comp rx=0 tx=0).stop 2023-10-14T12:35:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f238ab23700 1 -- 172.21.15.72:0/1622879849 shutdown_connections 2023-10-14T12:35:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f238ab23700 1 --2- 172.21.15.72:0/1622879849 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 0x7f23840b2290 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f238ab23700 1 --2- 172.21.15.72:0/1622879849 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23840b1260 0x7f23840c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f238ab23700 1 -- 172.21.15.72:0/1622879849 >> 172.21.15.72:0/1622879849 conn(0x7f23840cbb50 msgr2=0x7f23840cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:01.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.925+0000 7f238ab23700 1 -- 172.21.15.72:0/1622879849 shutdown_connections 2023-10-14T12:35:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.926+0000 7f238ab23700 1 -- 172.21.15.72:0/1622879849 wait complete. 2023-10-14T12:35:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.927+0000 7f238ab23700 1 Processor -- start 2023-10-14T12:35:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.927+0000 7f238ab23700 1 -- start start 2023-10-14T12:35:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.927+0000 7f238ab23700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23840b1260 0x7f23841f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.927+0000 7f238ab23700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 0x7f23840c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.927+0000 7f238ab23700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f238415b6c0 0x7f23840c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.927+0000 7f238ab23700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23841f6500 con 0x7f23840ce7d0 2023-10-14T12:35:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.927+0000 7f238ab23700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23841f67a0 con 0x7f238415b6c0 2023-10-14T12:35:01.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.927+0000 7f238ab23700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23841f6a80 con 0x7f23840b1260 2023-10-14T12:35:01.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f2383fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 0x7f23840c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f2383fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 0x7f23840c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49072/0 (socket says 172.21.15.72:49072) 2023-10-14T12:35:01.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f2383fff700 1 -- 172.21.15.72:0/3551594226 learned_addr learned my addr 172.21.15.72:0/3551594226 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:01.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f23890c0700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f238415b6c0 0x7f23840c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f2383fff700 1 -- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23840b1260 msgr2=0x7f23841f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f23888bf700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23840b1260 0x7f23841f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f2383fff700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23840b1260 0x7f23841f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f2383fff700 1 -- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f238415b6c0 msgr2=0x7f23840c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f2383fff700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f238415b6c0 0x7f23840c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f2383fff700 1 -- 172.21.15.72:0/3551594226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c009b30 con 0x7f23840ce7d0 2023-10-14T12:35:01.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f23890c0700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f238415b6c0 0x7f23840c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:35:01.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f23888bf700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f23840b1260 0x7f23841f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:35:01.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f2383fff700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 0x7f23840c79f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f237000b530 tx=0x7f237000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f23817fa700 1 -- 172.21.15.72:0/3551594226 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370011830 con 0x7f23840ce7d0 2023-10-14T12:35:01.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f23817fa700 1 -- 172.21.15.72:0/3551594226 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23700119b0 con 0x7f23840ce7d0 2023-10-14T12:35:01.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23841f6d60 con 0x7f23840ce7d0 2023-10-14T12:35:01.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f23817fa700 1 -- 172.21.15.72:0/3551594226 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370011d60 con 0x7f23840ce7d0 2023-10-14T12:35:01.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.928+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23841f2aa0 con 0x7f23840ce7d0 2023-10-14T12:35:01.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.929+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23841f6910 con 0x7f23840ce7d0 2023-10-14T12:35:01.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.930+0000 7f23817fa700 1 -- 172.21.15.72:0/3551594226 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f237001a400 con 0x7f23840ce7d0 2023-10-14T12:35:01.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.930+0000 7f23817fa700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f236806af00 0x7f236806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.930+0000 7f23817fa700 1 -- 172.21.15.72:0/3551594226 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2370089ea0 con 0x7f23840ce7d0 2023-10-14T12:35:01.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.930+0000 7f23888bf700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f236806af00 0x7f236806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.930+0000 7f23817fa700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f2368073690 0x7f2368075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:01.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.930+0000 7f23817fa700 1 -- 172.21.15.72:0/3551594226 --> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f23680761e0 con 0x7f2368073690 2023-10-14T12:35:01.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.930+0000 7f23817fa700 1 -- 172.21.15.72:0/3551594226 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f237008a2f0 con 0x7f23840ce7d0 2023-10-14T12:35:01.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.931+0000 7f23890c0700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f2368073690 0x7f2368075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:01.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.931+0000 7f23888bf700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f236806af00 0x7f236806d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2378006fd0 tx=0x7f2378008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.931+0000 7f23890c0700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f2368073690 0x7f2368075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:01.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.932+0000 7f23817fa700 1 -- 172.21.15.72:0/3551594226 <== osd.4 v2:172.21.15.123:6800/2822863008 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f23680761e0 con 0x7f2368073690 2023-10-14T12:35:01.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.946+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 --> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f23841f6bf0 con 0x7f2368073690 2023-10-14T12:35:01.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.947+0000 7f23817fa700 1 -- 172.21.15.72:0/3551594226 <== osd.4 v2:172.21.15.123:6800/2822863008 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f23841f6bf0 con 0x7f2368073690 2023-10-14T12:35:01.951 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:35:01.951 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:35:01.951 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:35:01.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.947+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f2368073690 msgr2=0x7f2368075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.947+0000 7f238ab23700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.123:6800/2822863008,v1:172.21.15.123:6801/2822863008] conn(0x7f2368073690 0x7f2368075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.947+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f236806af00 msgr2=0x7f236806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.947+0000 7f238ab23700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f236806af00 0x7f236806d3c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2378006fd0 tx=0x7f2378008040 comp rx=0 tx=0).stop 2023-10-14T12:35:01.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.947+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 msgr2=0x7f23840c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:01.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.947+0000 7f238ab23700 1 --2- 172.21.15.72:0/3551594226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23840ce7d0 0x7f23840c79f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f237000b530 tx=0x7f237000b8f0 comp rx=0 tx=0).stop 2023-10-14T12:35:01.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.948+0000 7f23890c0700 1 -- 172.21.15.72:0/3551594226 reap_dead start 2023-10-14T12:35:01.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.948+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 shutdown_connections 2023-10-14T12:35:01.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.948+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 >> 172.21.15.72:0/3551594226 conn(0x7f23840cbb50 msgr2=0x7f23840ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:01.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.948+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 shutdown_connections 2023-10-14T12:35:01.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:01.948+0000 7f238ab23700 1 -- 172.21.15.72:0/3551594226 wait complete. 2023-10-14T12:35:01.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T12:35:02.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.081+0000 7f32e614d700 1 Processor -- start 2023-10-14T12:35:02.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.081+0000 7f32e614d700 1 -- start start 2023-10-14T12:35:02.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32e614d700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f32e00b3410 0x7f32e00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32e614d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32e00cb8d0 0x7f32e00b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32e614d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e0070d70 con 0x7f32e0152470 2023-10-14T12:35:02.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32e614d700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e0071200 con 0x7f32e00b3410 2023-10-14T12:35:02.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32e614d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00cbd80 con 0x7f32e00cb8d0 2023-10-14T12:35:02.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32df7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f32e0152470 0x7f32e00b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55380/0 (socket says 172.21.15.72:55380) 2023-10-14T12:35:02.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32df7fe700 1 -- 172.21.15.72:0/4059899398 learned_addr learned my addr 172.21.15.72:0/4059899398 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:02.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32deffd700 1 --2- 172.21.15.72:0/4059899398 >> v2:172.21.15.123:3300/0 conn(0x7f32e00b3410 0x7f32e00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32dffff700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32e00cb8d0 0x7f32e00b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999808163 0 0) 0x7f32e0070d70 con 0x7f32e0152470 2023-10-14T12:35:02.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32cc0035b0 con 0x7f32e0152470 2023-10-14T12:35:02.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3919939333 0 0) 0x7f32cc0035b0 con 0x7f32e0152470 2023-10-14T12:35:02.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32e00cb8d0 msgr2=0x7f32e00b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:02.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32de7fc700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32e00cb8d0 0x7f32e00b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 >> v2:172.21.15.123:3300/0 conn(0x7f32e00b3410 msgr2=0x7f32e00cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:02.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.082+0000 7f32de7fc700 1 --2- 172.21.15.72:0/4059899398 >> v2:172.21.15.123:3300/0 conn(0x7f32e00b3410 0x7f32e00cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e0070440 con 0x7f32e0152470 2023-10-14T12:35:02.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f32d0001670 con 0x7f32e0152470 2023-10-14T12:35:02.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 >> v1:172.21.15.72:6789/0 conn(0x7f32e0152470 legacy=0x7f32e00b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32cc003a00 0x7f32cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32cc004850 0x7f32cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32e00cb8d0 0x7f32cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0071200 con 0x7f32cc003a00 2023-10-14T12:35:02.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00cbd80 con 0x7f32cc004850 2023-10-14T12:35:02.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc00ba90 con 0x7f32e00cb8d0 2023-10-14T12:35:02.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32df7fe700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32cc003a00 0x7f32cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32deffd700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32cc004850 0x7f32cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32dffff700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32e00cb8d0 0x7f32cc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32df7fe700 1 -- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32e00cb8d0 msgr2=0x7f32cc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32df7fe700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32e00cb8d0 0x7f32cc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32df7fe700 1 -- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32cc004850 msgr2=0x7f32cc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32df7fe700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32cc004850 0x7f32cc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32df7fe700 1 -- 172.21.15.72:0/4059899398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0035b0 con 0x7f32cc003a00 2023-10-14T12:35:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32deffd700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32cc004850 0x7f32cc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:35:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32df7fe700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32cc003a00 0x7f32cc003e20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f32d000c370 tx=0x7f32cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d683ae1fe42e21c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0007c60 con 0x7f32cc003a00 2023-10-14T12:35:02.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d0005960 con 0x7f32cc003a00 2023-10-14T12:35:02.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.083+0000 7f32de7fc700 1 -- 172.21.15.72:0/4059899398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0005d10 con 0x7f32cc003a00 2023-10-14T12:35:02.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.084+0000 7f32e614d700 1 -- 172.21.15.72:0/4059899398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32cc003a00 msgr2=0x7f32cc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.084+0000 7f32e614d700 1 --2- 172.21.15.72:0/4059899398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32cc003a00 0x7f32cc003e20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f32d000c370 tx=0x7f32cc005880 comp rx=0 tx=0).stop 2023-10-14T12:35:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.084+0000 7f32dffff700 1 -- 172.21.15.72:0/4059899398 reap_dead start 2023-10-14T12:35:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.084+0000 7f32e614d700 1 -- 172.21.15.72:0/4059899398 shutdown_connections 2023-10-14T12:35:02.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.084+0000 7f32e614d700 1 -- 172.21.15.72:0/4059899398 >> 172.21.15.72:0/4059899398 conn(0x7f32e00cdd00 msgr2=0x7f32e00ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:02.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.084+0000 7f32e614d700 1 -- 172.21.15.72:0/4059899398 shutdown_connections 2023-10-14T12:35:02.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.084+0000 7f32e614d700 1 -- 172.21.15.72:0/4059899398 wait complete. 2023-10-14T12:35:02.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.085+0000 7f32e614d700 1 Processor -- start 2023-10-14T12:35:02.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.085+0000 7f32e614d700 1 -- start start 2023-10-14T12:35:02.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32e614d700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32cc003a00 0x7f32e015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32e614d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e00c8d40 0x7f32e01f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32e614d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32e00ca850 0x7f32e00cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32e614d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e014efa0 con 0x7f32e00ca850 2023-10-14T12:35:02.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32e614d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e00c5c70 con 0x7f32e00c8d40 2023-10-14T12:35:02.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32e614d700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01f0be0 con 0x7f32cc003a00 2023-10-14T12:35:02.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32e00ca850 0x7f32e00cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32dffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32e00ca850 0x7f32e00cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49096/0 (socket says 172.21.15.72:49096) 2023-10-14T12:35:02.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32dffff700 1 -- 172.21.15.72:0/941447115 learned_addr learned my addr 172.21.15.72:0/941447115 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:02.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32deffd700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e00c8d40 0x7f32e01f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32df7fe700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32cc003a00 0x7f32e015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.107 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32dffff700 1 -- 172.21.15.72:0/941447115 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32cc003a00 msgr2=0x7f32e015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32dffff700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32cc003a00 0x7f32e015d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32dffff700 1 -- 172.21.15.72:0/941447115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e00c8d40 msgr2=0x7f32e01f06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32dffff700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e00c8d40 0x7f32e01f06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32dffff700 1 -- 172.21.15.72:0/941447115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e014f2e0 con 0x7f32e00ca850 2023-10-14T12:35:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.086+0000 7f32dffff700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32e00ca850 0x7f32e00cacd0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f32e00cedd0 tx=0x7f32d80114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.087+0000 7f32d7fff700 1 -- 172.21.15.72:0/941447115 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d800e070 con 0x7f32e00ca850 2023-10-14T12:35:02.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.087+0000 7f32d7fff700 1 -- 172.21.15.72:0/941447115 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d8003cf0 con 0x7f32e00ca850 2023-10-14T12:35:02.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.087+0000 7f32d7fff700 1 -- 172.21.15.72:0/941447115 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8003ea0 con 0x7f32e00ca850 2023-10-14T12:35:02.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.087+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e015d950 con 0x7f32e00ca850 2023-10-14T12:35:02.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.087+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e015df10 con 0x7f32e00ca850 2023-10-14T12:35:02.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.088+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e00c5e00 con 0x7f32e00ca850 2023-10-14T12:35:02.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.088+0000 7f32d7fff700 1 -- 172.21.15.72:0/941447115 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32d8011960 con 0x7f32e00ca850 2023-10-14T12:35:02.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.088+0000 7f32d7fff700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f32c006af00 0x7f32c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.088+0000 7f32d7fff700 1 -- 172.21.15.72:0/941447115 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f32d8089bb0 con 0x7f32e00ca850 2023-10-14T12:35:02.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.088+0000 7f32df7fe700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f32c006af00 0x7f32c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.089+0000 7f32df7fe700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f32c006af00 0x7f32c006d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f32d0015040 tx=0x7f32d000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.093+0000 7f32d7fff700 1 -- 172.21.15.72:0/941447115 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32d8054b90 con 0x7f32e00ca850 2023-10-14T12:35:02.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.283+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f32e0070a00 con 0x7f32c006af00 2023-10-14T12:35:02.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.283+0000 7f32d7fff700 1 -- 172.21.15.72:0/941447115 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f32d000ccb0 con 0x7f32c006af00 2023-10-14T12:35:02.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f32c006af00 msgr2=0x7f32c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f32c006af00 0x7f32c006d3c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f32d0015040 tx=0x7f32d000a000 comp rx=0 tx=0).stop 2023-10-14T12:35:02.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32e00ca850 msgr2=0x7f32e00cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32e00ca850 0x7f32e00cacd0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f32e00cedd0 tx=0x7f32d80114b0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 shutdown_connections 2023-10-14T12:35:02.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f32c006af00 0x7f32c006d3c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32e00ca850 0x7f32e00cacd0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f32cc003a00 0x7f32e015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 --2- 172.21.15.72:0/941447115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32e00c8d40 0x7f32e01f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 >> 172.21.15.72:0/941447115 conn(0x7f32e00cdd00 msgr2=0x7f32e00b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:02.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 shutdown_connections 2023-10-14T12:35:02.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.285+0000 7f32e614d700 1 -- 172.21.15.72:0/941447115 wait complete. 2023-10-14T12:35:02.291 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T12:35:02.298 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T12:35:02.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:35:02.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.422+0000 7f40e282a700 1 Processor -- start 2023-10-14T12:35:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.422+0000 7f40e282a700 1 -- start start 2023-10-14T12:35:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e282a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0cf400 0x7f40dc0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e282a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40dc143970 0x7f40dc06cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e282a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc1613d0 con 0x7f40dc0ce1c0 2023-10-14T12:35:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e282a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc143de0 con 0x7f40dc143970 2023-10-14T12:35:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e282a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc15edf0 con 0x7f40dc0cf400 2023-10-14T12:35:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e0dc7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40dc143970 0x7f40dc06cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40db7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f40dc0ce1c0 0x7f40dc143260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55400/0 (socket says 172.21.15.72:55400) 2023-10-14T12:35:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40db7fe700 1 -- 172.21.15.72:0/460052429 learned_addr learned my addr 172.21.15.72:0/460052429 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40dbfff700 1 --2- 172.21.15.72:0/460052429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0cf400 0x7f40dc0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e0dc7700 1 -- 172.21.15.72:0/460052429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0cf400 msgr2=0x7f40dc0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e0dc7700 1 --2- 172.21.15.72:0/460052429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0cf400 0x7f40dc0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e0dc7700 1 -- 172.21.15.72:0/460052429 >> v1:172.21.15.72:6789/0 conn(0x7f40dc0ce1c0 legacy=0x7f40dc143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40daffd700 1 -- 172.21.15.72:0/460052429 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802383510 0 0) 0x7f40dc1613d0 con 0x7f40dc0ce1c0 2023-10-14T12:35:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e0dc7700 1 -- 172.21.15.72:0/460052429 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc161620 con 0x7f40dc143970 2023-10-14T12:35:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40dbfff700 1 --2- 172.21.15.72:0/460052429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0cf400 0x7f40dc0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:35:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40e0dc7700 1 --2- 172.21.15.72:0/460052429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 0x7f40dc06cc00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009d90 tx=0x7f40d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e6b88fad237642 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40daffd700 1 -- 172.21.15.72:0/460052429 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400e070 con 0x7f40dc143970 2023-10-14T12:35:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.423+0000 7f40daffd700 1 -- 172.21.15.72:0/460052429 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400bbd0 con 0x7f40dc143970 2023-10-14T12:35:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.424+0000 7f40daffd700 1 -- 172.21.15.72:0/460052429 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4012430 con 0x7f40dc143970 2023-10-14T12:35:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.424+0000 7f40e282a700 1 -- 172.21.15.72:0/460052429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 msgr2=0x7f40dc06cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.424+0000 7f40e282a700 1 --2- 172.21.15.72:0/460052429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 0x7f40dc06cc00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009d90 tx=0x7f40d400b330 comp rx=0 tx=0).stop 2023-10-14T12:35:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.424+0000 7f40e282a700 1 -- 172.21.15.72:0/460052429 shutdown_connections 2023-10-14T12:35:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.424+0000 7f40e282a700 1 --2- 172.21.15.72:0/460052429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 0x7f40dc06cc00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.424+0000 7f40e282a700 1 --2- 172.21.15.72:0/460052429 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0cf400 0x7f40dc0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.424+0000 7f40e282a700 1 -- 172.21.15.72:0/460052429 >> 172.21.15.72:0/460052429 conn(0x7f40dc06a820 msgr2=0x7f40dc06ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.424+0000 7f40e282a700 1 -- 172.21.15.72:0/460052429 shutdown_connections 2023-10-14T12:35:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.424+0000 7f40e282a700 1 -- 172.21.15.72:0/460052429 wait complete. 2023-10-14T12:35:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.425+0000 7f40e282a700 1 Processor -- start 2023-10-14T12:35:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.425+0000 7f40e282a700 1 -- start start 2023-10-14T12:35:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40e282a700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0ce1c0 0x7f40dc1f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40e282a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40dc0cf400 0x7f40dc0b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40e282a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 0x7f40dc0b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40e282a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0c4700 con 0x7f40dc143970 2023-10-14T12:35:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40e282a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0b37b0 con 0x7f40dc0cf400 2023-10-14T12:35:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40e282a700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0b2ba0 con 0x7f40dc0ce1c0 2023-10-14T12:35:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40e0dc7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 0x7f40dc0b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40e0dc7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 0x7f40dc0b5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49110/0 (socket says 172.21.15.72:49110) 2023-10-14T12:35:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40e0dc7700 1 -- 172.21.15.72:0/87412794 learned_addr learned my addr 172.21.15.72:0/87412794 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40db7fe700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40dc0cf400 0x7f40dc0b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.426+0000 7f40dbfff700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0ce1c0 0x7f40dc1f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40e0dc7700 1 -- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0ce1c0 msgr2=0x7f40dc1f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40e0dc7700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f40dc0ce1c0 0x7f40dc1f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40e0dc7700 1 -- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40dc0cf400 msgr2=0x7f40dc0b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40e0dc7700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40dc0cf400 0x7f40dc0b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40e0dc7700 1 -- 172.21.15.72:0/87412794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4009a70 con 0x7f40dc143970 2023-10-14T12:35:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40e0dc7700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 0x7f40dc0b5680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f40d4014040 tx=0x7f40d4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40d8ff9700 1 -- 172.21.15.72:0/87412794 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4012430 con 0x7f40dc143970 2023-10-14T12:35:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40d8ff9700 1 -- 172.21.15.72:0/87412794 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4020070 con 0x7f40dc143970 2023-10-14T12:35:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc0b2e80 con 0x7f40dc143970 2023-10-14T12:35:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40d8ff9700 1 -- 172.21.15.72:0/87412794 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4004280 con 0x7f40dc143970 2023-10-14T12:35:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.427+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc0b3440 con 0x7f40dc143970 2023-10-14T12:35:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.428+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40dc161be0 con 0x7f40dc143970 2023-10-14T12:35:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.428+0000 7f40d8ff9700 1 -- 172.21.15.72:0/87412794 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40d40043e0 con 0x7f40dc143970 2023-10-14T12:35:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.429+0000 7f40d8ff9700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f40c806af00 0x7f40c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.429+0000 7f40dbfff700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f40c806af00 0x7f40c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.429+0000 7f40d8ff9700 1 -- 172.21.15.72:0/87412794 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f40d4022070 con 0x7f40dc143970 2023-10-14T12:35:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.429+0000 7f40d8ff9700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7f40c8073690 0x7f40c8075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.429+0000 7f40d8ff9700 1 -- 172.21.15.72:0/87412794 --> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40c80761e0 con 0x7f40c8073690 2023-10-14T12:35:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.429+0000 7f40d8ff9700 1 -- 172.21.15.72:0/87412794 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40d408da60 con 0x7f40dc143970 2023-10-14T12:35:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.429+0000 7f40dbfff700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f40c806af00 0x7f40c806d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009930 tx=0x7f40cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.429+0000 7f40db7fe700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7f40c8073690 0x7f40c8075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.430+0000 7f40db7fe700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7f40c8073690 0x7f40c8075b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.430+0000 7f40d8ff9700 1 -- 172.21.15.72:0/87412794 <== osd.5 v2:172.21.15.123:6809/1151915294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f40c80761e0 con 0x7f40c8073690 2023-10-14T12:35:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 --> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40dc161900 con 0x7f40c8073690 2023-10-14T12:35:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40d8ff9700 1 -- 172.21.15.72:0/87412794 <== osd.5 v2:172.21.15.123:6809/1151915294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f40d0007050 con 0x7f40c8073690 2023-10-14T12:35:02.447 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:35:02.448 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:35:02.448 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:35:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7f40c8073690 msgr2=0x7f40c8075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e282a700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.123:6809/1151915294,v1:172.21.15.123:6811/1151915294] conn(0x7f40c8073690 0x7f40c8075b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f40c806af00 msgr2=0x7f40c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e282a700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f40c806af00 0x7f40c806d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f40cc009930 tx=0x7f40cc008040 comp rx=0 tx=0).stop 2023-10-14T12:35:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 msgr2=0x7f40dc0b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e282a700 1 --2- 172.21.15.72:0/87412794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40dc143970 0x7f40dc0b5680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f40d4014040 tx=0x7f40d4004ad0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e0dc7700 1 -- 172.21.15.72:0/87412794 reap_dead start 2023-10-14T12:35:02.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 shutdown_connections 2023-10-14T12:35:02.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.445+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 >> 172.21.15.72:0/87412794 conn(0x7f40dc06a820 msgr2=0x7f40dc06c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:02.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.446+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 shutdown_connections 2023-10-14T12:35:02.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.446+0000 7f40e282a700 1 -- 172.21.15.72:0/87412794 wait complete. 2023-10-14T12:35:02.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T12:35:02.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.582+0000 7f533d6b5700 1 Processor -- start 2023-10-14T12:35:02.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.582+0000 7f533d6b5700 1 -- start start 2023-10-14T12:35:02.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.582+0000 7f533d6b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5338160b50 0x7f53380cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.582+0000 7f533d6b5700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f53380b9000 0x7f53380b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.582+0000 7f533d6b5700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53380b5980 con 0x7f53380b5530 2023-10-14T12:35:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.582+0000 7f533d6b5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53380b94b0 con 0x7f5338160b50 2023-10-14T12:35:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.582+0000 7f533d6b5700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53380d0010 con 0x7f53380b9000 2023-10-14T12:35:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5336ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5338160b50 0x7f53380cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5336ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5338160b50 0x7f53380cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49116/0 (socket says 172.21.15.72:49116) 2023-10-14T12:35:02.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5336ffd700 1 -- 172.21.15.72:0/4035787402 learned_addr learned my addr 172.21.15.72:0/4035787402 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:02.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f53367fc700 1 --2- 172.21.15.72:0/4035787402 >> v2:172.21.15.123:3300/0 conn(0x7f53380b9000 0x7f53380b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5336ffd700 1 -- 172.21.15.72:0/4035787402 >> v2:172.21.15.123:3300/0 conn(0x7f53380b9000 msgr2=0x7f53380b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:02.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5336ffd700 1 --2- 172.21.15.72:0/4035787402 >> v2:172.21.15.123:3300/0 conn(0x7f53380b9000 0x7f53380b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5336ffd700 1 -- 172.21.15.72:0/4035787402 >> v1:172.21.15.123:6789/0 conn(0x7f53380b5530 legacy=0x7f53381611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5336ffd700 1 -- 172.21.15.72:0/4035787402 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380d02f0 con 0x7f5338160b50 2023-10-14T12:35:02.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5336ffd700 1 --2- 172.21.15.72:0/4035787402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338160b50 0x7f53380cf980 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f53200098f0 tx=0x7f5320009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bbbee41cf7949d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5335ffb700 1 -- 172.21.15.72:0/4035787402 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320011830 con 0x7f5338160b50 2023-10-14T12:35:02.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5335ffb700 1 -- 172.21.15.72:0/4035787402 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5320011990 con 0x7f5338160b50 2023-10-14T12:35:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.583+0000 7f5335ffb700 1 -- 172.21.15.72:0/4035787402 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320011d20 con 0x7f5338160b50 2023-10-14T12:35:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.584+0000 7f533d6b5700 1 -- 172.21.15.72:0/4035787402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338160b50 msgr2=0x7f53380cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.584+0000 7f533d6b5700 1 --2- 172.21.15.72:0/4035787402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338160b50 0x7f53380cf980 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f53200098f0 tx=0x7f5320009c00 comp rx=0 tx=0).stop 2023-10-14T12:35:02.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.584+0000 7f533d6b5700 1 -- 172.21.15.72:0/4035787402 shutdown_connections 2023-10-14T12:35:02.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.584+0000 7f533d6b5700 1 --2- 172.21.15.72:0/4035787402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338160b50 0x7f53380cf980 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.584+0000 7f533d6b5700 1 --2- 172.21.15.72:0/4035787402 >> v2:172.21.15.123:3300/0 conn(0x7f53380b9000 0x7f53380b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.584+0000 7f533d6b5700 1 -- 172.21.15.72:0/4035787402 >> 172.21.15.72:0/4035787402 conn(0x7f533806bc70 msgr2=0x7f533806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.584+0000 7f533d6b5700 1 -- 172.21.15.72:0/4035787402 shutdown_connections 2023-10-14T12:35:02.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.584+0000 7f533d6b5700 1 -- 172.21.15.72:0/4035787402 wait complete. 2023-10-14T12:35:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.585+0000 7f533d6b5700 1 Processor -- start 2023-10-14T12:35:02.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.585+0000 7f533d6b5700 1 -- start start 2023-10-14T12:35:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f533d6b5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53380b5530 0x7f5338154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f533d6b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53380b9000 0x7f533815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f533d6b5700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5338160b50 0x7f53381569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f533d6b5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53381594e0 con 0x7f53380b9000 2023-10-14T12:35:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f533d6b5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5338154fd0 con 0x7f53380b5530 2023-10-14T12:35:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f533d6b5700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533815c580 con 0x7f5338160b50 2023-10-14T12:35:02.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53367fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53380b9000 0x7f533815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53367fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53380b9000 0x7f533815bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49124/0 (socket says 172.21.15.72:49124) 2023-10-14T12:35:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53367fc700 1 -- 172.21.15.72:0/1905263688 learned_addr learned my addr 172.21.15.72:0/1905263688 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f5336ffd700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53380b5530 0x7f5338154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53377fe700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5338160b50 0x7f53381569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53367fc700 1 -- 172.21.15.72:0/1905263688 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5338160b50 msgr2=0x7f53381569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53367fc700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5338160b50 0x7f53381569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53367fc700 1 -- 172.21.15.72:0/1905263688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53380b5530 msgr2=0x7f5338154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53367fc700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53380b5530 0x7f5338154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53367fc700 1 -- 172.21.15.72:0/1905263688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5320009550 con 0x7f53380b9000 2023-10-14T12:35:02.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f5336ffd700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53380b5530 0x7f5338154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:35:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.586+0000 7f53367fc700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53380b9000 0x7f533815bb00 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f532800e9b0 tx=0x7f532800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.587+0000 7f532f7fe700 1 -- 172.21.15.72:0/1905263688 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5328009710 con 0x7f53380b9000 2023-10-14T12:35:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.587+0000 7f532f7fe700 1 -- 172.21.15.72:0/1905263688 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532800c850 con 0x7f53380b9000 2023-10-14T12:35:02.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.587+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53381f34a0 con 0x7f53380b9000 2023-10-14T12:35:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.587+0000 7f532f7fe700 1 -- 172.21.15.72:0/1905263688 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532800cbc0 con 0x7f53380b9000 2023-10-14T12:35:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.587+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53381f3ca0 con 0x7f53380b9000 2023-10-14T12:35:02.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.587+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533804ebb0 con 0x7f53380b9000 2023-10-14T12:35:02.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.588+0000 7f532f7fe700 1 -- 172.21.15.72:0/1905263688 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f532800cd20 con 0x7f53380b9000 2023-10-14T12:35:02.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.588+0000 7f532f7fe700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f531806af00 0x7f531806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.588+0000 7f532f7fe700 1 -- 172.21.15.72:0/1905263688 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f5328089830 con 0x7f53380b9000 2023-10-14T12:35:02.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.588+0000 7f5336ffd700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f531806af00 0x7f531806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.589+0000 7f5336ffd700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f531806af00 0x7f531806d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5320014040 tx=0x7f5320008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.593+0000 7f532f7fe700 1 -- 172.21.15.72:0/1905263688 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5328054780 con 0x7f53380b9000 2023-10-14T12:35:02.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.783+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f53380ce160 con 0x7f531806af00 2023-10-14T12:35:02.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.783+0000 7f532f7fe700 1 -- 172.21.15.72:0/1905263688 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5320011c00 con 0x7f531806af00 2023-10-14T12:35:02.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f531806af00 msgr2=0x7f531806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f531806af00 0x7f531806d3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5320014040 tx=0x7f5320008030 comp rx=0 tx=0).stop 2023-10-14T12:35:02.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53380b9000 msgr2=0x7f533815bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53380b9000 0x7f533815bb00 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f532800e9b0 tx=0x7f532800ed70 comp rx=0 tx=0).stop 2023-10-14T12:35:02.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 shutdown_connections 2023-10-14T12:35:02.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f531806af00 0x7f531806d3c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5338160b50 0x7f53381569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53380b5530 0x7f5338154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 --2- 172.21.15.72:0/1905263688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53380b9000 0x7f533815bb00 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 >> 172.21.15.72:0/1905263688 conn(0x7f533806bc70 msgr2=0x7f5338155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 shutdown_connections 2023-10-14T12:35:02.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.785+0000 7f533d6b5700 1 -- 172.21.15.72:0/1905263688 wait complete. 2023-10-14T12:35:02.791 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T12:35:02.799 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T12:35:02.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:35:02.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.923+0000 7f66bafc1700 1 Processor -- start 2023-10-14T12:35:02.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.923+0000 7f66bafc1700 1 -- start start 2023-10-14T12:35:02.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66bafc1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66b415b210 0x7f66b40b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66bafc1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f66b40cf540 0x7f66b415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66bafc1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b40b3220 con 0x7f66b4161f30 2023-10-14T12:35:02.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66bafc1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b4161240 con 0x7f66b415b210 2023-10-14T12:35:02.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66bafc1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b40b34f0 con 0x7f66b40cf540 2023-10-14T12:35:02.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b8d5d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66b415b210 0x7f66b40b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f66b4161f30 0x7f66b40cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55430/0 (socket says 172.21.15.72:55430) 2023-10-14T12:35:02.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b3fff700 1 -- 172.21.15.72:0/3352901604 learned_addr learned my addr 172.21.15.72:0/3352901604 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:02.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b955e700 1 --2- 172.21.15.72:0/3352901604 >> v2:172.21.15.123:3300/0 conn(0x7f66b40cf540 0x7f66b415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b8d5d700 1 -- 172.21.15.72:0/3352901604 >> v2:172.21.15.123:3300/0 conn(0x7f66b40cf540 msgr2=0x7f66b415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b8d5d700 1 --2- 172.21.15.72:0/3352901604 >> v2:172.21.15.123:3300/0 conn(0x7f66b40cf540 0x7f66b415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b8d5d700 1 -- 172.21.15.72:0/3352901604 >> v1:172.21.15.72:6789/0 conn(0x7f66b4161f30 legacy=0x7f66b40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b37fe700 1 -- 172.21.15.72:0/3352901604 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951391713 0 0) 0x7f66b40b3220 con 0x7f66b4161f30 2023-10-14T12:35:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b8d5d700 1 -- 172.21.15.72:0/3352901604 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4161450 con 0x7f66b415b210 2023-10-14T12:35:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b8d5d700 1 --2- 172.21.15.72:0/3352901604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 0x7f66b40b2ce0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009840 tx=0x7f66a8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2ed0f0da75804a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b37fe700 1 -- 172.21.15.72:0/3352901604 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8011830 con 0x7f66b415b210 2023-10-14T12:35:02.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b37fe700 1 -- 172.21.15.72:0/3352901604 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a8011990 con 0x7f66b415b210 2023-10-14T12:35:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.924+0000 7f66b37fe700 1 -- 172.21.15.72:0/3352901604 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8011d20 con 0x7f66b415b210 2023-10-14T12:35:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.925+0000 7f66bafc1700 1 -- 172.21.15.72:0/3352901604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 msgr2=0x7f66b40b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.925+0000 7f66bafc1700 1 --2- 172.21.15.72:0/3352901604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 0x7f66b40b2ce0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f66a8009840 tx=0x7f66a8009b50 comp rx=0 tx=0).stop 2023-10-14T12:35:02.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.925+0000 7f66bafc1700 1 -- 172.21.15.72:0/3352901604 shutdown_connections 2023-10-14T12:35:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.925+0000 7f66bafc1700 1 --2- 172.21.15.72:0/3352901604 >> v2:172.21.15.123:3300/0 conn(0x7f66b40cf540 0x7f66b415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.925+0000 7f66bafc1700 1 --2- 172.21.15.72:0/3352901604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 0x7f66b40b2ce0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.925+0000 7f66bafc1700 1 -- 172.21.15.72:0/3352901604 >> 172.21.15.72:0/3352901604 conn(0x7f66b40cdce0 msgr2=0x7f66b40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.925+0000 7f66bafc1700 1 -- 172.21.15.72:0/3352901604 shutdown_connections 2023-10-14T12:35:02.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.925+0000 7f66bafc1700 1 -- 172.21.15.72:0/3352901604 wait complete. 2023-10-14T12:35:02.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.926+0000 7f66bafc1700 1 Processor -- start 2023-10-14T12:35:02.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.927+0000 7f66bafc1700 1 -- start start 2023-10-14T12:35:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66bafc1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b40cf540 0x7f66b40cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66bafc1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 0x7f66b41f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66bafc1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b4161f30 0x7f66b40c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66bafc1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40b3df0 con 0x7f66b415b210 2023-10-14T12:35:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66bafc1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40c92a0 con 0x7f66b4161f30 2023-10-14T12:35:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66bafc1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b40cb320 con 0x7f66b40cf540 2023-10-14T12:35:02.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 0x7f66b41f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 0x7f66b41f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49136/0 (socket says 172.21.15.72:49136) 2023-10-14T12:35:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b3fff700 1 -- 172.21.15.72:0/3246668305 learned_addr learned my addr 172.21.15.72:0/3246668305 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b955e700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b4161f30 0x7f66b40c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b8d5d700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b40cf540 0x7f66b40cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b3fff700 1 -- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b40cf540 msgr2=0x7f66b40cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b3fff700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f66b40cf540 0x7f66b40cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b3fff700 1 -- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b4161f30 msgr2=0x7f66b40c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b3fff700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66b4161f30 0x7f66b40c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b3fff700 1 -- 172.21.15.72:0/3246668305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80094a0 con 0x7f66b415b210 2023-10-14T12:35:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b3fff700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 0x7f66b41f2c40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c520 tx=0x7f66a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b17fa700 1 -- 172.21.15.72:0/3246668305 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a0004c80 con 0x7f66b415b210 2023-10-14T12:35:02.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b17fa700 1 -- 172.21.15.72:0/3246668305 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a0004de0 con 0x7f66b415b210 2023-10-14T12:35:02.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b40b4040 con 0x7f66b415b210 2023-10-14T12:35:02.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66b17fa700 1 -- 172.21.15.72:0/3246668305 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00072d0 con 0x7f66b415b210 2023-10-14T12:35:02.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.928+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b40b4600 con 0x7f66b415b210 2023-10-14T12:35:02.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.929+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66b4161a10 con 0x7f66b415b210 2023-10-14T12:35:02.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.930+0000 7f66b17fa700 1 -- 172.21.15.72:0/3246668305 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f66a0007430 con 0x7f66b415b210 2023-10-14T12:35:02.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.930+0000 7f66b17fa700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 0x7f669806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.930+0000 7f66b17fa700 1 -- 172.21.15.72:0/3246668305 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f66a0089450 con 0x7f66b415b210 2023-10-14T12:35:02.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.930+0000 7f66b8d5d700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 0x7f669806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.930+0000 7f66b17fa700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f6698073690 0x7f6698075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:02.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.930+0000 7f66b17fa700 1 -- 172.21.15.72:0/3246668305 --> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66980761e0 con 0x7f6698073690 2023-10-14T12:35:02.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.930+0000 7f66b17fa700 1 -- 172.21.15.72:0/3246668305 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66a008bb10 con 0x7f66b415b210 2023-10-14T12:35:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.930+0000 7f66b955e700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f6698073690 0x7f6698075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.930+0000 7f66b8d5d700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 0x7f669806d3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f66a80090b0 tx=0x7f66a8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.931+0000 7f66b955e700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f6698073690 0x7f6698075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:02.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.932+0000 7f66b17fa700 1 -- 172.21.15.72:0/3246668305 <== osd.6 v2:172.21.15.123:6808/3866020482 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f66980761e0 con 0x7f6698073690 2023-10-14T12:35:02.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.946+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 --> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66b4161730 con 0x7f6698073690 2023-10-14T12:35:02.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66b17fa700 1 -- 172.21.15.72:0/3246668305 <== osd.6 v2:172.21.15.123:6808/3866020482 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f66ac009b70 con 0x7f6698073690 2023-10-14T12:35:02.950 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:35:02.950 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:35:02.951 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:35:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f6698073690 msgr2=0x7f6698075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.123:6808/3866020482,v1:172.21.15.123:6810/3866020482] conn(0x7f6698073690 0x7f6698075b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 msgr2=0x7f669806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f669806af00 0x7f669806d3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f66a80090b0 tx=0x7f66a8008030 comp rx=0 tx=0).stop 2023-10-14T12:35:02.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 msgr2=0x7f66b41f2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:02.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 --2- 172.21.15.72:0/3246668305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66b415b210 0x7f66b41f2c40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f66a000c520 tx=0x7f66a000c8e0 comp rx=0 tx=0).stop 2023-10-14T12:35:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66b955e700 1 -- 172.21.15.72:0/3246668305 reap_dead start 2023-10-14T12:35:02.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 shutdown_connections 2023-10-14T12:35:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 >> 172.21.15.72:0/3246668305 conn(0x7f66b40cdce0 msgr2=0x7f66b406ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 shutdown_connections 2023-10-14T12:35:02.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:02.947+0000 7f66bafc1700 1 -- 172.21.15.72:0/3246668305 wait complete. 2023-10-14T12:35:02.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T12:35:03.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.080+0000 7f5589792700 1 Processor -- start 2023-10-14T12:35:03.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.080+0000 7f5589792700 1 -- start start 2023-10-14T12:35:03.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.080+0000 7f5589792700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5584157d00 0x7f55840cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.080+0000 7f5589792700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55840cf380 0x7f55841612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.080+0000 7f5589792700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55840cf7e0 con 0x7f55841617e0 2023-10-14T12:35:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.080+0000 7f5589792700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55841580e0 con 0x7f5584157d00 2023-10-14T12:35:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.080+0000 7f5589792700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558406c370 con 0x7f55840cf380 2023-10-14T12:35:03.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.081+0000 7f55827fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55840cf380 0x7f55841612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.081+0000 7f5582ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5584157d00 0x7f55840cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.081+0000 7f55827fc700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55840cf380 0x7f55841612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:44796/0 (socket says 172.21.15.72:44796) 2023-10-14T12:35:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.081+0000 7f5582ffd700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5584157d00 0x7f55840cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:37296/0 (socket says 172.21.15.72:37296) 2023-10-14T12:35:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.081+0000 7f55827fc700 1 -- 172.21.15.72:0/274386136 learned_addr learned my addr 172.21.15.72:0/274386136 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.081+0000 7f55827fc700 1 -- 172.21.15.72:0/274386136 >> v2:172.21.15.123:3300/0 conn(0x7f5584157d00 msgr2=0x7f55840cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:03.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.081+0000 7f55827fc700 1 --2- 172.21.15.72:0/274386136 >> v2:172.21.15.123:3300/0 conn(0x7f5584157d00 0x7f55840cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.081+0000 7f55827fc700 1 -- 172.21.15.72:0/274386136 >> v1:172.21.15.123:6789/0 conn(0x7f55841617e0 legacy=0x7f55840b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.081+0000 7f55827fc700 1 -- 172.21.15.72:0/274386136 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558406b9d0 con 0x7f55840cf380 2023-10-14T12:35:03.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f55827fc700 1 --2- 172.21.15.72:0/274386136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55840cf380 0x7f55841612a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55780098f0 tx=0x7f5578009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76c5421d45dbf71a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5581ffb700 1 -- 172.21.15.72:0/274386136 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578011830 con 0x7f55840cf380 2023-10-14T12:35:03.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5581ffb700 1 -- 172.21.15.72:0/274386136 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5578011990 con 0x7f55840cf380 2023-10-14T12:35:03.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5581ffb700 1 -- 172.21.15.72:0/274386136 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578011d20 con 0x7f55840cf380 2023-10-14T12:35:03.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5589792700 1 -- 172.21.15.72:0/274386136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55840cf380 msgr2=0x7f55841612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5589792700 1 --2- 172.21.15.72:0/274386136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55840cf380 0x7f55841612a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55780098f0 tx=0x7f5578009c00 comp rx=0 tx=0).stop 2023-10-14T12:35:03.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5589792700 1 -- 172.21.15.72:0/274386136 shutdown_connections 2023-10-14T12:35:03.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5589792700 1 --2- 172.21.15.72:0/274386136 >> v2:172.21.15.123:3300/0 conn(0x7f5584157d00 0x7f55840cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5589792700 1 --2- 172.21.15.72:0/274386136 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55840cf380 0x7f55841612a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5589792700 1 -- 172.21.15.72:0/274386136 >> 172.21.15.72:0/274386136 conn(0x7f558406a820 msgr2=0x7f558406ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:03.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5589792700 1 -- 172.21.15.72:0/274386136 shutdown_connections 2023-10-14T12:35:03.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.082+0000 7f5589792700 1 -- 172.21.15.72:0/274386136 wait complete. 2023-10-14T12:35:03.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5589792700 1 Processor -- start 2023-10-14T12:35:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5589792700 1 -- start start 2023-10-14T12:35:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5589792700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55840cf380 0x7f55841f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5589792700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5584157d00 0x7f55841f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5589792700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55841617e0 0x7f55840b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5589792700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840b0b10 con 0x7f55840cf380 2023-10-14T12:35:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5589792700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840b0d60 con 0x7f5584157d00 2023-10-14T12:35:03.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5589792700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840b1040 con 0x7f55841617e0 2023-10-14T12:35:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5582ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55840cf380 0x7f55841f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5582ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55840cf380 0x7f55841f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49150/0 (socket says 172.21.15.72:49150) 2023-10-14T12:35:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.084+0000 7f5582ffd700 1 -- 172.21.15.72:0/305108008 learned_addr learned my addr 172.21.15.72:0/305108008 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f55837fe700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55841617e0 0x7f55840b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f55827fc700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5584157d00 0x7f55841f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f5582ffd700 1 -- 172.21.15.72:0/305108008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55841617e0 msgr2=0x7f55840b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f5582ffd700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55841617e0 0x7f55840b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f5582ffd700 1 -- 172.21.15.72:0/305108008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5584157d00 msgr2=0x7f55841f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f5582ffd700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5584157d00 0x7f55841f4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f5582ffd700 1 -- 172.21.15.72:0/305108008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578009550 con 0x7f55840cf380 2023-10-14T12:35:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f5582ffd700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55840cf380 0x7f55841f3b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f557400e9b0 tx=0x7f557400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f556b7fe700 1 -- 172.21.15.72:0/305108008 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574009710 con 0x7f55840cf380 2023-10-14T12:35:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f556b7fe700 1 -- 172.21.15.72:0/305108008 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557400c850 con 0x7f55840cf380 2023-10-14T12:35:03.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f556b7fe700 1 -- 172.21.15.72:0/305108008 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557400cbc0 con 0x7f55840cf380 2023-10-14T12:35:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55840b1320 con 0x7f55840cf380 2023-10-14T12:35:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.085+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55841f46c0 con 0x7f55840cf380 2023-10-14T12:35:03.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.086+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558404ebb0 con 0x7f55840cf380 2023-10-14T12:35:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.087+0000 7f556b7fe700 1 -- 172.21.15.72:0/305108008 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f557400cd20 con 0x7f55840cf380 2023-10-14T12:35:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.087+0000 7f556b7fe700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f557006af00 0x7f557006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.087+0000 7f556b7fe700 1 -- 172.21.15.72:0/305108008 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f55740898d0 con 0x7f55840cf380 2023-10-14T12:35:03.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.087+0000 7f55827fc700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f557006af00 0x7f557006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.087+0000 7f55827fc700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f557006af00 0x7f557006d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5578009c40 tx=0x7f5578008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.091+0000 7f556b7fe700 1 -- 172.21.15.72:0/305108008 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5574054790 con 0x7f55840cf380 2023-10-14T12:35:03.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.278+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f55840b0ed0 con 0x7f557006af00 2023-10-14T12:35:03.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.278+0000 7f556b7fe700 1 -- 172.21.15.72:0/305108008 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f55840b0ed0 con 0x7f557006af00 2023-10-14T12:35:03.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f557006af00 msgr2=0x7f557006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f557006af00 0x7f557006d3c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5578009c40 tx=0x7f5578008030 comp rx=0 tx=0).stop 2023-10-14T12:35:03.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55840cf380 msgr2=0x7f55841f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55840cf380 0x7f55841f3b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f557400e9b0 tx=0x7f557400ed70 comp rx=0 tx=0).stop 2023-10-14T12:35:03.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 shutdown_connections 2023-10-14T12:35:03.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f557006af00 0x7f557006d3c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f55841617e0 0x7f55840b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f55840cf380 0x7f55841f3b00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 --2- 172.21.15.72:0/305108008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5584157d00 0x7f55841f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 >> 172.21.15.72:0/305108008 conn(0x7f558406a820 msgr2=0x7f558415a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:03.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 shutdown_connections 2023-10-14T12:35:03.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.280+0000 7f5589792700 1 -- 172.21.15.72:0/305108008 wait complete. 2023-10-14T12:35:03.286 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T12:35:03.293 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T12:35:03.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T12:35:03.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.418+0000 7f43a48af700 1 Processor -- start 2023-10-14T12:35:03.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.418+0000 7f43a48af700 1 -- start start 2023-10-14T12:35:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f43a48af700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43a015d660 0x7f43a00cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f43a48af700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a0072b70 con 0x7f43a00cd800 2023-10-14T12:35:03.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f43a48af700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a006fb60 con 0x7f43a0161c50 2023-10-14T12:35:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f43a48af700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a0162210 con 0x7f43a015d660 2023-10-14T12:35:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f43a00cd800 0x7f43a006ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55460/0 (socket says 172.21.15.72:55460) 2023-10-14T12:35:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439dd9b700 1 -- 172.21.15.72:0/4236566643 learned_addr learned my addr 172.21.15.72:0/4236566643 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:03.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439e59c700 1 --2- 172.21.15.72:0/4236566643 >> v2:172.21.15.123:3300/0 conn(0x7f43a015d660 0x7f43a00cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654825171 0 0) 0x7f43a0072b70 con 0x7f43a00cd800 2023-10-14T12:35:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43880035b0 con 0x7f43a00cd800 2023-10-14T12:35:03.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198936327 0 0) 0x7f43880035b0 con 0x7f43a00cd800 2023-10-14T12:35:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 >> v2:172.21.15.123:3300/0 conn(0x7f43a015d660 msgr2=0x7f43a00cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 --2- 172.21.15.72:0/4236566643 >> v2:172.21.15.123:3300/0 conn(0x7f43a015d660 0x7f43a00cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 >> v1:172.21.15.123:6789/0 conn(0x7f43a0161c50 legacy=0x7f43a006f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a006a9c0 con 0x7f43a00cd800 2023-10-14T12:35:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f4394001670 con 0x7f43a00cd800 2023-10-14T12:35:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 >> v1:172.21.15.72:6789/0 conn(0x7f43a00cd800 legacy=0x7f43a006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.419+0000 7f439d59a700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4388003a00 0x7f4388003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439d59a700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4388004850 0x7f4388004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439d59a700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4388005210 0x7f438800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0162210 con 0x7f4388004850 2023-10-14T12:35:03.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438800c0b0 con 0x7f4388003a00 2023-10-14T12:35:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438800c270 con 0x7f4388005210 2023-10-14T12:35:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439dd9b700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4388004850 0x7f4388004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439e59c700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4388003a00 0x7f4388003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439ed9d700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4388005210 0x7f438800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439dd9b700 1 -- 172.21.15.72:0/4236566643 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4388005210 msgr2=0x7f438800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439dd9b700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f4388005210 0x7f438800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439dd9b700 1 -- 172.21.15.72:0/4236566643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4388003a00 msgr2=0x7f4388003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:03.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439dd9b700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4388003a00 0x7f4388003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439dd9b700 1 -- 172.21.15.72:0/4236566643 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43880035b0 con 0x7f4388004850 2023-10-14T12:35:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439ed9d700 1 -- 172.21.15.72:0/4236566643 reap_dead start 2023-10-14T12:35:03.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439dd9b700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4388004850 0x7f4388004cd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f439400c210 tx=0x7f4388005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b512286ea564e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394007c10 con 0x7f4388004850 2023-10-14T12:35:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439400cdb0 con 0x7f4388004850 2023-10-14T12:35:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.420+0000 7f439d59a700 1 -- 172.21.15.72:0/4236566643 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394005ba0 con 0x7f4388004850 2023-10-14T12:35:03.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.421+0000 7f43a48af700 1 -- 172.21.15.72:0/4236566643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4388004850 msgr2=0x7f4388004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.421+0000 7f43a48af700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4388004850 0x7f4388004cd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f439400c210 tx=0x7f4388005880 comp rx=0 tx=0).stop 2023-10-14T12:35:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.421+0000 7f43a48af700 1 -- 172.21.15.72:0/4236566643 shutdown_connections 2023-10-14T12:35:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.421+0000 7f43a48af700 1 --2- 172.21.15.72:0/4236566643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4388004850 0x7f4388004cd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.421+0000 7f43a48af700 1 -- 172.21.15.72:0/4236566643 >> 172.21.15.72:0/4236566643 conn(0x7f43a00ccce0 msgr2=0x7f43a00cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:03.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.421+0000 7f43a48af700 1 -- 172.21.15.72:0/4236566643 shutdown_connections 2023-10-14T12:35:03.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.421+0000 7f43a48af700 1 -- 172.21.15.72:0/4236566643 wait complete. 2023-10-14T12:35:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.422+0000 7f43a48af700 1 Processor -- start 2023-10-14T12:35:03.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.422+0000 7f43a48af700 1 -- start start 2023-10-14T12:35:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f43a48af700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4388004850 0x7f43a006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f43a48af700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a015da40 0x7f43a0156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f43a48af700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43a0157070 0x7f43a00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f43a48af700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0157520 con 0x7f43a015da40 2023-10-14T12:35:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f43a48af700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a0157a30 con 0x7f4388004850 2023-10-14T12:35:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f43a48af700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00c6ab0 con 0x7f43a0157070 2023-10-14T12:35:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a015da40 0x7f43a0156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a015da40 0x7f43a0156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49172/0 (socket says 172.21.15.72:49172) 2023-10-14T12:35:03.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439dd9b700 1 -- 172.21.15.72:0/4285320923 learned_addr learned my addr 172.21.15.72:0/4285320923 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:03.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439e59c700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4388004850 0x7f43a006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439ed9d700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43a0157070 0x7f43a00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439dd9b700 1 -- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43a0157070 msgr2=0x7f43a00c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439dd9b700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f43a0157070 0x7f43a00c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439dd9b700 1 -- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4388004850 msgr2=0x7f43a006efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439dd9b700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4388004850 0x7f43a006efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439dd9b700 1 -- 172.21.15.72:0/4285320923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a00b3020 con 0x7f43a015da40 2023-10-14T12:35:03.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f439dd9b700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a015da40 0x7f43a0156b30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f438800c080 tx=0x7f4394001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f438effd700 1 -- 172.21.15.72:0/4285320923 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394001640 con 0x7f43a015da40 2023-10-14T12:35:03.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.423+0000 7f438effd700 1 -- 172.21.15.72:0/4285320923 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43940070d0 con 0x7f43a015da40 2023-10-14T12:35:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.424+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a00b3300 con 0x7f43a015da40 2023-10-14T12:35:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.424+0000 7f438effd700 1 -- 172.21.15.72:0/4285320923 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394007460 con 0x7f43a015da40 2023-10-14T12:35:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.424+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a006f4f0 con 0x7f43a015da40 2023-10-14T12:35:03.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.424+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43a00b2ea0 con 0x7f43a015da40 2023-10-14T12:35:03.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.425+0000 7f438effd700 1 -- 172.21.15.72:0/4285320923 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f43940075c0 con 0x7f43a015da40 2023-10-14T12:35:03.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.425+0000 7f438effd700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f438006af30 0x7f438006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.425+0000 7f438effd700 1 -- 172.21.15.72:0/4285320923 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f439408a600 con 0x7f43a015da40 2023-10-14T12:35:03.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.425+0000 7f439e59c700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f438006af30 0x7f438006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.425+0000 7f438effd700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f43800736c0 0x7f4380075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.425+0000 7f438effd700 1 -- 172.21.15.72:0/4285320923 --> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4380076210 con 0x7f43800736c0 2023-10-14T12:35:03.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.425+0000 7f438effd700 1 -- 172.21.15.72:0/4285320923 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f439408cbe0 con 0x7f43a015da40 2023-10-14T12:35:03.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.426+0000 7f439e59c700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f438006af30 0x7f438006d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f43a00694d0 tx=0x7f4390009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.426+0000 7f439ed9d700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f43800736c0 0x7f4380075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.426+0000 7f439ed9d700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f43800736c0 0x7f4380075b40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.427+0000 7f438effd700 1 -- 172.21.15.72:0/4285320923 <== osd.7 v2:172.21.15.123:6824/4045319468 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f4380076210 con 0x7f43800736c0 2023-10-14T12:35:03.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.441+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 --> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f43a00b37c0 con 0x7f43800736c0 2023-10-14T12:35:03.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.442+0000 7f438effd700 1 -- 172.21.15.72:0/4285320923 <== osd.7 v2:172.21.15.123:6824/4045319468 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f43a00b37c0 con 0x7f43800736c0 2023-10-14T12:35:03.449 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-14T12:35:03.449 INFO:teuthology.orchestra.run.smithi072.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T12:35:03.450 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-14T12:35:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.442+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f43800736c0 msgr2=0x7f4380075b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.442+0000 7f43a48af700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.123:6824/4045319468,v1:172.21.15.123:6825/4045319468] conn(0x7f43800736c0 0x7f4380075b40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.442+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f438006af30 msgr2=0x7f438006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.442+0000 7f43a48af700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f438006af30 0x7f438006d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f43a00694d0 tx=0x7f4390009210 comp rx=0 tx=0).stop 2023-10-14T12:35:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.442+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a015da40 msgr2=0x7f43a0156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.442+0000 7f43a48af700 1 --2- 172.21.15.72:0/4285320923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43a015da40 0x7f43a0156b30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f438800c080 tx=0x7f4394001a00 comp rx=0 tx=0).stop 2023-10-14T12:35:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.442+0000 7f439ed9d700 1 -- 172.21.15.72:0/4285320923 reap_dead start 2023-10-14T12:35:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.443+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 shutdown_connections 2023-10-14T12:35:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.443+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 >> 172.21.15.72:0/4285320923 conn(0x7f43a00ccce0 msgr2=0x7f43a00adb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.443+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 shutdown_connections 2023-10-14T12:35:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.443+0000 7f43a48af700 1 -- 172.21.15.72:0/4285320923 wait complete. 2023-10-14T12:35:03.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T12:35:03.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.577+0000 7fb5511b9700 1 Processor -- start 2023-10-14T12:35:03.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.577+0000 7fb5511b9700 1 -- start start 2023-10-14T12:35:03.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb5511b9700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb54c0b5700 0x7fb54c0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb5511b9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb5511b9700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c0d0010 con 0x7fb54c160b50 2023-10-14T12:35:03.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb5511b9700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0d02f0 con 0x7fb54c0b5700 2023-10-14T12:35:03.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb5511b9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0d05d0 con 0x7fb54c0b9000 2023-10-14T12:35:03.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb54b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb54a59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb54c0b5700 0x7fb54c0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb54b59e700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c0ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:44836/0 (socket says 172.21.15.72:44836) 2023-10-14T12:35:03.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb54a59c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb54c0b5700 0x7fb54c0cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:37334/0 (socket says 172.21.15.72:37334) 2023-10-14T12:35:03.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.578+0000 7fb54b59e700 1 -- 172.21.15.72:0/2460222283 learned_addr learned my addr 172.21.15.72:0/2460222283 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.579+0000 7fb54b59e700 1 -- 172.21.15.72:0/2460222283 >> v2:172.21.15.123:3300/0 conn(0x7fb54c0b5700 msgr2=0x7fb54c0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.579+0000 7fb54b59e700 1 --2- 172.21.15.72:0/2460222283 >> v2:172.21.15.123:3300/0 conn(0x7fb54c0b5700 0x7fb54c0cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.579+0000 7fb54b59e700 1 -- 172.21.15.72:0/2460222283 >> v1:172.21.15.123:6789/0 conn(0x7fb54c160b50 legacy=0x7fb54c0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.579+0000 7fb54b59e700 1 -- 172.21.15.72:0/2460222283 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0ce160 con 0x7fb54c0b9000 2023-10-14T12:35:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.579+0000 7fb54b59e700 1 --2- 172.21.15.72:0/2460222283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c0ce680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e50 tx=0x7fb54400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5835a050708ae9d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.579+0000 7fb549d9b700 1 -- 172.21.15.72:0/2460222283 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400e070 con 0x7fb54c0b9000 2023-10-14T12:35:03.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.579+0000 7fb549d9b700 1 -- 172.21.15.72:0/2460222283 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400b910 con 0x7fb54c0b9000 2023-10-14T12:35:03.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.579+0000 7fb549d9b700 1 -- 172.21.15.72:0/2460222283 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400bcc0 con 0x7fb54c0b9000 2023-10-14T12:35:03.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.580+0000 7fb5511b9700 1 -- 172.21.15.72:0/2460222283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 msgr2=0x7fb54c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.580+0000 7fb5511b9700 1 --2- 172.21.15.72:0/2460222283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c0ce680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e50 tx=0x7fb54400b330 comp rx=0 tx=0).stop 2023-10-14T12:35:03.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.580+0000 7fb5511b9700 1 -- 172.21.15.72:0/2460222283 shutdown_connections 2023-10-14T12:35:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.580+0000 7fb5511b9700 1 --2- 172.21.15.72:0/2460222283 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c0ce680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.580+0000 7fb5511b9700 1 --2- 172.21.15.72:0/2460222283 >> v2:172.21.15.123:3300/0 conn(0x7fb54c0b5700 0x7fb54c0cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.580+0000 7fb5511b9700 1 -- 172.21.15.72:0/2460222283 >> 172.21.15.72:0/2460222283 conn(0x7fb54c06bc70 msgr2=0x7fb54c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.580+0000 7fb5511b9700 1 -- 172.21.15.72:0/2460222283 shutdown_connections 2023-10-14T12:35:03.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.580+0000 7fb5511b9700 1 -- 172.21.15.72:0/2460222283 wait complete. 2023-10-14T12:35:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.581+0000 7fb5511b9700 1 Processor -- start 2023-10-14T12:35:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.581+0000 7fb5511b9700 1 -- start start 2023-10-14T12:35:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb5511b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb54c0b5700 0x7fb54c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb5511b9700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb5511b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb54c160b50 0x7fb54c1f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb5511b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15ac60 con 0x7fb54c0b5700 2023-10-14T12:35:03.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb5511b9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15af40 con 0x7fb54c160b50 2023-10-14T12:35:03.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb5511b9700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15b220 con 0x7fb54c0b9000 2023-10-14T12:35:03.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb54c0b5700 0x7fb54c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb54c0b5700 0x7fb54c15db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49186/0 (socket says 172.21.15.72:49186) 2023-10-14T12:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54ad9d700 1 -- 172.21.15.72:0/1086533691 learned_addr learned my addr 172.21.15.72:0/1086533691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54b59e700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb54c160b50 0x7fb54c1f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54a59c700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54ad9d700 1 -- 172.21.15.72:0/1086533691 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 msgr2=0x7fb54c153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54ad9d700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54ad9d700 1 -- 172.21.15.72:0/1086533691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb54c160b50 msgr2=0x7fb54c1f3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54ad9d700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb54c160b50 0x7fb54c1f3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54ad9d700 1 -- 172.21.15.72:0/1086533691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544009b30 con 0x7fb54c0b5700 2023-10-14T12:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.582+0000 7fb54ad9d700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb54c0b5700 0x7fb54c15db90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00c430 tx=0x7fb53c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.583+0000 7fb5337fe700 1 -- 172.21.15.72:0/1086533691 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0050d0 con 0x7fb54c0b5700 2023-10-14T12:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.583+0000 7fb5337fe700 1 -- 172.21.15.72:0/1086533691 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c005250 con 0x7fb54c0b5700 2023-10-14T12:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.583+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c1f2a40 con 0x7fb54c0b5700 2023-10-14T12:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.583+0000 7fb5337fe700 1 -- 172.21.15.72:0/1086533691 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c006860 con 0x7fb54c0b5700 2023-10-14T12:35:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.583+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c15bb40 con 0x7fb54c0b5700 2023-10-14T12:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.584+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c1f2c30 con 0x7fb54c0b5700 2023-10-14T12:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.584+0000 7fb5337fe700 1 -- 172.21.15.72:0/1086533691 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb53c003680 con 0x7fb54c0b5700 2023-10-14T12:35:03.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.584+0000 7fb5337fe700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb53806af00 0x7fb53806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.585+0000 7fb5337fe700 1 -- 172.21.15.72:0/1086533691 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb53c088810 con 0x7fb54c0b5700 2023-10-14T12:35:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.585+0000 7fb54a59c700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb53806af00 0x7fb53806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.585+0000 7fb54a59c700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb53806af00 0x7fb53806d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0cccd0 tx=0x7fb540009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.589+0000 7fb5337fe700 1 -- 172.21.15.72:0/1086533691 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb53c053760 con 0x7fb54c0b5700 2023-10-14T12:35:03.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.779+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb54c15b0b0 con 0x7fb53806af00 2023-10-14T12:35:03.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.779+0000 7fb5337fe700 1 -- 172.21.15.72:0/1086533691 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb54c15b0b0 con 0x7fb53806af00 2023-10-14T12:35:03.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb53806af00 msgr2=0x7fb53806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb53806af00 0x7fb53806d3c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0cccd0 tx=0x7fb540009210 comp rx=0 tx=0).stop 2023-10-14T12:35:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb54c0b5700 msgr2=0x7fb54c15db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb54c0b5700 0x7fb54c15db90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00c430 tx=0x7fb53c00c740 comp rx=0 tx=0).stop 2023-10-14T12:35:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 shutdown_connections 2023-10-14T12:35:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fb53806af00 0x7fb53806d3c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb54c160b50 0x7fb54c1f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb54c0b5700 0x7fb54c15db90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 --2- 172.21.15.72:0/1086533691 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fb54c0b9000 0x7fb54c153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 >> 172.21.15.72:0/1086533691 conn(0x7fb54c06bc70 msgr2=0x7fb54c0b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 shutdown_connections 2023-10-14T12:35:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.781+0000 7fb5511b9700 1 -- 172.21.15.72:0/1086533691 wait complete. 2023-10-14T12:35:03.786 INFO:teuthology.orchestra.run.smithi072.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T12:35:03.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:35:03.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.917+0000 7f96c8b1b700 1 Processor -- start 2023-10-14T12:35:03.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.917+0000 7f96c8b1b700 1 -- start start 2023-10-14T12:35:03.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c8b1b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96c4160b50 0x7f96c40cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c8b1b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f96c40b5700 0x7f96c40ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c8b1b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40b94b0 con 0x7f96c40b9000 2023-10-14T12:35:03.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c8b1b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40d0010 con 0x7f96c4160b50 2023-10-14T12:35:03.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c8b1b700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40d02f0 con 0x7f96c40b5700 2023-10-14T12:35:03.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96c4160b50 0x7f96c40cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c1d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f96c40b9000 0x7f96c40b4ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55496/0 (socket says 172.21.15.72:55496) 2023-10-14T12:35:03.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c1d9b700 1 -- 172.21.15.72:0/1496656811 learned_addr learned my addr 172.21.15.72:0/1496656811 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:03.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c2d9d700 1 --2- 172.21.15.72:0/1496656811 >> v2:172.21.15.123:3300/0 conn(0x7f96c40b5700 0x7f96c40ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c259c700 1 -- 172.21.15.72:0/1496656811 >> v2:172.21.15.123:3300/0 conn(0x7f96c40b5700 msgr2=0x7f96c40ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:03.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c259c700 1 --2- 172.21.15.72:0/1496656811 >> v2:172.21.15.123:3300/0 conn(0x7f96c40b5700 0x7f96c40ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c259c700 1 -- 172.21.15.72:0/1496656811 >> v1:172.21.15.72:6789/0 conn(0x7f96c40b9000 legacy=0x7f96c40b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c259c700 1 -- 172.21.15.72:0/1496656811 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40d05d0 con 0x7f96c4160b50 2023-10-14T12:35:03.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.918+0000 7f96c159a700 1 -- 172.21.15.72:0/1496656811 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301972398 0 0) 0x7f96c40b94b0 con 0x7f96c40b9000 2023-10-14T12:35:03.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c259c700 1 --2- 172.21.15.72:0/1496656811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 0x7f96c40cf980 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009840 tx=0x7f96b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903fdf5661c23203 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c159a700 1 -- 172.21.15.72:0/1496656811 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8011830 con 0x7f96c4160b50 2023-10-14T12:35:03.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c159a700 1 -- 172.21.15.72:0/1496656811 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b8011990 con 0x7f96c4160b50 2023-10-14T12:35:03.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c159a700 1 -- 172.21.15.72:0/1496656811 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8011d20 con 0x7f96c4160b50 2023-10-14T12:35:03.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1496656811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 msgr2=0x7f96c40cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c8b1b700 1 --2- 172.21.15.72:0/1496656811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 0x7f96c40cf980 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009840 tx=0x7f96b8009b50 comp rx=0 tx=0).stop 2023-10-14T12:35:03.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1496656811 shutdown_connections 2023-10-14T12:35:03.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c8b1b700 1 --2- 172.21.15.72:0/1496656811 >> v2:172.21.15.123:3300/0 conn(0x7f96c40b5700 0x7f96c40ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c8b1b700 1 --2- 172.21.15.72:0/1496656811 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 0x7f96c40cf980 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1496656811 >> 172.21.15.72:0/1496656811 conn(0x7f96c406bc70 msgr2=0x7f96c406c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1496656811 shutdown_connections 2023-10-14T12:35:03.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.919+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1496656811 wait complete. 2023-10-14T12:35:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.921+0000 7f96c8b1b700 1 Processor -- start 2023-10-14T12:35:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.921+0000 7f96c8b1b700 1 -- start start 2023-10-14T12:35:03.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c8b1b700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96c40b5700 0x7f96c41468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c8b1b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96c40b9000 0x7f96c40c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c8b1b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 0x7f96c4144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c8b1b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41464d0 con 0x7f96c4160b50 2023-10-14T12:35:03.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c8b1b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4146e30 con 0x7f96c40b9000 2023-10-14T12:35:03.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c8b1b700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4145850 con 0x7f96c40b5700 2023-10-14T12:35:03.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 0x7f96c4144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 0x7f96c4144e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49204/0 (socket says 172.21.15.72:49204) 2023-10-14T12:35:03.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c2d9d700 1 -- 172.21.15.72:0/1340523687 learned_addr learned my addr 172.21.15.72:0/1340523687 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:03.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c259c700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96c40b5700 0x7f96c41468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c1d9b700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96c40b9000 0x7f96c40c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c2d9d700 1 -- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96c40b5700 msgr2=0x7f96c41468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c2d9d700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96c40b5700 0x7f96c41468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c2d9d700 1 -- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96c40b9000 msgr2=0x7f96c40c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:03.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c2d9d700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96c40b9000 0x7f96c40c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:03.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c2d9d700 1 -- 172.21.15.72:0/1340523687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80094a0 con 0x7f96c4160b50 2023-10-14T12:35:03.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c1d9b700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96c40b9000 0x7f96c40c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:35:03.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c259c700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96c40b5700 0x7f96c41468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:35:03.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c2d9d700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 0x7f96c4144e70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f96bc007e30 tx=0x7f96bc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96b2ffd700 1 -- 172.21.15.72:0/1340523687 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00eea0 con 0x7f96c4160b50 2023-10-14T12:35:03.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96b2ffd700 1 -- 172.21.15.72:0/1340523687 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc014420 con 0x7f96c4160b50 2023-10-14T12:35:03.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c4145b30 con 0x7f96c4160b50 2023-10-14T12:35:03.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96b2ffd700 1 -- 172.21.15.72:0/1340523687 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0147d0 con 0x7f96c4160b50 2023-10-14T12:35:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.922+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c41460f0 con 0x7f96c4160b50 2023-10-14T12:35:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.923+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4146610 con 0x7f96c4160b50 2023-10-14T12:35:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.924+0000 7f96b2ffd700 1 -- 172.21.15.72:0/1340523687 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f96bc014930 con 0x7f96c4160b50 2023-10-14T12:35:03.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.924+0000 7f96b2ffd700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f96a406af00 0x7f96a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.924+0000 7f96b2ffd700 1 -- 172.21.15.72:0/1340523687 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f96bc089e50 con 0x7f96c4160b50 2023-10-14T12:35:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.924+0000 7f96c259c700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f96a406af00 0x7f96a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.925+0000 7f96c259c700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f96a406af00 0x7f96a406d3c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009b90 tx=0x7f96b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:03.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:03.929+0000 7f96b2ffd700 1 -- 172.21.15.72:0/1340523687 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96c4146610 con 0x7f96c4160b50 2023-10-14T12:35:04.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.117+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96c4160f30 con 0x7f96a406af00 2023-10-14T12:35:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.124+0000 7f96b2ffd700 1 -- 172.21.15.72:0/1340523687 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288710 (secure 0 0 0) 0x7f96b8011b80 con 0x7f96a406af00 2023-10-14T12:35:04.129 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:35:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f96a406af00 msgr2=0x7f96a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f96a406af00 0x7f96a406d3c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009b90 tx=0x7f96b8008030 comp rx=0 tx=0).stop 2023-10-14T12:35:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 msgr2=0x7f96c4144e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 0x7f96c4144e70 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f96bc007e30 tx=0x7f96bc00e3c0 comp rx=0 tx=0).stop 2023-10-14T12:35:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 shutdown_connections 2023-10-14T12:35:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f96a406af00 0x7f96a406d3c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96c4160b50 0x7f96c4144e70 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f96c40b5700 0x7f96c41468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 --2- 172.21.15.72:0/1340523687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96c40b9000 0x7f96c40c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 >> 172.21.15.72:0/1340523687 conn(0x7f96c406bc70 msgr2=0x7f96c4155930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 shutdown_connections 2023-10-14T12:35:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:04.128+0000 7f96c8b1b700 1 -- 172.21.15.72:0/1340523687 wait complete. 2023-10-14T12:35:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:35:04.142 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-10-14T12:35:03.403716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220856,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753864,"statfs":{"total":773094113280,"available":772867956736,"internally_reserved":0,"allocated":4759552,"data_stored":2699604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002599"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836180+0000","last_change":"2023-10-14T12:34:44.773258+0000","last_active":"2023-10-14T12:34:45.836180+0000","last_peered":"2023-10-14T12:34:45.836180+0000","last_clean":"2023-10-14T12:34:45.836180+0000","last_became_active":"2023-10-14T12:34:44.772874+0000","last_became_peered":"2023-10-14T12:34:44.772874+0000","last_unstale":"2023-10-14T12:34:45.836180+0000","last_undegraded":"2023-10-14T12:34:45.836180+0000","last_fullsized":"2023-10-14T12:34:45.836180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835866+0000","last_change":"2023-10-14T12:34:44.766065+0000","last_active":"2023-10-14T12:34:45.835866+0000","last_peered":"2023-10-14T12:34:45.835866+0000","last_clean":"2023-10-14T12:34:45.835866+0000","last_became_active":"2023-10-14T12:34:44.765783+0000","last_became_peered":"2023-10-14T12:34:44.765783+0000","last_unstale":"2023-10-14T12:34:45.835866+0000","last_undegraded":"2023-10-14T12:34:45.835866+0000","last_fullsized":"2023-10-14T12:34:45.835866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836798+0000","last_change":"2023-10-14T12:34:44.766216+0000","last_active":"2023-10-14T12:34:45.836798+0000","last_peered":"2023-10-14T12:34:45.836798+0000","last_clean":"2023-10-14T12:34:45.836798+0000","last_became_active":"2023-10-14T12:34:44.765915+0000","last_became_peered":"2023-10-14T12:34:44.765915+0000","last_unstale":"2023-10-14T12:34:45.836798+0000","last_undegraded":"2023-10-14T12:34:45.836798+0000","last_fullsized":"2023-10-14T12:34:45.836798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835634+0000","last_change":"2023-10-14T12:34:44.776783+0000","last_active":"2023-10-14T12:34:45.835634+0000","last_peered":"2023-10-14T12:34:45.835634+0000","last_clean":"2023-10-14T12:34:45.835634+0000","last_became_active":"2023-10-14T12:34:44.776527+0000","last_became_peered":"2023-10-14T12:34:44.776527+0000","last_unstale":"2023-10-14T12:34:45.835634+0000","last_undegraded":"2023-10-14T12:34:45.835634+0000","last_fullsized":"2023-10-14T12:34:45.835634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:02:10.476396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835368+0000","last_change":"2023-10-14T12:34:44.774798+0000","last_active":"2023-10-14T12:34:45.835368+0000","last_peered":"2023-10-14T12:34:45.835368+0000","last_clean":"2023-10-14T12:34:45.835368+0000","last_became_active":"2023-10-14T12:34:44.774508+0000","last_became_peered":"2023-10-14T12:34:44.774508+0000","last_unstale":"2023-10-14T12:34:45.835368+0000","last_undegraded":"2023-10-14T12:34:45.835368+0000","last_fullsized":"2023-10-14T12:34:45.835368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:24.842813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835002+0000","last_change":"2023-10-14T12:34:44.771286+0000","last_active":"2023-10-14T12:34:45.835002+0000","last_peered":"2023-10-14T12:34:45.835002+0000","last_clean":"2023-10-14T12:34:45.835002+0000","last_became_active":"2023-10-14T12:34:44.768717+0000","last_became_peered":"2023-10-14T12:34:44.768717+0000","last_unstale":"2023-10-14T12:34:45.835002+0000","last_undegraded":"2023-10-14T12:34:45.835002+0000","last_fullsized":"2023-10-14T12:34:45.835002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:08:42.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764118+0000","last_change":"2023-10-14T12:34:44.771173+0000","last_active":"2023-10-14T12:34:45.764118+0000","last_peered":"2023-10-14T12:34:45.764118+0000","last_clean":"2023-10-14T12:34:45.764118+0000","last_became_active":"2023-10-14T12:34:44.770869+0000","last_became_peered":"2023-10-14T12:34:44.770869+0000","last_unstale":"2023-10-14T12:34:45.764118+0000","last_undegraded":"2023-10-14T12:34:45.764118+0000","last_fullsized":"2023-10-14T12:34:45.764118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835912+0000","last_change":"2023-10-14T12:34:44.766306+0000","last_active":"2023-10-14T12:34:45.835912+0000","last_peered":"2023-10-14T12:34:45.835912+0000","last_clean":"2023-10-14T12:34:45.835912+0000","last_became_active":"2023-10-14T12:34:44.765917+0000","last_became_peered":"2023-10-14T12:34:44.765917+0000","last_unstale":"2023-10-14T12:34:45.835912+0000","last_undegraded":"2023-10-14T12:34:45.835912+0000","last_fullsized":"2023-10-14T12:34:45.835912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836985+0000","last_change":"2023-10-14T12:34:44.769040+0000","last_active":"2023-10-14T12:34:45.836985+0000","last_peered":"2023-10-14T12:34:45.836985+0000","last_clean":"2023-10-14T12:34:45.836985+0000","last_became_active":"2023-10-14T12:34:44.768514+0000","last_became_peered":"2023-10-14T12:34:44.768514+0000","last_unstale":"2023-10-14T12:34:45.836985+0000","last_undegraded":"2023-10-14T12:34:45.836985+0000","last_fullsized":"2023-10-14T12:34:45.836985+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765522+0000","last_change":"2023-10-14T12:34:44.764554+0000","last_active":"2023-10-14T12:34:45.765522+0000","last_peered":"2023-10-14T12:34:45.765522+0000","last_clean":"2023-10-14T12:34:45.765522+0000","last_became_active":"2023-10-14T12:34:44.764252+0000","last_became_peered":"2023-10-14T12:34:44.764252+0000","last_unstale":"2023-10-14T12:34:45.765522+0000","last_undegraded":"2023-10-14T12:34:45.765522+0000","last_fullsized":"2023-10-14T12:34:45.765522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:55:36.689643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764651+0000","last_change":"2023-10-14T12:34:44.776394+0000","last_active":"2023-10-14T12:34:45.764651+0000","last_peered":"2023-10-14T12:34:45.764651+0000","last_clean":"2023-10-14T12:34:45.764651+0000","last_became_active":"2023-10-14T12:34:44.775897+0000","last_became_peered":"2023-10-14T12:34:44.775897+0000","last_unstale":"2023-10-14T12:34:45.764651+0000","last_undegraded":"2023-10-14T12:34:45.764651+0000","last_fullsized":"2023-10-14T12:34:45.764651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:13.095221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836748+0000","last_change":"2023-10-14T12:34:44.766520+0000","last_active":"2023-10-14T12:34:45.836748+0000","last_peered":"2023-10-14T12:34:45.836748+0000","last_clean":"2023-10-14T12:34:45.836748+0000","last_became_active":"2023-10-14T12:34:44.766208+0000","last_became_peered":"2023-10-14T12:34:44.766208+0000","last_unstale":"2023-10-14T12:34:45.836748+0000","last_undegraded":"2023-10-14T12:34:45.836748+0000","last_fullsized":"2023-10-14T12:34:45.836748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764453+0000","last_change":"2023-10-14T12:34:44.767161+0000","last_active":"2023-10-14T12:34:45.764453+0000","last_peered":"2023-10-14T12:34:45.764453+0000","last_clean":"2023-10-14T12:34:45.764453+0000","last_became_active":"2023-10-14T12:34:44.766602+0000","last_became_peered":"2023-10-14T12:34:44.766602+0000","last_unstale":"2023-10-14T12:34:45.764453+0000","last_undegraded":"2023-10-14T12:34:45.764453+0000","last_fullsized":"2023-10-14T12:34:45.764453+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765845+0000","last_change":"2023-10-14T12:34:44.770652+0000","last_active":"2023-10-14T12:34:45.765845+0000","last_peered":"2023-10-14T12:34:45.765845+0000","last_clean":"2023-10-14T12:34:45.765845+0000","last_became_active":"2023-10-14T12:34:44.770368+0000","last_became_peered":"2023-10-14T12:34:44.770368+0000","last_unstale":"2023-10-14T12:34:45.765845+0000","last_undegraded":"2023-10-14T12:34:45.765845+0000","last_fullsized":"2023-10-14T12:34:45.765845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.763799+0000","last_change":"2023-10-14T12:34:44.764695+0000","last_active":"2023-10-14T12:34:45.763799+0000","last_peered":"2023-10-14T12:34:45.763799+0000","last_clean":"2023-10-14T12:34:45.763799+0000","last_became_active":"2023-10-14T12:34:44.763083+0000","last_became_peered":"2023-10-14T12:34:44.763083+0000","last_unstale":"2023-10-14T12:34:45.763799+0000","last_undegraded":"2023-10-14T12:34:45.763799+0000","last_fullsized":"2023-10-14T12:34:45.763799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765533+0000","last_change":"2023-10-14T12:34:44.768707+0000","last_active":"2023-10-14T12:34:45.765533+0000","last_peered":"2023-10-14T12:34:45.765533+0000","last_clean":"2023-10-14T12:34:45.765533+0000","last_became_active":"2023-10-14T12:34:44.768474+0000","last_became_peered":"2023-10-14T12:34:44.768474+0000","last_unstale":"2023-10-14T12:34:45.765533+0000","last_undegraded":"2023-10-14T12:34:45.765533+0000","last_fullsized":"2023-10-14T12:34:45.765533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765794+0000","last_change":"2023-10-14T12:34:44.771432+0000","last_active":"2023-10-14T12:34:45.765794+0000","last_peered":"2023-10-14T12:34:45.765794+0000","last_clean":"2023-10-14T12:34:45.765794+0000","last_became_active":"2023-10-14T12:34:44.771158+0000","last_became_peered":"2023-10-14T12:34:44.771158+0000","last_unstale":"2023-10-14T12:34:45.765794+0000","last_undegraded":"2023-10-14T12:34:45.765794+0000","last_fullsized":"2023-10-14T12:34:45.765794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835519+0000","last_change":"2023-10-14T12:34:44.776578+0000","last_active":"2023-10-14T12:34:45.835519+0000","last_peered":"2023-10-14T12:34:45.835519+0000","last_clean":"2023-10-14T12:34:45.835519+0000","last_became_active":"2023-10-14T12:34:44.776263+0000","last_became_peered":"2023-10-14T12:34:44.776263+0000","last_unstale":"2023-10-14T12:34:45.835519+0000","last_undegraded":"2023-10-14T12:34:45.835519+0000","last_fullsized":"2023-10-14T12:34:45.835519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835662+0000","last_change":"2023-10-14T12:34:44.767374+0000","last_active":"2023-10-14T12:34:45.835662+0000","last_peered":"2023-10-14T12:34:45.835662+0000","last_clean":"2023-10-14T12:34:45.835662+0000","last_became_active":"2023-10-14T12:34:44.767035+0000","last_became_peered":"2023-10-14T12:34:44.767035+0000","last_unstale":"2023-10-14T12:34:45.835662+0000","last_undegraded":"2023-10-14T12:34:45.835662+0000","last_fullsized":"2023-10-14T12:34:45.835662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:06.799411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835300+0000","last_change":"2023-10-14T12:34:44.775911+0000","last_active":"2023-10-14T12:34:45.835300+0000","last_peered":"2023-10-14T12:34:45.835300+0000","last_clean":"2023-10-14T12:34:45.835300+0000","last_became_active":"2023-10-14T12:34:44.775453+0000","last_became_peered":"2023-10-14T12:34:44.775453+0000","last_unstale":"2023-10-14T12:34:45.835300+0000","last_undegraded":"2023-10-14T12:34:45.835300+0000","last_fullsized":"2023-10-14T12:34:45.835300+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:37.110615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764577+0000","last_change":"2023-10-14T12:34:44.766571+0000","last_active":"2023-10-14T12:34:45.764577+0000","last_peered":"2023-10-14T12:34:45.764577+0000","last_clean":"2023-10-14T12:34:45.764577+0000","last_became_active":"2023-10-14T12:34:44.766299+0000","last_became_peered":"2023-10-14T12:34:44.766299+0000","last_unstale":"2023-10-14T12:34:45.764577+0000","last_undegraded":"2023-10-14T12:34:45.764577+0000","last_fullsized":"2023-10-14T12:34:45.764577+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765865+0000","last_change":"2023-10-14T12:34:44.770392+0000","last_active":"2023-10-14T12:34:45.765865+0000","last_peered":"2023-10-14T12:34:45.765865+0000","last_clean":"2023-10-14T12:34:45.765865+0000","last_became_active":"2023-10-14T12:34:44.770033+0000","last_became_peered":"2023-10-14T12:34:44.770033+0000","last_unstale":"2023-10-14T12:34:45.765865+0000","last_undegraded":"2023-10-14T12:34:45.765865+0000","last_fullsized":"2023-10-14T12:34:45.765865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765576+0000","last_change":"2023-10-14T12:34:44.768259+0000","last_active":"2023-10-14T12:34:45.765576+0000","last_peered":"2023-10-14T12:34:45.765576+0000","last_clean":"2023-10-14T12:34:45.765576+0000","last_became_active":"2023-10-14T12:34:44.767967+0000","last_became_peered":"2023-10-14T12:34:44.767967+0000","last_unstale":"2023-10-14T12:34:45.765576+0000","last_undegraded":"2023-10-14T12:34:45.765576+0000","last_fullsized":"2023-10-14T12:34:45.765576+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835233+0000","last_change":"2023-10-14T12:34:44.770347+0000","last_active":"2023-10-14T12:34:45.835233+0000","last_peered":"2023-10-14T12:34:45.835233+0000","last_clean":"2023-10-14T12:34:45.835233+0000","last_became_active":"2023-10-14T12:34:44.768304+0000","last_became_peered":"2023-10-14T12:34:44.768304+0000","last_unstale":"2023-10-14T12:34:45.835233+0000","last_undegraded":"2023-10-14T12:34:45.835233+0000","last_fullsized":"2023-10-14T12:34:45.835233+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:27:07.068125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835441+0000","last_change":"2023-10-14T12:34:44.764335+0000","last_active":"2023-10-14T12:34:45.835441+0000","last_peered":"2023-10-14T12:34:45.835441+0000","last_clean":"2023-10-14T12:34:45.835441+0000","last_became_active":"2023-10-14T12:34:44.764072+0000","last_became_peered":"2023-10-14T12:34:44.764072+0000","last_unstale":"2023-10-14T12:34:45.835441+0000","last_undegraded":"2023-10-14T12:34:45.835441+0000","last_fullsized":"2023-10-14T12:34:45.835441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835405+0000","last_change":"2023-10-14T12:34:44.768012+0000","last_active":"2023-10-14T12:34:45.835405+0000","last_peered":"2023-10-14T12:34:45.835405+0000","last_clean":"2023-10-14T12:34:45.835405+0000","last_became_active":"2023-10-14T12:34:44.767743+0000","last_became_peered":"2023-10-14T12:34:44.767743+0000","last_unstale":"2023-10-14T12:34:45.835405+0000","last_undegraded":"2023-10-14T12:34:45.835405+0000","last_fullsized":"2023-10-14T12:34:45.835405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835418+0000","last_change":"2023-10-14T12:34:44.766816+0000","last_active":"2023-10-14T12:34:45.835418+0000","last_peered":"2023-10-14T12:34:45.835418+0000","last_clean":"2023-10-14T12:34:45.835418+0000","last_became_active":"2023-10-14T12:34:44.766309+0000","last_became_peered":"2023-10-14T12:34:44.766309+0000","last_unstale":"2023-10-14T12:34:45.835418+0000","last_undegraded":"2023-10-14T12:34:45.835418+0000","last_fullsized":"2023-10-14T12:34:45.835418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764364+0000","last_change":"2023-10-14T12:34:44.766262+0000","last_active":"2023-10-14T12:34:45.764364+0000","last_peered":"2023-10-14T12:34:45.764364+0000","last_clean":"2023-10-14T12:34:45.764364+0000","last_became_active":"2023-10-14T12:34:44.765904+0000","last_became_peered":"2023-10-14T12:34:44.765904+0000","last_unstale":"2023-10-14T12:34:45.764364+0000","last_undegraded":"2023-10-14T12:34:45.764364+0000","last_fullsized":"2023-10-14T12:34:45.764364+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:31.500295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835345+0000","last_change":"2023-10-14T12:34:44.764983+0000","last_active":"2023-10-14T12:34:45.835345+0000","last_peered":"2023-10-14T12:34:45.835345+0000","last_clean":"2023-10-14T12:34:45.835345+0000","last_became_active":"2023-10-14T12:34:44.764719+0000","last_became_peered":"2023-10-14T12:34:44.764719+0000","last_unstale":"2023-10-14T12:34:45.835345+0000","last_undegraded":"2023-10-14T12:34:45.835345+0000","last_fullsized":"2023-10-14T12:34:45.835345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835251+0000","last_change":"2023-10-14T12:34:44.769030+0000","last_active":"2023-10-14T12:34:45.835251+0000","last_peered":"2023-10-14T12:34:45.835251+0000","last_clean":"2023-10-14T12:34:45.835251+0000","last_became_active":"2023-10-14T12:34:44.768729+0000","last_became_peered":"2023-10-14T12:34:44.768729+0000","last_unstale":"2023-10-14T12:34:45.835251+0000","last_undegraded":"2023-10-14T12:34:45.835251+0000","last_fullsized":"2023-10-14T12:34:45.835251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:36.593887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765428+0000","last_change":"2023-10-14T12:34:44.768972+0000","last_active":"2023-10-14T12:34:45.765428+0000","last_peered":"2023-10-14T12:34:45.765428+0000","last_clean":"2023-10-14T12:34:45.765428+0000","last_became_active":"2023-10-14T12:34:44.768243+0000","last_became_peered":"2023-10-14T12:34:44.768243+0000","last_unstale":"2023-10-14T12:34:45.765428+0000","last_undegraded":"2023-10-14T12:34:45.765428+0000","last_fullsized":"2023-10-14T12:34:45.765428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835003+0000","last_change":"2023-10-14T12:34:44.768827+0000","last_active":"2023-10-14T12:34:45.835003+0000","last_peered":"2023-10-14T12:34:45.835003+0000","last_clean":"2023-10-14T12:34:45.835003+0000","last_became_active":"2023-10-14T12:34:44.768423+0000","last_became_peered":"2023-10-14T12:34:44.768423+0000","last_unstale":"2023-10-14T12:34:45.835003+0000","last_undegraded":"2023-10-14T12:34:45.835003+0000","last_fullsized":"2023-10-14T12:34:45.835003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765078+0000","last_change":"2023-10-14T12:34:44.771115+0000","last_active":"2023-10-14T12:34:45.765078+0000","last_peered":"2023-10-14T12:34:45.765078+0000","last_clean":"2023-10-14T12:34:45.765078+0000","last_became_active":"2023-10-14T12:34:44.770846+0000","last_became_peered":"2023-10-14T12:34:44.770846+0000","last_unstale":"2023-10-14T12:34:45.765078+0000","last_undegraded":"2023-10-14T12:34:45.765078+0000","last_fullsized":"2023-10-14T12:34:45.765078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:18.644528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775649+0000","last_change":"2023-10-14T12:34:43.742439+0000","last_active":"2023-10-14T12:34:44.775649+0000","last_peered":"2023-10-14T12:34:44.775649+0000","last_clean":"2023-10-14T12:34:44.775649+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:34:44.775649+0000","last_undegraded":"2023-10-14T12:34:44.775649+0000","last_fullsized":"2023-10-14T12:34:44.775649+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835738+0000","last_change":"2023-10-14T12:34:44.772445+0000","last_active":"2023-10-14T12:34:45.835738+0000","last_peered":"2023-10-14T12:34:45.835738+0000","last_clean":"2023-10-14T12:34:45.835738+0000","last_became_active":"2023-10-14T12:34:44.772093+0000","last_became_peered":"2023-10-14T12:34:44.772093+0000","last_unstale":"2023-10-14T12:34:45.835738+0000","last_undegraded":"2023-10-14T12:34:45.835738+0000","last_fullsized":"2023-10-14T12:34:45.835738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773796+0000","last_change":"2023-10-14T12:34:43.740875+0000","last_active":"2023-10-14T12:34:44.773796+0000","last_peered":"2023-10-14T12:34:44.773796+0000","last_clean":"2023-10-14T12:34:44.773796+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:34:44.773796+0000","last_undegraded":"2023-10-14T12:34:44.773796+0000","last_fullsized":"2023-10-14T12:34:44.773796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:07:36.785040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765494+0000","last_change":"2023-10-14T12:34:44.775914+0000","last_active":"2023-10-14T12:34:45.765494+0000","last_peered":"2023-10-14T12:34:45.765494+0000","last_clean":"2023-10-14T12:34:45.765494+0000","last_became_active":"2023-10-14T12:34:44.775648+0000","last_became_peered":"2023-10-14T12:34:44.775648+0000","last_unstale":"2023-10-14T12:34:45.765494+0000","last_undegraded":"2023-10-14T12:34:45.765494+0000","last_fullsized":"2023-10-14T12:34:45.765494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:29.349378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.774951+0000","last_change":"2023-10-14T12:34:43.737909+0000","last_active":"2023-10-14T12:34:44.774951+0000","last_peered":"2023-10-14T12:34:44.774951+0000","last_clean":"2023-10-14T12:34:44.774951+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:34:44.774951+0000","last_undegraded":"2023-10-14T12:34:44.774951+0000","last_fullsized":"2023-10-14T12:34:44.774951+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:21.264726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836154+0000","last_change":"2023-10-14T12:34:44.765349+0000","last_active":"2023-10-14T12:34:45.836154+0000","last_peered":"2023-10-14T12:34:45.836154+0000","last_clean":"2023-10-14T12:34:45.836154+0000","last_became_active":"2023-10-14T12:34:44.765043+0000","last_became_peered":"2023-10-14T12:34:44.765043+0000","last_unstale":"2023-10-14T12:34:45.836154+0000","last_undegraded":"2023-10-14T12:34:45.836154+0000","last_fullsized":"2023-10-14T12:34:45.836154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:16.606114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775771+0000","last_change":"2023-10-14T12:34:43.738060+0000","last_active":"2023-10-14T12:34:44.775771+0000","last_peered":"2023-10-14T12:34:44.775771+0000","last_clean":"2023-10-14T12:34:44.775771+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:34:44.775771+0000","last_undegraded":"2023-10-14T12:34:44.775771+0000","last_fullsized":"2023-10-14T12:34:44.775771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:07:43.162820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836764+0000","last_change":"2023-10-14T12:34:44.763674+0000","last_active":"2023-10-14T12:34:45.836764+0000","last_peered":"2023-10-14T12:34:45.836764+0000","last_clean":"2023-10-14T12:34:45.836764+0000","last_became_active":"2023-10-14T12:34:44.763356+0000","last_became_peered":"2023-10-14T12:34:44.763356+0000","last_unstale":"2023-10-14T12:34:45.836764+0000","last_undegraded":"2023-10-14T12:34:45.836764+0000","last_fullsized":"2023-10-14T12:34:45.836764+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.772744+0000","last_change":"2023-10-14T12:34:43.738857+0000","last_active":"2023-10-14T12:34:44.772744+0000","last_peered":"2023-10-14T12:34:44.772744+0000","last_clean":"2023-10-14T12:34:44.772744+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:34:44.772744+0000","last_undegraded":"2023-10-14T12:34:44.772744+0000","last_fullsized":"2023-10-14T12:34:44.772744+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:47.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764009+0000","last_change":"2023-10-14T12:34:44.767242+0000","last_active":"2023-10-14T12:34:45.764009+0000","last_peered":"2023-10-14T12:34:45.764009+0000","last_clean":"2023-10-14T12:34:45.764009+0000","last_became_active":"2023-10-14T12:34:44.766961+0000","last_became_peered":"2023-10-14T12:34:44.766961+0000","last_unstale":"2023-10-14T12:34:45.764009+0000","last_undegraded":"2023-10-14T12:34:45.764009+0000","last_fullsized":"2023-10-14T12:34:45.764009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775710+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:44.775710+0000","last_peered":"2023-10-14T12:34:44.775710+0000","last_clean":"2023-10-14T12:34:44.775710+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:44.775710+0000","last_undegraded":"2023-10-14T12:34:44.775710+0000","last_fullsized":"2023-10-14T12:34:44.775710+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765983+0000","last_change":"2023-10-14T12:34:44.770562+0000","last_active":"2023-10-14T12:34:45.765983+0000","last_peered":"2023-10-14T12:34:45.765983+0000","last_clean":"2023-10-14T12:34:45.765983+0000","last_became_active":"2023-10-14T12:34:44.770030+0000","last_became_peered":"2023-10-14T12:34:44.770030+0000","last_unstale":"2023-10-14T12:34:45.765983+0000","last_undegraded":"2023-10-14T12:34:45.765983+0000","last_fullsized":"2023-10-14T12:34:45.765983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757619+0000","last_change":"2023-10-14T12:34:43.738248+0000","last_active":"2023-10-14T12:34:44.757619+0000","last_peered":"2023-10-14T12:34:44.757619+0000","last_clean":"2023-10-14T12:34:44.757619+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:34:44.757619+0000","last_undegraded":"2023-10-14T12:34:44.757619+0000","last_fullsized":"2023-10-14T12:34:44.757619+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836002+0000","last_change":"2023-10-14T12:34:44.762002+0000","last_active":"2023-10-14T12:34:45.836002+0000","last_peered":"2023-10-14T12:34:45.836002+0000","last_clean":"2023-10-14T12:34:45.836002+0000","last_became_active":"2023-10-14T12:34:44.761308+0000","last_became_peered":"2023-10-14T12:34:44.761308+0000","last_unstale":"2023-10-14T12:34:45.836002+0000","last_undegraded":"2023-10-14T12:34:45.836002+0000","last_fullsized":"2023-10-14T12:34:45.836002+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.754851+0000","last_change":"2023-10-14T12:34:43.737450+0000","last_active":"2023-10-14T12:34:44.754851+0000","last_peered":"2023-10-14T12:34:44.754851+0000","last_clean":"2023-10-14T12:34:44.754851+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:34:44.754851+0000","last_undegraded":"2023-10-14T12:34:44.754851+0000","last_fullsized":"2023-10-14T12:34:44.754851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:02:27.820010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835759+0000","last_change":"2023-10-14T12:34:44.776821+0000","last_active":"2023-10-14T12:34:45.835759+0000","last_peered":"2023-10-14T12:34:45.835759+0000","last_clean":"2023-10-14T12:34:45.835759+0000","last_became_active":"2023-10-14T12:34:44.776592+0000","last_became_peered":"2023-10-14T12:34:44.776592+0000","last_unstale":"2023-10-14T12:34:45.835759+0000","last_undegraded":"2023-10-14T12:34:45.835759+0000","last_fullsized":"2023-10-14T12:34:45.835759+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:31.333285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.753775+0000","last_change":"2023-10-14T12:34:43.733989+0000","last_active":"2023-10-14T12:34:44.753775+0000","last_peered":"2023-10-14T12:34:44.753775+0000","last_clean":"2023-10-14T12:34:44.753775+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:34:44.753775+0000","last_undegraded":"2023-10-14T12:34:44.753775+0000","last_fullsized":"2023-10-14T12:34:44.753775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:52.723651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765232+0000","last_change":"2023-10-14T12:34:44.763705+0000","last_active":"2023-10-14T12:34:45.765232+0000","last_peered":"2023-10-14T12:34:45.765232+0000","last_clean":"2023-10-14T12:34:45.765232+0000","last_became_active":"2023-10-14T12:34:44.763408+0000","last_became_peered":"2023-10-14T12:34:44.763408+0000","last_unstale":"2023-10-14T12:34:45.765232+0000","last_undegraded":"2023-10-14T12:34:45.765232+0000","last_fullsized":"2023-10-14T12:34:45.765232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:02.756175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750731+0000","last_change":"2023-10-14T12:34:43.734905+0000","last_active":"2023-10-14T12:34:44.750731+0000","last_peered":"2023-10-14T12:34:44.750731+0000","last_clean":"2023-10-14T12:34:44.750731+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:34:44.750731+0000","last_undegraded":"2023-10-14T12:34:44.750731+0000","last_fullsized":"2023-10-14T12:34:44.750731+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836842+0000","last_change":"2023-10-14T12:34:44.764740+0000","last_active":"2023-10-14T12:34:45.836842+0000","last_peered":"2023-10-14T12:34:45.836842+0000","last_clean":"2023-10-14T12:34:45.836842+0000","last_became_active":"2023-10-14T12:34:44.764455+0000","last_became_peered":"2023-10-14T12:34:44.764455+0000","last_unstale":"2023-10-14T12:34:45.836842+0000","last_undegraded":"2023-10-14T12:34:45.836842+0000","last_fullsized":"2023-10-14T12:34:45.836842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:43.273571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779891+0000","last_change":"2023-10-14T12:34:43.735967+0000","last_active":"2023-10-14T12:34:44.779891+0000","last_peered":"2023-10-14T12:34:44.779891+0000","last_clean":"2023-10-14T12:34:44.779891+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:34:44.779891+0000","last_undegraded":"2023-10-14T12:34:44.779891+0000","last_fullsized":"2023-10-14T12:34:44.779891+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765386+0000","last_change":"2023-10-14T12:34:44.774548+0000","last_active":"2023-10-14T12:34:45.765386+0000","last_peered":"2023-10-14T12:34:45.765386+0000","last_clean":"2023-10-14T12:34:45.765386+0000","last_became_active":"2023-10-14T12:34:44.774253+0000","last_became_peered":"2023-10-14T12:34:44.774253+0000","last_unstale":"2023-10-14T12:34:45.765386+0000","last_undegraded":"2023-10-14T12:34:45.765386+0000","last_fullsized":"2023-10-14T12:34:45.765386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:44.075921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779429+0000","last_change":"2023-10-14T12:34:43.741443+0000","last_active":"2023-10-14T12:34:44.779429+0000","last_peered":"2023-10-14T12:34:44.779429+0000","last_clean":"2023-10-14T12:34:44.779429+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:34:44.779429+0000","last_undegraded":"2023-10-14T12:34:44.779429+0000","last_fullsized":"2023-10-14T12:34:44.779429+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:35:17.642741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836528+0000","last_change":"2023-10-14T12:34:44.766187+0000","last_active":"2023-10-14T12:34:45.836528+0000","last_peered":"2023-10-14T12:34:45.836528+0000","last_clean":"2023-10-14T12:34:45.836528+0000","last_became_active":"2023-10-14T12:34:44.765932+0000","last_became_peered":"2023-10-14T12:34:44.765932+0000","last_unstale":"2023-10-14T12:34:45.836528+0000","last_undegraded":"2023-10-14T12:34:45.836528+0000","last_fullsized":"2023-10-14T12:34:45.836528+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:08.660786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.773813+0000","last_change":"2023-10-14T12:34:43.738642+0000","last_active":"2023-10-14T12:34:44.773813+0000","last_peered":"2023-10-14T12:34:44.773813+0000","last_clean":"2023-10-14T12:34:44.773813+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:34:44.773813+0000","last_undegraded":"2023-10-14T12:34:44.773813+0000","last_fullsized":"2023-10-14T12:34:44.773813+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835518+0000","last_change":"2023-10-14T12:34:44.773042+0000","last_active":"2023-10-14T12:34:45.835518+0000","last_peered":"2023-10-14T12:34:45.835518+0000","last_clean":"2023-10-14T12:34:45.835518+0000","last_became_active":"2023-10-14T12:34:44.772662+0000","last_became_peered":"2023-10-14T12:34:44.772662+0000","last_unstale":"2023-10-14T12:34:45.835518+0000","last_undegraded":"2023-10-14T12:34:45.835518+0000","last_fullsized":"2023-10-14T12:34:45.835518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758499+0000","last_change":"2023-10-14T12:34:43.738291+0000","last_active":"2023-10-14T12:34:44.758499+0000","last_peered":"2023-10-14T12:34:44.758499+0000","last_clean":"2023-10-14T12:34:44.758499+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:34:44.758499+0000","last_undegraded":"2023-10-14T12:34:44.758499+0000","last_fullsized":"2023-10-14T12:34:44.758499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:21:28.347591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764881+0000","last_change":"2023-10-14T12:34:44.761488+0000","last_active":"2023-10-14T12:34:45.764881+0000","last_peered":"2023-10-14T12:34:45.764881+0000","last_clean":"2023-10-14T12:34:45.764881+0000","last_became_active":"2023-10-14T12:34:44.761153+0000","last_became_peered":"2023-10-14T12:34:44.761153+0000","last_unstale":"2023-10-14T12:34:45.764881+0000","last_undegraded":"2023-10-14T12:34:45.764881+0000","last_fullsized":"2023-10-14T12:34:45.764881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:05:48.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.755992+0000","last_change":"2023-10-14T12:34:43.742416+0000","last_active":"2023-10-14T12:34:44.755992+0000","last_peered":"2023-10-14T12:34:44.755992+0000","last_clean":"2023-10-14T12:34:44.755992+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:34:44.755992+0000","last_undegraded":"2023-10-14T12:34:44.755992+0000","last_fullsized":"2023-10-14T12:34:44.755992+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:57:53.912318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835631+0000","last_change":"2023-10-14T12:34:44.762671+0000","last_active":"2023-10-14T12:34:45.835631+0000","last_peered":"2023-10-14T12:34:45.835631+0000","last_clean":"2023-10-14T12:34:45.835631+0000","last_became_active":"2023-10-14T12:34:44.762396+0000","last_became_peered":"2023-10-14T12:34:44.762396+0000","last_unstale":"2023-10-14T12:34:45.835631+0000","last_undegraded":"2023-10-14T12:34:45.835631+0000","last_fullsized":"2023-10-14T12:34:45.835631+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:27:41.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.777137+0000","last_change":"2023-10-14T12:34:43.745867+0000","last_active":"2023-10-14T12:34:44.777137+0000","last_peered":"2023-10-14T12:34:44.777137+0000","last_clean":"2023-10-14T12:34:44.777137+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:34:44.777137+0000","last_undegraded":"2023-10-14T12:34:44.777137+0000","last_fullsized":"2023-10-14T12:34:44.777137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835643+0000","last_change":"2023-10-14T12:34:44.761814+0000","last_active":"2023-10-14T12:34:45.835643+0000","last_peered":"2023-10-14T12:34:45.835643+0000","last_clean":"2023-10-14T12:34:45.835643+0000","last_became_active":"2023-10-14T12:34:44.761558+0000","last_became_peered":"2023-10-14T12:34:44.761558+0000","last_unstale":"2023-10-14T12:34:45.835643+0000","last_undegraded":"2023-10-14T12:34:45.835643+0000","last_fullsized":"2023-10-14T12:34:45.835643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:43.883009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775988+0000","last_change":"2023-10-14T12:34:43.743560+0000","last_active":"2023-10-14T12:34:44.775988+0000","last_peered":"2023-10-14T12:34:44.775988+0000","last_clean":"2023-10-14T12:34:44.775988+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:34:44.775988+0000","last_undegraded":"2023-10-14T12:34:44.775988+0000","last_fullsized":"2023-10-14T12:34:44.775988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:26.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764518+0000","last_change":"2023-10-14T12:34:44.766417+0000","last_active":"2023-10-14T12:34:45.764518+0000","last_peered":"2023-10-14T12:34:45.764518+0000","last_clean":"2023-10-14T12:34:45.764518+0000","last_became_active":"2023-10-14T12:34:44.766119+0000","last_became_peered":"2023-10-14T12:34:44.766119+0000","last_unstale":"2023-10-14T12:34:45.764518+0000","last_undegraded":"2023-10-14T12:34:45.764518+0000","last_fullsized":"2023-10-14T12:34:45.764518+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:25.491537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775467+0000","last_change":"2023-10-14T12:34:43.738033+0000","last_active":"2023-10-14T12:34:44.775467+0000","last_peered":"2023-10-14T12:34:44.775467+0000","last_clean":"2023-10-14T12:34:44.775467+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:34:44.775467+0000","last_undegraded":"2023-10-14T12:34:44.775467+0000","last_fullsized":"2023-10-14T12:34:44.775467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765588+0000","last_change":"2023-10-14T12:34:44.775797+0000","last_active":"2023-10-14T12:34:45.765588+0000","last_peered":"2023-10-14T12:34:45.765588+0000","last_clean":"2023-10-14T12:34:45.765588+0000","last_became_active":"2023-10-14T12:34:44.775417+0000","last_became_peered":"2023-10-14T12:34:44.775417+0000","last_unstale":"2023-10-14T12:34:45.765588+0000","last_undegraded":"2023-10-14T12:34:45.765588+0000","last_fullsized":"2023-10-14T12:34:45.765588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.775680+0000","last_change":"2023-10-14T12:34:43.744197+0000","last_active":"2023-10-14T12:34:44.775680+0000","last_peered":"2023-10-14T12:34:44.775680+0000","last_clean":"2023-10-14T12:34:44.775680+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:34:44.775680+0000","last_undegraded":"2023-10-14T12:34:44.775680+0000","last_fullsized":"2023-10-14T12:34:44.775680+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:18:53.838278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836010+0000","last_change":"2023-10-14T12:34:44.770567+0000","last_active":"2023-10-14T12:34:45.836010+0000","last_peered":"2023-10-14T12:34:45.836010+0000","last_clean":"2023-10-14T12:34:45.836010+0000","last_became_active":"2023-10-14T12:34:44.768157+0000","last_became_peered":"2023-10-14T12:34:44.768157+0000","last_unstale":"2023-10-14T12:34:45.836010+0000","last_undegraded":"2023-10-14T12:34:45.836010+0000","last_fullsized":"2023-10-14T12:34:45.836010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:26:05.274311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756934+0000","last_change":"2023-10-14T12:34:43.739053+0000","last_active":"2023-10-14T12:34:44.756934+0000","last_peered":"2023-10-14T12:34:44.756934+0000","last_clean":"2023-10-14T12:34:44.756934+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:34:44.756934+0000","last_undegraded":"2023-10-14T12:34:44.756934+0000","last_fullsized":"2023-10-14T12:34:44.756934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765656+0000","last_change":"2023-10-14T12:34:44.768620+0000","last_active":"2023-10-14T12:34:45.765656+0000","last_peered":"2023-10-14T12:34:45.765656+0000","last_clean":"2023-10-14T12:34:45.765656+0000","last_became_active":"2023-10-14T12:34:44.768087+0000","last_became_peered":"2023-10-14T12:34:44.768087+0000","last_unstale":"2023-10-14T12:34:45.765656+0000","last_undegraded":"2023-10-14T12:34:45.765656+0000","last_fullsized":"2023-10-14T12:34:45.765656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:35.927780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.769614+0000","last_change":"2023-10-14T12:34:43.739027+0000","last_active":"2023-10-14T12:34:44.769614+0000","last_peered":"2023-10-14T12:34:44.769614+0000","last_clean":"2023-10-14T12:34:44.769614+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:34:44.769614+0000","last_undegraded":"2023-10-14T12:34:44.769614+0000","last_fullsized":"2023-10-14T12:34:44.769614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:28:18.085129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836679+0000","last_change":"2023-10-14T12:34:44.761072+0000","last_active":"2023-10-14T12:34:45.836679+0000","last_peered":"2023-10-14T12:34:45.836679+0000","last_clean":"2023-10-14T12:34:45.836679+0000","last_became_active":"2023-10-14T12:34:44.760736+0000","last_became_peered":"2023-10-14T12:34:44.760736+0000","last_unstale":"2023-10-14T12:34:45.836679+0000","last_undegraded":"2023-10-14T12:34:45.836679+0000","last_fullsized":"2023-10-14T12:34:45.836679+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.759860+0000","last_change":"2023-10-14T12:34:43.739164+0000","last_active":"2023-10-14T12:34:44.759860+0000","last_peered":"2023-10-14T12:34:44.759860+0000","last_clean":"2023-10-14T12:34:44.759860+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:34:44.759860+0000","last_undegraded":"2023-10-14T12:34:44.759860+0000","last_fullsized":"2023-10-14T12:34:44.759860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:38:58.156116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764254+0000","last_change":"2023-10-14T12:34:44.764345+0000","last_active":"2023-10-14T12:34:45.764254+0000","last_peered":"2023-10-14T12:34:45.764254+0000","last_clean":"2023-10-14T12:34:45.764254+0000","last_became_active":"2023-10-14T12:34:44.764069+0000","last_became_peered":"2023-10-14T12:34:44.764069+0000","last_unstale":"2023-10-14T12:34:45.764254+0000","last_undegraded":"2023-10-14T12:34:45.764254+0000","last_fullsized":"2023-10-14T12:34:45.764254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.751773+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:44.751773+0000","last_peered":"2023-10-14T12:34:44.751773+0000","last_clean":"2023-10-14T12:34:44.751773+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:44.751773+0000","last_undegraded":"2023-10-14T12:34:44.751773+0000","last_fullsized":"2023-10-14T12:34:44.751773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:07.658999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835883+0000","last_change":"2023-10-14T12:34:44.768053+0000","last_active":"2023-10-14T12:34:45.835883+0000","last_peered":"2023-10-14T12:34:45.835883+0000","last_clean":"2023-10-14T12:34:45.835883+0000","last_became_active":"2023-10-14T12:34:44.767802+0000","last_became_peered":"2023-10-14T12:34:44.767802+0000","last_unstale":"2023-10-14T12:34:45.835883+0000","last_undegraded":"2023-10-14T12:34:45.835883+0000","last_fullsized":"2023-10-14T12:34:45.835883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:05.080086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757835+0000","last_change":"2023-10-14T12:34:43.737529+0000","last_active":"2023-10-14T12:34:44.757835+0000","last_peered":"2023-10-14T12:34:44.757835+0000","last_clean":"2023-10-14T12:34:44.757835+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:34:44.757835+0000","last_undegraded":"2023-10-14T12:34:44.757835+0000","last_fullsized":"2023-10-14T12:34:44.757835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:30:56.810287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835146+0000","last_change":"2023-10-14T12:34:44.768491+0000","last_active":"2023-10-14T12:34:45.835146+0000","last_peered":"2023-10-14T12:34:45.835146+0000","last_clean":"2023-10-14T12:34:45.835146+0000","last_became_active":"2023-10-14T12:34:44.768177+0000","last_became_peered":"2023-10-14T12:34:44.768177+0000","last_unstale":"2023-10-14T12:34:45.835146+0000","last_undegraded":"2023-10-14T12:34:45.835146+0000","last_fullsized":"2023-10-14T12:34:45.835146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:46.157212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.779481+0000","last_change":"2023-10-14T12:34:43.735693+0000","last_active":"2023-10-14T12:34:44.779481+0000","last_peered":"2023-10-14T12:34:44.779481+0000","last_clean":"2023-10-14T12:34:44.779481+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:34:44.779481+0000","last_undegraded":"2023-10-14T12:34:44.779481+0000","last_fullsized":"2023-10-14T12:34:44.779481+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:33.628589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765390+0000","last_change":"2023-10-14T12:34:44.761812+0000","last_active":"2023-10-14T12:34:45.765390+0000","last_peered":"2023-10-14T12:34:45.765390+0000","last_clean":"2023-10-14T12:34:45.765390+0000","last_became_active":"2023-10-14T12:34:44.761519+0000","last_became_peered":"2023-10-14T12:34:44.761519+0000","last_unstale":"2023-10-14T12:34:45.765390+0000","last_undegraded":"2023-10-14T12:34:45.765390+0000","last_fullsized":"2023-10-14T12:34:45.765390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:09.167362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835973+0000","last_change":"2023-10-14T12:34:43.735820+0000","last_active":"2023-10-14T12:34:45.835973+0000","last_peered":"2023-10-14T12:34:45.835973+0000","last_clean":"2023-10-14T12:34:45.835973+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:34:45.835973+0000","last_undegraded":"2023-10-14T12:34:45.835973+0000","last_fullsized":"2023-10-14T12:34:45.835973+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:43:56.743915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835989+0000","last_change":"2023-10-14T12:34:44.776057+0000","last_active":"2023-10-14T12:34:45.835989+0000","last_peered":"2023-10-14T12:34:45.835989+0000","last_clean":"2023-10-14T12:34:45.835989+0000","last_became_active":"2023-10-14T12:34:44.775820+0000","last_became_peered":"2023-10-14T12:34:44.775820+0000","last_unstale":"2023-10-14T12:34:45.835989+0000","last_undegraded":"2023-10-14T12:34:45.835989+0000","last_fullsized":"2023-10-14T12:34:45.835989+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:15:57.486092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758094+0000","last_change":"2023-10-14T12:34:43.736834+0000","last_active":"2023-10-14T12:34:44.758094+0000","last_peered":"2023-10-14T12:34:44.758094+0000","last_clean":"2023-10-14T12:34:44.758094+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:34:44.758094+0000","last_undegraded":"2023-10-14T12:34:44.758094+0000","last_fullsized":"2023-10-14T12:34:44.758094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:43:43.074134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836529+0000","last_change":"2023-10-14T12:34:44.769426+0000","last_active":"2023-10-14T12:34:45.836529+0000","last_peered":"2023-10-14T12:34:45.836529+0000","last_clean":"2023-10-14T12:34:45.836529+0000","last_became_active":"2023-10-14T12:34:44.769173+0000","last_became_peered":"2023-10-14T12:34:44.769173+0000","last_unstale":"2023-10-14T12:34:45.836529+0000","last_undegraded":"2023-10-14T12:34:45.836529+0000","last_fullsized":"2023-10-14T12:34:45.836529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:23:22.266513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.757464+0000","last_change":"2023-10-14T12:34:43.737030+0000","last_active":"2023-10-14T12:34:44.757464+0000","last_peered":"2023-10-14T12:34:44.757464+0000","last_clean":"2023-10-14T12:34:44.757464+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:34:44.757464+0000","last_undegraded":"2023-10-14T12:34:44.757464+0000","last_fullsized":"2023-10-14T12:34:44.757464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:19:36.108828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835225+0000","last_change":"2023-10-14T12:34:44.763379+0000","last_active":"2023-10-14T12:34:45.835225+0000","last_peered":"2023-10-14T12:34:45.835225+0000","last_clean":"2023-10-14T12:34:45.835225+0000","last_became_active":"2023-10-14T12:34:44.763069+0000","last_became_peered":"2023-10-14T12:34:44.763069+0000","last_unstale":"2023-10-14T12:34:45.835225+0000","last_undegraded":"2023-10-14T12:34:45.835225+0000","last_fullsized":"2023-10-14T12:34:45.835225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:19:27.048297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.756075+0000","last_change":"2023-10-14T12:34:43.740716+0000","last_active":"2023-10-14T12:34:44.756075+0000","last_peered":"2023-10-14T12:34:44.756075+0000","last_clean":"2023-10-14T12:34:44.756075+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:34:44.756075+0000","last_undegraded":"2023-10-14T12:34:44.756075+0000","last_fullsized":"2023-10-14T12:34:44.756075+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:07.585462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.766013+0000","last_change":"2023-10-14T12:34:44.769837+0000","last_active":"2023-10-14T12:34:45.766013+0000","last_peered":"2023-10-14T12:34:45.766013+0000","last_clean":"2023-10-14T12:34:45.766013+0000","last_became_active":"2023-10-14T12:34:44.769543+0000","last_became_peered":"2023-10-14T12:34:44.769543+0000","last_unstale":"2023-10-14T12:34:45.766013+0000","last_undegraded":"2023-10-14T12:34:45.766013+0000","last_fullsized":"2023-10-14T12:34:45.766013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:09:34.630376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.758262+0000","last_change":"2023-10-14T12:34:43.738818+0000","last_active":"2023-10-14T12:34:44.758262+0000","last_peered":"2023-10-14T12:34:44.758262+0000","last_clean":"2023-10-14T12:34:44.758262+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:34:44.758262+0000","last_undegraded":"2023-10-14T12:34:44.758262+0000","last_fullsized":"2023-10-14T12:34:44.758262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:21.861042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765067+0000","last_change":"2023-10-14T12:34:44.764824+0000","last_active":"2023-10-14T12:34:45.765067+0000","last_peered":"2023-10-14T12:34:45.765067+0000","last_clean":"2023-10-14T12:34:45.765067+0000","last_became_active":"2023-10-14T12:34:44.764567+0000","last_became_peered":"2023-10-14T12:34:44.764567+0000","last_unstale":"2023-10-14T12:34:45.765067+0000","last_undegraded":"2023-10-14T12:34:45.765067+0000","last_fullsized":"2023-10-14T12:34:45.765067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:52:53.725438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752091+0000","last_change":"2023-10-14T12:34:43.733187+0000","last_active":"2023-10-14T12:34:44.752091+0000","last_peered":"2023-10-14T12:34:44.752091+0000","last_clean":"2023-10-14T12:34:44.752091+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:34:44.752091+0000","last_undegraded":"2023-10-14T12:34:44.752091+0000","last_fullsized":"2023-10-14T12:34:44.752091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:04:35.592100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765866+0000","last_change":"2023-10-14T12:34:44.767412+0000","last_active":"2023-10-14T12:34:45.765866+0000","last_peered":"2023-10-14T12:34:45.765866+0000","last_clean":"2023-10-14T12:34:45.765866+0000","last_became_active":"2023-10-14T12:34:44.766080+0000","last_became_peered":"2023-10-14T12:34:44.766080+0000","last_unstale":"2023-10-14T12:34:45.765866+0000","last_undegraded":"2023-10-14T12:34:45.765866+0000","last_fullsized":"2023-10-14T12:34:45.765866+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:32:41.477384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.752465+0000","last_change":"2023-10-14T12:34:43.744939+0000","last_active":"2023-10-14T12:34:44.752465+0000","last_peered":"2023-10-14T12:34:44.752465+0000","last_clean":"2023-10-14T12:34:44.752465+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:34:44.752465+0000","last_undegraded":"2023-10-14T12:34:44.752465+0000","last_fullsized":"2023-10-14T12:34:44.752465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:42.271784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-14T12:34:44.750684+0000","last_change":"2023-10-14T12:33:27.351654+0000","last_active":"2023-10-14T12:34:44.750684+0000","last_peered":"2023-10-14T12:34:44.750684+0000","last_clean":"2023-10-14T12:34:44.750684+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:34:44.750684+0000","last_undegraded":"2023-10-14T12:34:44.750684+0000","last_fullsized":"2023-10-14T12:34:44.750684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:33:25.769176+0000","last_clean_scrub_stamp":"2023-10-14T12:33:25.769176+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:00:19.227811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":781306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.40699999999999997}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":19.899000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.435}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.31},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56100000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.504},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.63200000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48299999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.495}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.434},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.502}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54000000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.56899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.84199999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.94099999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.747},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.88}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.89600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":779658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.496},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.57699999999999996}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.56000000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.66300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.26100000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.36899999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.34100000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.505}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.53100000000000003}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.52000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":190902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.29099999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.40799999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.46200000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.44900000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.42899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.67500000000000004}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.63500000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.71999999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.76800000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.752},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.69199999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.78300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":189368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.57399999999999995}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.626},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.43099999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48799999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:35:04.151 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.151 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.152 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.152 INFO:tasks.ceph:pgid 6.3c last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.153 INFO:tasks.ceph:pgid 6.3b last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.153 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.153 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.154 INFO:tasks.ceph:pgid 6.38 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.154 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.155 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.155 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.155 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.156 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.156 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.157 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.157 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.157 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.158 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.158 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.158 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.159 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.159 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.160 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.160 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.160 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.161 INFO:tasks.ceph:pgid 6.26 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.161 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.162 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.162 INFO:tasks.ceph:pgid 6.23 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.162 INFO:tasks.ceph:pgid 6.22 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.163 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.163 INFO:tasks.ceph:pgid 6.20 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.163 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.164 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.164 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.165 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.165 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.165 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.166 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.166 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.167 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.167 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.167 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.168 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.168 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.168 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.169 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.169 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.170 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.170 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.170 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.171 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.171 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.171 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.172 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.172 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.173 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.173 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.173 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.174 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.174 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.175 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.175 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.175 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.176 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.176 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.176 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.177 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.177 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.178 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.178 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.178 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.179 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.179 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.179 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.180 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.180 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.181 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.181 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.181 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.182 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.182 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.183 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.183 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.183 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.184 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.184 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.184 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.185 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.185 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.186 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.186 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.186 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.187 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.187 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.187 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.188 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T12:33:25.769176+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=33, tm_sec=25, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:04.188 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T12:35:07.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:35:07.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:35:24.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:35:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.324+0000 7fc0ee36c700 1 Processor -- start 2023-10-14T12:35:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.324+0000 7fc0ee36c700 1 -- start start 2023-10-14T12:35:24.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.324+0000 7fc0ee36c700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc0e80b0c30 0x7fc0e80b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.324+0000 7fc0ee36c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e80c9d40 con 0x7fc0e815b600 2023-10-14T12:35:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.324+0000 7fc0ee36c700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e80b1550 con 0x7fc0e80b1860 2023-10-14T12:35:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.324+0000 7fc0ee36c700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e80cd6d0 con 0x7fc0e80b0c30 2023-10-14T12:35:24.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0ec909700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc0e815b600 0x7fc0e80ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55508/0 (socket says 172.21.15.72:55508) 2023-10-14T12:35:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0ec909700 1 -- 172.21.15.72:0/1993690569 learned_addr learned my addr 172.21.15.72:0/1993690569 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:35:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920835093 0 0) 0x7fc0e80c9d40 con 0x7fc0e815b600 2023-10-14T12:35:24.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e7fff700 1 --2- 172.21.15.72:0/1993690569 >> v2:172.21.15.123:3300/0 conn(0x7fc0e80b0c30 0x7fc0e80b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:24.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0d00057c0 con 0x7fc0e815b600 2023-10-14T12:35:24.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 455785366 0 0) 0x7fc0d00057c0 con 0x7fc0e815b600 2023-10-14T12:35:24.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 >> v2:172.21.15.123:3300/0 conn(0x7fc0e80b0c30 msgr2=0x7fc0e80b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:24.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 --2- 172.21.15.72:0/1993690569 >> v2:172.21.15.123:3300/0 conn(0x7fc0e80b0c30 0x7fc0e80b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 >> v1:172.21.15.123:6789/0 conn(0x7fc0e80b1860 legacy=0x7fc0e80ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e80cd9a0 con 0x7fc0e815b600 2023-10-14T12:35:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7fc0e00019f0 con 0x7fc0e815b600 2023-10-14T12:35:24.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 >> v1:172.21.15.72:6789/0 conn(0x7fc0e815b600 legacy=0x7fc0e80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0d0005c10 0x7fc0d0006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0d0006a60 0x7fc0d0006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:24.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d0007420 0x7fc0d000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80cd6d0 con 0x7fc0d0005c10 2023-10-14T12:35:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d000e350 con 0x7fc0d0007420 2023-10-14T12:35:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d000e510 con 0x7fc0d0006a60 2023-10-14T12:35:24.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e7fff700 1 --2- 172.21.15.72:0/1993690569 >> v2:172.21.15.123:3300/0 conn(0x7fc0e80b0c30 0x7fc0e80b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:35:24.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e7fff700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0d0005c10 0x7fc0d0006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:24.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0ec909700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d0007420 0x7fc0d000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:24.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.325+0000 7fc0e77fe700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0d0006a60 0x7fc0d0006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:24.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0e7fff700 1 -- 172.21.15.72:0/1993690569 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0d0006a60 msgr2=0x7fc0d0006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0e7fff700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0d0006a60 0x7fc0d0006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0e7fff700 1 -- 172.21.15.72:0/1993690569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d0007420 msgr2=0x7fc0d000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:24.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0e7fff700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d0007420 0x7fc0d000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0ec909700 1 -- 172.21.15.72:0/1993690569 reap_dead start 2023-10-14T12:35:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0e7fff700 1 -- 172.21.15.72:0/1993690569 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d00057c0 con 0x7fc0d0005c10 2023-10-14T12:35:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0e7fff700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0d0005c10 0x7fc0d0006010 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009900 tx=0x7fc0d0007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f0d75aebd54ca1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:24.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800c070 con 0x7fc0d0005c10 2023-10-14T12:35:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d8004230 con 0x7fc0d0005c10 2023-10-14T12:35:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0e6ffd700 1 -- 172.21.15.72:0/1993690569 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80045a0 con 0x7fc0d0005c10 2023-10-14T12:35:24.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0ee36c700 1 -- 172.21.15.72:0/1993690569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0d0005c10 msgr2=0x7fc0d0006010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.326+0000 7fc0ee36c700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0d0005c10 0x7fc0d0006010 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009900 tx=0x7fc0d0007a90 comp rx=0 tx=0).stop 2023-10-14T12:35:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.327+0000 7fc0ee36c700 1 -- 172.21.15.72:0/1993690569 shutdown_connections 2023-10-14T12:35:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.327+0000 7fc0ee36c700 1 --2- 172.21.15.72:0/1993690569 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0d0005c10 0x7fc0d0006010 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.327+0000 7fc0ee36c700 1 -- 172.21.15.72:0/1993690569 >> 172.21.15.72:0/1993690569 conn(0x7fc0e806c850 msgr2=0x7fc0e806cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.327+0000 7fc0ee36c700 1 -- 172.21.15.72:0/1993690569 shutdown_connections 2023-10-14T12:35:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.327+0000 7fc0ee36c700 1 -- 172.21.15.72:0/1993690569 wait complete. 2023-10-14T12:35:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.328+0000 7fc0ee36c700 1 Processor -- start 2023-10-14T12:35:24.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.328+0000 7fc0ee36c700 1 -- start start 2023-10-14T12:35:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0ee36c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d0005c10 0x7fc0e80b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:24.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0ee36c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e80aeb10 0x7fc0e80c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:24.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0ee36c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0e8157d30 0x7fc0e8146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:24.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0ee36c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80b0a60 con 0x7fc0e80aeb10 2023-10-14T12:35:24.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0ee36c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8153780 con 0x7fc0d0005c10 2023-10-14T12:35:24.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0ee36c700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8153a20 con 0x7fc0e8157d30 2023-10-14T12:35:24.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e80aeb10 0x7fc0e80c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:24.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d0005c10 0x7fc0e80b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:24.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e80aeb10 0x7fc0e80c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49218/0 (socket says 172.21.15.72:49218) 2023-10-14T12:35:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e77fe700 1 -- 172.21.15.72:0/933694931 learned_addr learned my addr 172.21.15.72:0/933694931 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0ec909700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0e8157d30 0x7fc0e8146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e77fe700 1 -- 172.21.15.72:0/933694931 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0e8157d30 msgr2=0x7fc0e8146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:24.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e77fe700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0e8157d30 0x7fc0e8146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e77fe700 1 -- 172.21.15.72:0/933694931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d0005c10 msgr2=0x7fc0e80b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e77fe700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d0005c10 0x7fc0e80b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e77fe700 1 -- 172.21.15.72:0/933694931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8153d00 con 0x7fc0e80aeb10 2023-10-14T12:35:24.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e77fe700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e80aeb10 0x7fc0e80c5360 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00f840 tx=0x7fc0dc00fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:24.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.329+0000 7fc0e4ff9700 1 -- 172.21.15.72:0/933694931 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc003b80 con 0x7fc0e80aeb10 2023-10-14T12:35:24.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.330+0000 7fc0e4ff9700 1 -- 172.21.15.72:0/933694931 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0dc003ce0 con 0x7fc0e80aeb10 2023-10-14T12:35:24.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.330+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e80c3fb0 con 0x7fc0e80aeb10 2023-10-14T12:35:24.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.330+0000 7fc0e4ff9700 1 -- 172.21.15.72:0/933694931 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc004290 con 0x7fc0e80aeb10 2023-10-14T12:35:24.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.330+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e8147d90 con 0x7fc0e80aeb10 2023-10-14T12:35:24.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.331+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e804f400 con 0x7fc0e80aeb10 2023-10-14T12:35:24.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.331+0000 7fc0e4ff9700 1 -- 172.21.15.72:0/933694931 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc0dc0043f0 con 0x7fc0e80aeb10 2023-10-14T12:35:24.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.331+0000 7fc0e4ff9700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc0d406af30 0x7fc0d406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:24.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.332+0000 7fc0e4ff9700 1 -- 172.21.15.72:0/933694931 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6078+0+0 (secure 0 0 0) 0x7fc0dc0894f0 con 0x7fc0e80aeb10 2023-10-14T12:35:24.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.332+0000 7fc0e7fff700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc0d406af30 0x7fc0d406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:24.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.332+0000 7fc0e7fff700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc0d406af30 0x7fc0d406d3f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8008010 tx=0x7fc0d800c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:24.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.336+0000 7fc0e4ff9700 1 -- 172.21.15.72:0/933694931 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0dc0544c0 con 0x7fc0e80aeb10 2023-10-14T12:35:24.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.520+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0e80cdf60 con 0x7fc0d406af30 2023-10-14T12:35:24.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.528+0000 7fc0e4ff9700 1 -- 172.21.15.72:0/933694931 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287669 (secure 0 0 0) 0x7fc0d80043a0 con 0x7fc0d406af30 2023-10-14T12:35:24.534 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:35:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc0d406af30 msgr2=0x7fc0d406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:24.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc0d406af30 0x7fc0d406d3f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8008010 tx=0x7fc0d800c000 comp rx=0 tx=0).stop 2023-10-14T12:35:24.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e80aeb10 msgr2=0x7fc0e80c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:24.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e80aeb10 0x7fc0e80c5360 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00f840 tx=0x7fc0dc00fb50 comp rx=0 tx=0).stop 2023-10-14T12:35:24.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 shutdown_connections 2023-10-14T12:35:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7fc0d406af30 0x7fc0d406d3f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7fc0e8157d30 0x7fc0e8146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0d0005c10 0x7fc0e80b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 --2- 172.21.15.72:0/933694931 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0e80aeb10 0x7fc0e80c5360 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 >> 172.21.15.72:0/933694931 conn(0x7fc0e806c850 msgr2=0x7fc0e80ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 shutdown_connections 2023-10-14T12:35:24.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:24.532+0000 7fc0ee36c700 1 -- 172.21.15.72:0/933694931 wait complete. 2023-10-14T12:35:24.541 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:35:24.545 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-10-14T12:35:23.408989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220776,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753944,"statfs":{"total":773094113280,"available":772868038656,"internally_reserved":0,"allocated":4759552,"data_stored":2699604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002021"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836217+0000","last_change":"2023-10-14T12:34:44.773258+0000","last_active":"2023-10-14T12:34:45.836217+0000","last_peered":"2023-10-14T12:34:45.836217+0000","last_clean":"2023-10-14T12:34:45.836217+0000","last_became_active":"2023-10-14T12:34:44.772874+0000","last_became_peered":"2023-10-14T12:34:44.772874+0000","last_unstale":"2023-10-14T12:34:45.836217+0000","last_undegraded":"2023-10-14T12:34:45.836217+0000","last_fullsized":"2023-10-14T12:34:45.836217+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835901+0000","last_change":"2023-10-14T12:34:44.766065+0000","last_active":"2023-10-14T12:34:45.835901+0000","last_peered":"2023-10-14T12:34:45.835901+0000","last_clean":"2023-10-14T12:34:45.835901+0000","last_became_active":"2023-10-14T12:34:44.765783+0000","last_became_peered":"2023-10-14T12:34:44.765783+0000","last_unstale":"2023-10-14T12:34:45.835901+0000","last_undegraded":"2023-10-14T12:34:45.835901+0000","last_fullsized":"2023-10-14T12:34:45.835901+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836829+0000","last_change":"2023-10-14T12:34:44.766216+0000","last_active":"2023-10-14T12:34:45.836829+0000","last_peered":"2023-10-14T12:34:45.836829+0000","last_clean":"2023-10-14T12:34:45.836829+0000","last_became_active":"2023-10-14T12:34:44.765915+0000","last_became_peered":"2023-10-14T12:34:44.765915+0000","last_unstale":"2023-10-14T12:34:45.836829+0000","last_undegraded":"2023-10-14T12:34:45.836829+0000","last_fullsized":"2023-10-14T12:34:45.836829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:18.776272+0000","last_change":"2023-10-14T12:35:18.776321+0000","last_active":"2023-10-14T12:35:18.776272+0000","last_peered":"2023-10-14T12:35:18.776272+0000","last_clean":"2023-10-14T12:35:18.776272+0000","last_became_active":"2023-10-14T12:34:44.776527+0000","last_became_peered":"2023-10-14T12:34:44.776527+0000","last_unstale":"2023-10-14T12:35:18.776272+0000","last_undegraded":"2023-10-14T12:35:18.776272+0000","last_fullsized":"2023-10-14T12:35:18.776272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:18.776173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:18.776173+0000","last_clean_scrub_stamp":"2023-10-14T12:35:18.776173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:28.785632+0000","scrub_duration":0.0018641529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:17.819838+0000","last_change":"2023-10-14T12:35:17.819900+0000","last_active":"2023-10-14T12:35:17.819838+0000","last_peered":"2023-10-14T12:35:17.819838+0000","last_clean":"2023-10-14T12:35:17.819838+0000","last_became_active":"2023-10-14T12:34:44.774508+0000","last_became_peered":"2023-10-14T12:34:44.774508+0000","last_unstale":"2023-10-14T12:35:17.819838+0000","last_undegraded":"2023-10-14T12:35:17.819838+0000","last_fullsized":"2023-10-14T12:35:17.819838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:17.819723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:17.819723+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.819723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:42:17.377314+0000","scrub_duration":0.0021875810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835480+0000","last_change":"2023-10-14T12:34:44.771286+0000","last_active":"2023-10-14T12:34:45.835480+0000","last_peered":"2023-10-14T12:34:45.835480+0000","last_clean":"2023-10-14T12:34:45.835480+0000","last_became_active":"2023-10-14T12:34:44.768717+0000","last_became_peered":"2023-10-14T12:34:44.768717+0000","last_unstale":"2023-10-14T12:34:45.835480+0000","last_undegraded":"2023-10-14T12:34:45.835480+0000","last_fullsized":"2023-10-14T12:34:45.835480+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764157+0000","last_change":"2023-10-14T12:34:44.771173+0000","last_active":"2023-10-14T12:34:45.764157+0000","last_peered":"2023-10-14T12:34:45.764157+0000","last_clean":"2023-10-14T12:34:45.764157+0000","last_became_active":"2023-10-14T12:34:44.770869+0000","last_became_peered":"2023-10-14T12:34:44.770869+0000","last_unstale":"2023-10-14T12:34:45.764157+0000","last_undegraded":"2023-10-14T12:34:45.764157+0000","last_fullsized":"2023-10-14T12:34:45.764157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:13.657245+0000","last_change":"2023-10-14T12:35:13.657294+0000","last_active":"2023-10-14T12:35:13.657245+0000","last_peered":"2023-10-14T12:35:13.657245+0000","last_clean":"2023-10-14T12:35:13.657245+0000","last_became_active":"2023-10-14T12:34:44.765917+0000","last_became_peered":"2023-10-14T12:34:44.765917+0000","last_unstale":"2023-10-14T12:35:13.657245+0000","last_undegraded":"2023-10-14T12:35:13.657245+0000","last_fullsized":"2023-10-14T12:35:13.657245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:13.657150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:13.657150+0000","last_clean_scrub_stamp":"2023-10-14T12:35:13.657150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:14.297961+0000","scrub_duration":0.001938305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.837006+0000","last_change":"2023-10-14T12:34:44.769040+0000","last_active":"2023-10-14T12:34:45.837006+0000","last_peered":"2023-10-14T12:34:45.837006+0000","last_clean":"2023-10-14T12:34:45.837006+0000","last_became_active":"2023-10-14T12:34:44.768514+0000","last_became_peered":"2023-10-14T12:34:44.768514+0000","last_unstale":"2023-10-14T12:34:45.837006+0000","last_undegraded":"2023-10-14T12:34:45.837006+0000","last_fullsized":"2023-10-14T12:34:45.837006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765580+0000","last_change":"2023-10-14T12:34:44.764554+0000","last_active":"2023-10-14T12:34:45.765580+0000","last_peered":"2023-10-14T12:34:45.765580+0000","last_clean":"2023-10-14T12:34:45.765580+0000","last_became_active":"2023-10-14T12:34:44.764252+0000","last_became_peered":"2023-10-14T12:34:44.764252+0000","last_unstale":"2023-10-14T12:34:45.765580+0000","last_undegraded":"2023-10-14T12:34:45.765580+0000","last_fullsized":"2023-10-14T12:34:45.765580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764686+0000","last_change":"2023-10-14T12:34:44.776394+0000","last_active":"2023-10-14T12:34:45.764686+0000","last_peered":"2023-10-14T12:34:45.764686+0000","last_clean":"2023-10-14T12:34:45.764686+0000","last_became_active":"2023-10-14T12:34:44.775897+0000","last_became_peered":"2023-10-14T12:34:44.775897+0000","last_unstale":"2023-10-14T12:34:45.764686+0000","last_undegraded":"2023-10-14T12:34:45.764686+0000","last_fullsized":"2023-10-14T12:34:45.764686+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836773+0000","last_change":"2023-10-14T12:34:44.766520+0000","last_active":"2023-10-14T12:34:45.836773+0000","last_peered":"2023-10-14T12:34:45.836773+0000","last_clean":"2023-10-14T12:34:45.836773+0000","last_became_active":"2023-10-14T12:34:44.766208+0000","last_became_peered":"2023-10-14T12:34:44.766208+0000","last_unstale":"2023-10-14T12:34:45.836773+0000","last_undegraded":"2023-10-14T12:34:45.836773+0000","last_fullsized":"2023-10-14T12:34:45.836773+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764488+0000","last_change":"2023-10-14T12:34:44.767161+0000","last_active":"2023-10-14T12:34:45.764488+0000","last_peered":"2023-10-14T12:34:45.764488+0000","last_clean":"2023-10-14T12:34:45.764488+0000","last_became_active":"2023-10-14T12:34:44.766602+0000","last_became_peered":"2023-10-14T12:34:44.766602+0000","last_unstale":"2023-10-14T12:34:45.764488+0000","last_undegraded":"2023-10-14T12:34:45.764488+0000","last_fullsized":"2023-10-14T12:34:45.764488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765884+0000","last_change":"2023-10-14T12:34:44.770652+0000","last_active":"2023-10-14T12:34:45.765884+0000","last_peered":"2023-10-14T12:34:45.765884+0000","last_clean":"2023-10-14T12:34:45.765884+0000","last_became_active":"2023-10-14T12:34:44.770368+0000","last_became_peered":"2023-10-14T12:34:44.770368+0000","last_unstale":"2023-10-14T12:34:45.765884+0000","last_undegraded":"2023-10-14T12:34:45.765884+0000","last_fullsized":"2023-10-14T12:34:45.765884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.763856+0000","last_change":"2023-10-14T12:34:44.764695+0000","last_active":"2023-10-14T12:34:45.763856+0000","last_peered":"2023-10-14T12:34:45.763856+0000","last_clean":"2023-10-14T12:34:45.763856+0000","last_became_active":"2023-10-14T12:34:44.763083+0000","last_became_peered":"2023-10-14T12:34:44.763083+0000","last_unstale":"2023-10-14T12:34:45.763856+0000","last_undegraded":"2023-10-14T12:34:45.763856+0000","last_fullsized":"2023-10-14T12:34:45.763856+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765740+0000","last_change":"2023-10-14T12:34:44.768707+0000","last_active":"2023-10-14T12:34:45.765740+0000","last_peered":"2023-10-14T12:34:45.765740+0000","last_clean":"2023-10-14T12:34:45.765740+0000","last_became_active":"2023-10-14T12:34:44.768474+0000","last_became_peered":"2023-10-14T12:34:44.768474+0000","last_unstale":"2023-10-14T12:34:45.765740+0000","last_undegraded":"2023-10-14T12:34:45.765740+0000","last_fullsized":"2023-10-14T12:34:45.765740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765838+0000","last_change":"2023-10-14T12:34:44.771432+0000","last_active":"2023-10-14T12:34:45.765838+0000","last_peered":"2023-10-14T12:34:45.765838+0000","last_clean":"2023-10-14T12:34:45.765838+0000","last_became_active":"2023-10-14T12:34:44.771158+0000","last_became_peered":"2023-10-14T12:34:44.771158+0000","last_unstale":"2023-10-14T12:34:45.765838+0000","last_undegraded":"2023-10-14T12:34:45.765838+0000","last_fullsized":"2023-10-14T12:34:45.765838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835544+0000","last_change":"2023-10-14T12:34:44.776578+0000","last_active":"2023-10-14T12:34:45.835544+0000","last_peered":"2023-10-14T12:34:45.835544+0000","last_clean":"2023-10-14T12:34:45.835544+0000","last_became_active":"2023-10-14T12:34:44.776263+0000","last_became_peered":"2023-10-14T12:34:44.776263+0000","last_unstale":"2023-10-14T12:34:45.835544+0000","last_undegraded":"2023-10-14T12:34:45.835544+0000","last_fullsized":"2023-10-14T12:34:45.835544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835707+0000","last_change":"2023-10-14T12:34:44.767374+0000","last_active":"2023-10-14T12:34:45.835707+0000","last_peered":"2023-10-14T12:34:45.835707+0000","last_clean":"2023-10-14T12:34:45.835707+0000","last_became_active":"2023-10-14T12:34:44.767035+0000","last_became_peered":"2023-10-14T12:34:44.767035+0000","last_unstale":"2023-10-14T12:34:45.835707+0000","last_undegraded":"2023-10-14T12:34:45.835707+0000","last_fullsized":"2023-10-14T12:34:45.835707+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:12.349701+0000","last_change":"2023-10-14T12:35:12.349752+0000","last_active":"2023-10-14T12:35:12.349701+0000","last_peered":"2023-10-14T12:35:12.349701+0000","last_clean":"2023-10-14T12:35:12.349701+0000","last_became_active":"2023-10-14T12:34:44.775453+0000","last_became_peered":"2023-10-14T12:34:44.775453+0000","last_unstale":"2023-10-14T12:35:12.349701+0000","last_undegraded":"2023-10-14T12:35:12.349701+0000","last_fullsized":"2023-10-14T12:35:12.349701+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:12.349586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:12.349586+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.349586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:45.239721+0000","scrub_duration":0.001482625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764606+0000","last_change":"2023-10-14T12:34:44.766571+0000","last_active":"2023-10-14T12:34:45.764606+0000","last_peered":"2023-10-14T12:34:45.764606+0000","last_clean":"2023-10-14T12:34:45.764606+0000","last_became_active":"2023-10-14T12:34:44.766299+0000","last_became_peered":"2023-10-14T12:34:44.766299+0000","last_unstale":"2023-10-14T12:34:45.764606+0000","last_undegraded":"2023-10-14T12:34:45.764606+0000","last_fullsized":"2023-10-14T12:34:45.764606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765906+0000","last_change":"2023-10-14T12:34:44.770392+0000","last_active":"2023-10-14T12:34:45.765906+0000","last_peered":"2023-10-14T12:34:45.765906+0000","last_clean":"2023-10-14T12:34:45.765906+0000","last_became_active":"2023-10-14T12:34:44.770033+0000","last_became_peered":"2023-10-14T12:34:44.770033+0000","last_unstale":"2023-10-14T12:34:45.765906+0000","last_undegraded":"2023-10-14T12:34:45.765906+0000","last_fullsized":"2023-10-14T12:34:45.765906+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765615+0000","last_change":"2023-10-14T12:34:44.768259+0000","last_active":"2023-10-14T12:34:45.765615+0000","last_peered":"2023-10-14T12:34:45.765615+0000","last_clean":"2023-10-14T12:34:45.765615+0000","last_became_active":"2023-10-14T12:34:44.767967+0000","last_became_peered":"2023-10-14T12:34:44.767967+0000","last_unstale":"2023-10-14T12:34:45.765615+0000","last_undegraded":"2023-10-14T12:34:45.765615+0000","last_fullsized":"2023-10-14T12:34:45.765615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835270+0000","last_change":"2023-10-14T12:34:44.770347+0000","last_active":"2023-10-14T12:34:45.835270+0000","last_peered":"2023-10-14T12:34:45.835270+0000","last_clean":"2023-10-14T12:34:45.835270+0000","last_became_active":"2023-10-14T12:34:44.768304+0000","last_became_peered":"2023-10-14T12:34:44.768304+0000","last_unstale":"2023-10-14T12:34:45.835270+0000","last_undegraded":"2023-10-14T12:34:45.835270+0000","last_fullsized":"2023-10-14T12:34:45.835270+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:15.404415+0000","last_change":"2023-10-14T12:35:15.404467+0000","last_active":"2023-10-14T12:35:15.404415+0000","last_peered":"2023-10-14T12:35:15.404415+0000","last_clean":"2023-10-14T12:35:15.404415+0000","last_became_active":"2023-10-14T12:34:44.764072+0000","last_became_peered":"2023-10-14T12:34:44.764072+0000","last_unstale":"2023-10-14T12:35:15.404415+0000","last_undegraded":"2023-10-14T12:35:15.404415+0000","last_fullsized":"2023-10-14T12:35:15.404415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:15.404312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:15.404312+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.404312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:26.281514+0000","scrub_duration":0.00201366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835447+0000","last_change":"2023-10-14T12:34:44.768012+0000","last_active":"2023-10-14T12:34:45.835447+0000","last_peered":"2023-10-14T12:34:45.835447+0000","last_clean":"2023-10-14T12:34:45.835447+0000","last_became_active":"2023-10-14T12:34:44.767743+0000","last_became_peered":"2023-10-14T12:34:44.767743+0000","last_unstale":"2023-10-14T12:34:45.835447+0000","last_undegraded":"2023-10-14T12:34:45.835447+0000","last_fullsized":"2023-10-14T12:34:45.835447+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:19.441316+0000","last_change":"2023-10-14T12:35:19.441376+0000","last_active":"2023-10-14T12:35:19.441316+0000","last_peered":"2023-10-14T12:35:19.441316+0000","last_clean":"2023-10-14T12:35:19.441316+0000","last_became_active":"2023-10-14T12:34:44.766309+0000","last_became_peered":"2023-10-14T12:34:44.766309+0000","last_unstale":"2023-10-14T12:35:19.441316+0000","last_undegraded":"2023-10-14T12:35:19.441316+0000","last_fullsized":"2023-10-14T12:35:19.441316+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.441218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.441218+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.441218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:44.997017+0000","scrub_duration":0.0015683240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764405+0000","last_change":"2023-10-14T12:34:44.766262+0000","last_active":"2023-10-14T12:34:45.764405+0000","last_peered":"2023-10-14T12:34:45.764405+0000","last_clean":"2023-10-14T12:34:45.764405+0000","last_became_active":"2023-10-14T12:34:44.765904+0000","last_became_peered":"2023-10-14T12:34:44.765904+0000","last_unstale":"2023-10-14T12:34:45.764405+0000","last_undegraded":"2023-10-14T12:34:45.764405+0000","last_fullsized":"2023-10-14T12:34:45.764405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:17.455095+0000","last_change":"2023-10-14T12:35:17.455157+0000","last_active":"2023-10-14T12:35:17.455095+0000","last_peered":"2023-10-14T12:35:17.455095+0000","last_clean":"2023-10-14T12:35:17.455095+0000","last_became_active":"2023-10-14T12:34:44.764719+0000","last_became_peered":"2023-10-14T12:34:44.764719+0000","last_unstale":"2023-10-14T12:35:17.455095+0000","last_undegraded":"2023-10-14T12:35:17.455095+0000","last_fullsized":"2023-10-14T12:35:17.455095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:17.454997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:17.454997+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.454997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:57.377417+0000","scrub_duration":0.0023420310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:10.332828+0000","last_change":"2023-10-14T12:35:10.332872+0000","last_active":"2023-10-14T12:35:10.332828+0000","last_peered":"2023-10-14T12:35:10.332828+0000","last_clean":"2023-10-14T12:35:10.332828+0000","last_became_active":"2023-10-14T12:34:44.768729+0000","last_became_peered":"2023-10-14T12:34:44.768729+0000","last_unstale":"2023-10-14T12:35:10.332828+0000","last_undegraded":"2023-10-14T12:35:10.332828+0000","last_fullsized":"2023-10-14T12:35:10.332828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:10.332731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:10.332731+0000","last_clean_scrub_stamp":"2023-10-14T12:35:10.332731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.102844+0000","scrub_duration":0.0013980189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765471+0000","last_change":"2023-10-14T12:34:44.768972+0000","last_active":"2023-10-14T12:34:45.765471+0000","last_peered":"2023-10-14T12:34:45.765471+0000","last_clean":"2023-10-14T12:34:45.765471+0000","last_became_active":"2023-10-14T12:34:44.768243+0000","last_became_peered":"2023-10-14T12:34:44.768243+0000","last_unstale":"2023-10-14T12:34:45.765471+0000","last_undegraded":"2023-10-14T12:34:45.765471+0000","last_fullsized":"2023-10-14T12:34:45.765471+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:14.491517+0000","last_change":"2023-10-14T12:35:14.491561+0000","last_active":"2023-10-14T12:35:14.491517+0000","last_peered":"2023-10-14T12:35:14.491517+0000","last_clean":"2023-10-14T12:35:14.491517+0000","last_became_active":"2023-10-14T12:34:44.768423+0000","last_became_peered":"2023-10-14T12:34:44.768423+0000","last_unstale":"2023-10-14T12:35:14.491517+0000","last_undegraded":"2023-10-14T12:35:14.491517+0000","last_fullsized":"2023-10-14T12:35:14.491517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:14.491409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:14.491409+0000","last_clean_scrub_stamp":"2023-10-14T12:35:14.491409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:23.466129+0000","scrub_duration":0.001502986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765122+0000","last_change":"2023-10-14T12:34:44.771115+0000","last_active":"2023-10-14T12:34:45.765122+0000","last_peered":"2023-10-14T12:34:45.765122+0000","last_clean":"2023-10-14T12:34:45.765122+0000","last_became_active":"2023-10-14T12:34:44.770846+0000","last_became_peered":"2023-10-14T12:34:44.770846+0000","last_unstale":"2023-10-14T12:34:45.765122+0000","last_undegraded":"2023-10-14T12:34:45.765122+0000","last_fullsized":"2023-10-14T12:34:45.765122+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:09.344223+0000","last_change":"2023-10-14T12:35:09.344283+0000","last_active":"2023-10-14T12:35:09.344223+0000","last_peered":"2023-10-14T12:35:09.344223+0000","last_clean":"2023-10-14T12:35:09.344223+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:35:09.344223+0000","last_undegraded":"2023-10-14T12:35:09.344223+0000","last_fullsized":"2023-10-14T12:35:09.344223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2023-10-14T12:35:09.344122+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2023-10-14T12:35:09.344122+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.344122+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:30.708229+0000","scrub_duration":0.0021377689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:16.489516+0000","last_change":"2023-10-14T12:35:16.489564+0000","last_active":"2023-10-14T12:35:16.489516+0000","last_peered":"2023-10-14T12:35:16.489516+0000","last_clean":"2023-10-14T12:35:16.489516+0000","last_became_active":"2023-10-14T12:34:44.772093+0000","last_became_peered":"2023-10-14T12:34:44.772093+0000","last_unstale":"2023-10-14T12:35:16.489516+0000","last_undegraded":"2023-10-14T12:35:16.489516+0000","last_fullsized":"2023-10-14T12:35:16.489516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:16.489425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:16.489425+0000","last_clean_scrub_stamp":"2023-10-14T12:35:16.489425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:20.761264+0000","scrub_duration":0.001862371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:04.627042+0000","last_change":"2023-10-14T12:35:04.627114+0000","last_active":"2023-10-14T12:35:04.627042+0000","last_peered":"2023-10-14T12:35:04.627042+0000","last_clean":"2023-10-14T12:35:04.627042+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:35:04.627042+0000","last_undegraded":"2023-10-14T12:35:04.627042+0000","last_fullsized":"2023-10-14T12:35:04.627042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:04.626942+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:04.626942+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.626942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:18.397054+0000","scrub_duration":0.0018766779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765536+0000","last_change":"2023-10-14T12:34:44.775914+0000","last_active":"2023-10-14T12:34:45.765536+0000","last_peered":"2023-10-14T12:34:45.765536+0000","last_clean":"2023-10-14T12:34:45.765536+0000","last_became_active":"2023-10-14T12:34:44.775648+0000","last_became_peered":"2023-10-14T12:34:44.775648+0000","last_unstale":"2023-10-14T12:34:45.765536+0000","last_undegraded":"2023-10-14T12:34:45.765536+0000","last_fullsized":"2023-10-14T12:34:45.765536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:08.488806+0000","last_change":"2023-10-14T12:35:08.488859+0000","last_active":"2023-10-14T12:35:08.488806+0000","last_peered":"2023-10-14T12:35:08.488806+0000","last_clean":"2023-10-14T12:35:08.488806+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:35:08.488806+0000","last_undegraded":"2023-10-14T12:35:08.488806+0000","last_fullsized":"2023-10-14T12:35:08.488806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:08.488716+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:08.488716+0000","last_clean_scrub_stamp":"2023-10-14T12:35:08.488716+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:37.867958+0000","scrub_duration":0.0023671130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836194+0000","last_change":"2023-10-14T12:34:44.765349+0000","last_active":"2023-10-14T12:34:45.836194+0000","last_peered":"2023-10-14T12:34:45.836194+0000","last_clean":"2023-10-14T12:34:45.836194+0000","last_became_active":"2023-10-14T12:34:44.765043+0000","last_became_peered":"2023-10-14T12:34:44.765043+0000","last_unstale":"2023-10-14T12:34:45.836194+0000","last_undegraded":"2023-10-14T12:34:45.836194+0000","last_fullsized":"2023-10-14T12:34:45.836194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:05.442091+0000","last_change":"2023-10-14T12:35:05.442139+0000","last_active":"2023-10-14T12:35:05.442091+0000","last_peered":"2023-10-14T12:35:05.442091+0000","last_clean":"2023-10-14T12:35:05.442091+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:35:05.442091+0000","last_undegraded":"2023-10-14T12:35:05.442091+0000","last_fullsized":"2023-10-14T12:35:05.442091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:05.442005+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:05.442005+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.442005+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:05.609035+0000","scrub_duration":0.0022538969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:07.594936+0000","last_change":"2023-10-14T12:35:07.594986+0000","last_active":"2023-10-14T12:35:07.594936+0000","last_peered":"2023-10-14T12:35:07.594936+0000","last_clean":"2023-10-14T12:35:07.594936+0000","last_became_active":"2023-10-14T12:34:44.763356+0000","last_became_peered":"2023-10-14T12:34:44.763356+0000","last_unstale":"2023-10-14T12:35:07.594936+0000","last_undegraded":"2023-10-14T12:35:07.594936+0000","last_fullsized":"2023-10-14T12:35:07.594936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:07.594832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:07.594832+0000","last_clean_scrub_stamp":"2023-10-14T12:35:07.594832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:54.639365+0000","scrub_duration":0.001521924,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:14.831242+0000","last_change":"2023-10-14T12:35:14.831305+0000","last_active":"2023-10-14T12:35:14.831242+0000","last_peered":"2023-10-14T12:35:14.831242+0000","last_clean":"2023-10-14T12:35:14.831242+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:35:14.831242+0000","last_undegraded":"2023-10-14T12:35:14.831242+0000","last_fullsized":"2023-10-14T12:35:14.831242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:14.831136+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:14.831136+0000","last_clean_scrub_stamp":"2023-10-14T12:35:14.831136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:40.543419+0000","scrub_duration":0.0021581809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764050+0000","last_change":"2023-10-14T12:34:44.767242+0000","last_active":"2023-10-14T12:34:45.764050+0000","last_peered":"2023-10-14T12:34:45.764050+0000","last_clean":"2023-10-14T12:34:45.764050+0000","last_became_active":"2023-10-14T12:34:44.766961+0000","last_became_peered":"2023-10-14T12:34:44.766961+0000","last_unstale":"2023-10-14T12:34:45.764050+0000","last_undegraded":"2023-10-14T12:34:45.764050+0000","last_fullsized":"2023-10-14T12:34:45.764050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765020+0000","last_change":"2023-10-14T12:34:43.747673+0000","last_active":"2023-10-14T12:34:45.765020+0000","last_peered":"2023-10-14T12:34:45.765020+0000","last_clean":"2023-10-14T12:34:45.765020+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:34:45.765020+0000","last_undegraded":"2023-10-14T12:34:45.765020+0000","last_fullsized":"2023-10-14T12:34:45.765020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.766018+0000","last_change":"2023-10-14T12:34:44.770562+0000","last_active":"2023-10-14T12:34:45.766018+0000","last_peered":"2023-10-14T12:34:45.766018+0000","last_clean":"2023-10-14T12:34:45.766018+0000","last_became_active":"2023-10-14T12:34:44.770030+0000","last_became_peered":"2023-10-14T12:34:44.770030+0000","last_unstale":"2023-10-14T12:34:45.766018+0000","last_undegraded":"2023-10-14T12:34:45.766018+0000","last_fullsized":"2023-10-14T12:34:45.766018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:13.472574+0000","last_change":"2023-10-14T12:35:13.472623+0000","last_active":"2023-10-14T12:35:13.472574+0000","last_peered":"2023-10-14T12:35:13.472574+0000","last_clean":"2023-10-14T12:35:13.472574+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:35:13.472574+0000","last_undegraded":"2023-10-14T12:35:13.472574+0000","last_fullsized":"2023-10-14T12:35:13.472574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:13.472474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:13.472474+0000","last_clean_scrub_stamp":"2023-10-14T12:35:13.472474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:43.300344+0000","scrub_duration":0.0017954729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836053+0000","last_change":"2023-10-14T12:34:44.762002+0000","last_active":"2023-10-14T12:34:45.836053+0000","last_peered":"2023-10-14T12:34:45.836053+0000","last_clean":"2023-10-14T12:34:45.836053+0000","last_became_active":"2023-10-14T12:34:44.761308+0000","last_became_peered":"2023-10-14T12:34:44.761308+0000","last_unstale":"2023-10-14T12:34:45.836053+0000","last_undegraded":"2023-10-14T12:34:45.836053+0000","last_fullsized":"2023-10-14T12:34:45.836053+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:06.455879+0000","last_change":"2023-10-14T12:35:06.455925+0000","last_active":"2023-10-14T12:35:06.455879+0000","last_peered":"2023-10-14T12:35:06.455879+0000","last_clean":"2023-10-14T12:35:06.455879+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:35:06.455879+0000","last_undegraded":"2023-10-14T12:35:06.455879+0000","last_fullsized":"2023-10-14T12:35:06.455879+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:06.455787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:06.455787+0000","last_clean_scrub_stamp":"2023-10-14T12:35:06.455787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:54.240104+0000","scrub_duration":0.0017672090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835791+0000","last_change":"2023-10-14T12:34:44.776821+0000","last_active":"2023-10-14T12:34:45.835791+0000","last_peered":"2023-10-14T12:34:45.835791+0000","last_clean":"2023-10-14T12:34:45.835791+0000","last_became_active":"2023-10-14T12:34:44.776592+0000","last_became_peered":"2023-10-14T12:34:44.776592+0000","last_unstale":"2023-10-14T12:34:45.835791+0000","last_undegraded":"2023-10-14T12:34:45.835791+0000","last_fullsized":"2023-10-14T12:34:45.835791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:09.633987+0000","last_change":"2023-10-14T12:35:09.634042+0000","last_active":"2023-10-14T12:35:09.633987+0000","last_peered":"2023-10-14T12:35:09.633987+0000","last_clean":"2023-10-14T12:35:09.633987+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:35:09.633987+0000","last_undegraded":"2023-10-14T12:35:09.633987+0000","last_fullsized":"2023-10-14T12:35:09.633987+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:09.633882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:09.633882+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.633882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:37.630913+0000","scrub_duration":0.0016000669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765272+0000","last_change":"2023-10-14T12:34:44.763705+0000","last_active":"2023-10-14T12:34:45.765272+0000","last_peered":"2023-10-14T12:34:45.765272+0000","last_clean":"2023-10-14T12:34:45.765272+0000","last_became_active":"2023-10-14T12:34:44.763408+0000","last_became_peered":"2023-10-14T12:34:44.763408+0000","last_unstale":"2023-10-14T12:34:45.765272+0000","last_undegraded":"2023-10-14T12:34:45.765272+0000","last_fullsized":"2023-10-14T12:34:45.765272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:06.805190+0000","last_change":"2023-10-14T12:35:06.805234+0000","last_active":"2023-10-14T12:35:06.805190+0000","last_peered":"2023-10-14T12:35:06.805190+0000","last_clean":"2023-10-14T12:35:06.805190+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:35:06.805190+0000","last_undegraded":"2023-10-14T12:35:06.805190+0000","last_fullsized":"2023-10-14T12:35:06.805190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:06.805056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:06.805056+0000","last_clean_scrub_stamp":"2023-10-14T12:35:06.805056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:32.360854+0000","scrub_duration":0.001935003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:17.654580+0000","last_change":"2023-10-14T12:35:17.654663+0000","last_active":"2023-10-14T12:35:17.654580+0000","last_peered":"2023-10-14T12:35:17.654580+0000","last_clean":"2023-10-14T12:35:17.654580+0000","last_became_active":"2023-10-14T12:34:44.764455+0000","last_became_peered":"2023-10-14T12:34:44.764455+0000","last_unstale":"2023-10-14T12:35:17.654580+0000","last_undegraded":"2023-10-14T12:35:17.654580+0000","last_fullsized":"2023-10-14T12:35:17.654580+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:17.654436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:17.654436+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.654436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:43.809107+0000","scrub_duration":0.0021283600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:09.745017+0000","last_change":"2023-10-14T12:35:09.745066+0000","last_active":"2023-10-14T12:35:09.745017+0000","last_peered":"2023-10-14T12:35:09.745017+0000","last_clean":"2023-10-14T12:35:09.745017+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:35:09.745017+0000","last_undegraded":"2023-10-14T12:35:09.745017+0000","last_fullsized":"2023-10-14T12:35:09.745017+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2023-10-14T12:35:09.744908+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2023-10-14T12:35:09.744908+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.744908+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:44.024377+0000","scrub_duration":0.0024157639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765426+0000","last_change":"2023-10-14T12:34:44.774548+0000","last_active":"2023-10-14T12:34:45.765426+0000","last_peered":"2023-10-14T12:34:45.765426+0000","last_clean":"2023-10-14T12:34:45.765426+0000","last_became_active":"2023-10-14T12:34:44.774253+0000","last_became_peered":"2023-10-14T12:34:44.774253+0000","last_unstale":"2023-10-14T12:34:45.765426+0000","last_undegraded":"2023-10-14T12:34:45.765426+0000","last_fullsized":"2023-10-14T12:34:45.765426+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:03.578586+0000","last_change":"2023-10-14T12:35:03.578668+0000","last_active":"2023-10-14T12:35:03.578586+0000","last_peered":"2023-10-14T12:35:03.578586+0000","last_clean":"2023-10-14T12:35:03.578586+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:35:03.578586+0000","last_undegraded":"2023-10-14T12:35:03.578586+0000","last_fullsized":"2023-10-14T12:35:03.578586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2023-10-14T12:35:03.578503+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2023-10-14T12:35:03.578503+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.578503+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:07.850341+0000","scrub_duration":0.003262222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836574+0000","last_change":"2023-10-14T12:34:44.766187+0000","last_active":"2023-10-14T12:34:45.836574+0000","last_peered":"2023-10-14T12:34:45.836574+0000","last_clean":"2023-10-14T12:34:45.836574+0000","last_became_active":"2023-10-14T12:34:44.765932+0000","last_became_peered":"2023-10-14T12:34:44.765932+0000","last_unstale":"2023-10-14T12:34:45.836574+0000","last_undegraded":"2023-10-14T12:34:45.836574+0000","last_fullsized":"2023-10-14T12:34:45.836574+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:10.618170+0000","last_change":"2023-10-14T12:35:10.618248+0000","last_active":"2023-10-14T12:35:10.618170+0000","last_peered":"2023-10-14T12:35:10.618170+0000","last_clean":"2023-10-14T12:35:10.618170+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:35:10.618170+0000","last_undegraded":"2023-10-14T12:35:10.618170+0000","last_fullsized":"2023-10-14T12:35:10.618170+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:10.618045+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:10.618045+0000","last_clean_scrub_stamp":"2023-10-14T12:35:10.618045+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:35.811911+0000","scrub_duration":0.0024294249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835803+0000","last_change":"2023-10-14T12:34:44.773042+0000","last_active":"2023-10-14T12:34:45.835803+0000","last_peered":"2023-10-14T12:34:45.835803+0000","last_clean":"2023-10-14T12:34:45.835803+0000","last_became_active":"2023-10-14T12:34:44.772662+0000","last_became_peered":"2023-10-14T12:34:44.772662+0000","last_unstale":"2023-10-14T12:34:45.835803+0000","last_undegraded":"2023-10-14T12:34:45.835803+0000","last_fullsized":"2023-10-14T12:34:45.835803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:07.455141+0000","last_change":"2023-10-14T12:35:07.455189+0000","last_active":"2023-10-14T12:35:07.455141+0000","last_peered":"2023-10-14T12:35:07.455141+0000","last_clean":"2023-10-14T12:35:07.455141+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:35:07.455141+0000","last_undegraded":"2023-10-14T12:35:07.455141+0000","last_fullsized":"2023-10-14T12:35:07.455141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:07.455036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:07.455036+0000","last_clean_scrub_stamp":"2023-10-14T12:35:07.455036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:49.230595+0000","scrub_duration":0.0021334510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764925+0000","last_change":"2023-10-14T12:34:44.761488+0000","last_active":"2023-10-14T12:34:45.764925+0000","last_peered":"2023-10-14T12:34:45.764925+0000","last_clean":"2023-10-14T12:34:45.764925+0000","last_became_active":"2023-10-14T12:34:44.761153+0000","last_became_peered":"2023-10-14T12:34:44.761153+0000","last_unstale":"2023-10-14T12:34:45.764925+0000","last_undegraded":"2023-10-14T12:34:45.764925+0000","last_fullsized":"2023-10-14T12:34:45.764925+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:05.297664+0000","last_change":"2023-10-14T12:35:05.297709+0000","last_active":"2023-10-14T12:35:05.297664+0000","last_peered":"2023-10-14T12:35:05.297664+0000","last_clean":"2023-10-14T12:35:05.297664+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:35:05.297664+0000","last_undegraded":"2023-10-14T12:35:05.297664+0000","last_fullsized":"2023-10-14T12:35:05.297664+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:05.297555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:05.297555+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.297555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:30.748938+0000","scrub_duration":0.0015276039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:12.665218+0000","last_change":"2023-10-14T12:35:12.665284+0000","last_active":"2023-10-14T12:35:12.665218+0000","last_peered":"2023-10-14T12:35:12.665218+0000","last_clean":"2023-10-14T12:35:12.665218+0000","last_became_active":"2023-10-14T12:34:44.762396+0000","last_became_peered":"2023-10-14T12:34:44.762396+0000","last_unstale":"2023-10-14T12:35:12.665218+0000","last_undegraded":"2023-10-14T12:35:12.665218+0000","last_fullsized":"2023-10-14T12:35:12.665218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:12.665092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:12.665092+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.665092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:44:42.869431+0000","scrub_duration":0.0015451849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:12.618331+0000","last_change":"2023-10-14T12:35:12.618433+0000","last_active":"2023-10-14T12:35:12.618331+0000","last_peered":"2023-10-14T12:35:12.618331+0000","last_clean":"2023-10-14T12:35:12.618331+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:35:12.618331+0000","last_undegraded":"2023-10-14T12:35:12.618331+0000","last_fullsized":"2023-10-14T12:35:12.618331+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2023-10-14T12:35:12.618230+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2023-10-14T12:35:12.618230+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.618230+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:46.897698+0000","scrub_duration":0.0023501519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835680+0000","last_change":"2023-10-14T12:34:44.761814+0000","last_active":"2023-10-14T12:34:45.835680+0000","last_peered":"2023-10-14T12:34:45.835680+0000","last_clean":"2023-10-14T12:34:45.835680+0000","last_became_active":"2023-10-14T12:34:44.761558+0000","last_became_peered":"2023-10-14T12:34:44.761558+0000","last_unstale":"2023-10-14T12:34:45.835680+0000","last_undegraded":"2023-10-14T12:34:45.835680+0000","last_fullsized":"2023-10-14T12:34:45.835680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'2","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:17.909876+0000","last_change":"2023-10-14T12:35:17.909923+0000","last_active":"2023-10-14T12:35:17.909876+0000","last_peered":"2023-10-14T12:35:17.909876+0000","last_clean":"2023-10-14T12:35:17.909876+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:35:17.909876+0000","last_undegraded":"2023-10-14T12:35:17.909876+0000","last_fullsized":"2023-10-14T12:35:17.909876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2023-10-14T12:35:17.909780+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2023-10-14T12:35:17.909780+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.909780+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:20.253027+0000","scrub_duration":0.003061299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764556+0000","last_change":"2023-10-14T12:34:44.766417+0000","last_active":"2023-10-14T12:34:45.764556+0000","last_peered":"2023-10-14T12:34:45.764556+0000","last_clean":"2023-10-14T12:34:45.764556+0000","last_became_active":"2023-10-14T12:34:44.766119+0000","last_became_peered":"2023-10-14T12:34:44.766119+0000","last_unstale":"2023-10-14T12:34:45.764556+0000","last_undegraded":"2023-10-14T12:34:45.764556+0000","last_fullsized":"2023-10-14T12:34:45.764556+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:10.457274+0000","last_change":"2023-10-14T12:35:10.457346+0000","last_active":"2023-10-14T12:35:10.457274+0000","last_peered":"2023-10-14T12:35:10.457274+0000","last_clean":"2023-10-14T12:35:10.457274+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:35:10.457274+0000","last_undegraded":"2023-10-14T12:35:10.457274+0000","last_fullsized":"2023-10-14T12:35:10.457274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:10.457168+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:10.457168+0000","last_clean_scrub_stamp":"2023-10-14T12:35:10.457168+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:03.430833+0000","scrub_duration":0.0019522529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765626+0000","last_change":"2023-10-14T12:34:44.775797+0000","last_active":"2023-10-14T12:34:45.765626+0000","last_peered":"2023-10-14T12:34:45.765626+0000","last_clean":"2023-10-14T12:34:45.765626+0000","last_became_active":"2023-10-14T12:34:44.775417+0000","last_became_peered":"2023-10-14T12:34:44.775417+0000","last_unstale":"2023-10-14T12:34:45.765626+0000","last_undegraded":"2023-10-14T12:34:45.765626+0000","last_fullsized":"2023-10-14T12:34:45.765626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:03.955007+0000","last_change":"2023-10-14T12:35:03.955073+0000","last_active":"2023-10-14T12:35:03.955007+0000","last_peered":"2023-10-14T12:35:03.955007+0000","last_clean":"2023-10-14T12:35:03.955007+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:35:03.955007+0000","last_undegraded":"2023-10-14T12:35:03.955007+0000","last_fullsized":"2023-10-14T12:35:03.955007+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:03.954904+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:03.954904+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.954904+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:08:04.403532+0000","scrub_duration":0.0020523210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836045+0000","last_change":"2023-10-14T12:34:44.770567+0000","last_active":"2023-10-14T12:34:45.836045+0000","last_peered":"2023-10-14T12:34:45.836045+0000","last_clean":"2023-10-14T12:34:45.836045+0000","last_became_active":"2023-10-14T12:34:44.768157+0000","last_became_peered":"2023-10-14T12:34:44.768157+0000","last_unstale":"2023-10-14T12:34:45.836045+0000","last_undegraded":"2023-10-14T12:34:45.836045+0000","last_fullsized":"2023-10-14T12:34:45.836045+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:03.525608+0000","last_change":"2023-10-14T12:35:03.525669+0000","last_active":"2023-10-14T12:35:03.525608+0000","last_peered":"2023-10-14T12:35:03.525608+0000","last_clean":"2023-10-14T12:35:03.525608+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:35:03.525608+0000","last_undegraded":"2023-10-14T12:35:03.525608+0000","last_fullsized":"2023-10-14T12:35:03.525608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:03.525531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:03.525531+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.525531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:03.692561+0000","scrub_duration":0.001920871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765739+0000","last_change":"2023-10-14T12:34:44.768620+0000","last_active":"2023-10-14T12:34:45.765739+0000","last_peered":"2023-10-14T12:34:45.765739+0000","last_clean":"2023-10-14T12:34:45.765739+0000","last_became_active":"2023-10-14T12:34:44.768087+0000","last_became_peered":"2023-10-14T12:34:44.768087+0000","last_unstale":"2023-10-14T12:34:45.765739+0000","last_undegraded":"2023-10-14T12:34:45.765739+0000","last_fullsized":"2023-10-14T12:34:45.765739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:13.929361+0000","last_change":"2023-10-14T12:35:13.929420+0000","last_active":"2023-10-14T12:35:13.929361+0000","last_peered":"2023-10-14T12:35:13.929361+0000","last_clean":"2023-10-14T12:35:13.929361+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:35:13.929361+0000","last_undegraded":"2023-10-14T12:35:13.929361+0000","last_fullsized":"2023-10-14T12:35:13.929361+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:13.929259+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:13.929259+0000","last_clean_scrub_stamp":"2023-10-14T12:35:13.929259+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:16.370492+0000","scrub_duration":0.0017402209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:14.626071+0000","last_change":"2023-10-14T12:35:14.626155+0000","last_active":"2023-10-14T12:35:14.626071+0000","last_peered":"2023-10-14T12:35:14.626071+0000","last_clean":"2023-10-14T12:35:14.626071+0000","last_became_active":"2023-10-14T12:34:44.760736+0000","last_became_peered":"2023-10-14T12:34:44.760736+0000","last_unstale":"2023-10-14T12:35:14.626071+0000","last_undegraded":"2023-10-14T12:35:14.626071+0000","last_fullsized":"2023-10-14T12:35:14.626071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:14.625962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:14.625962+0000","last_clean_scrub_stamp":"2023-10-14T12:35:14.625962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:40.181761+0000","scrub_duration":0.0022190119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:09.900637+0000","last_change":"2023-10-14T12:35:09.900686+0000","last_active":"2023-10-14T12:35:09.900637+0000","last_peered":"2023-10-14T12:35:09.900637+0000","last_clean":"2023-10-14T12:35:09.900637+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:35:09.900637+0000","last_undegraded":"2023-10-14T12:35:09.900637+0000","last_fullsized":"2023-10-14T12:35:09.900637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:09.900545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:09.900545+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.900545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:44:10.260487+0000","scrub_duration":0.0017821200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.764296+0000","last_change":"2023-10-14T12:34:44.764345+0000","last_active":"2023-10-14T12:34:45.764296+0000","last_peered":"2023-10-14T12:34:45.764296+0000","last_clean":"2023-10-14T12:34:45.764296+0000","last_became_active":"2023-10-14T12:34:44.764069+0000","last_became_peered":"2023-10-14T12:34:44.764069+0000","last_unstale":"2023-10-14T12:34:45.764296+0000","last_undegraded":"2023-10-14T12:34:45.764296+0000","last_fullsized":"2023-10-14T12:34:45.764296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765706+0000","last_change":"2023-10-14T12:34:43.747932+0000","last_active":"2023-10-14T12:34:45.765706+0000","last_peered":"2023-10-14T12:34:45.765706+0000","last_clean":"2023-10-14T12:34:45.765706+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:34:45.765706+0000","last_undegraded":"2023-10-14T12:34:45.765706+0000","last_fullsized":"2023-10-14T12:34:45.765706+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:42.714192+0000","last_clean_scrub_stamp":"2023-10-14T12:34:42.714192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835919+0000","last_change":"2023-10-14T12:34:44.768053+0000","last_active":"2023-10-14T12:34:45.835919+0000","last_peered":"2023-10-14T12:34:45.835919+0000","last_clean":"2023-10-14T12:34:45.835919+0000","last_became_active":"2023-10-14T12:34:44.767802+0000","last_became_peered":"2023-10-14T12:34:44.767802+0000","last_unstale":"2023-10-14T12:34:45.835919+0000","last_undegraded":"2023-10-14T12:34:45.835919+0000","last_fullsized":"2023-10-14T12:34:45.835919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:05.914467+0000","last_change":"2023-10-14T12:35:05.914546+0000","last_active":"2023-10-14T12:35:05.914467+0000","last_peered":"2023-10-14T12:35:05.914467+0000","last_clean":"2023-10-14T12:35:05.914467+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:35:05.914467+0000","last_undegraded":"2023-10-14T12:35:05.914467+0000","last_fullsized":"2023-10-14T12:35:05.914467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:05.914344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:05.914344+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.914344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:45.061194+0000","scrub_duration":0.001652747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835178+0000","last_change":"2023-10-14T12:34:44.768491+0000","last_active":"2023-10-14T12:34:45.835178+0000","last_peered":"2023-10-14T12:34:45.835178+0000","last_clean":"2023-10-14T12:34:45.835178+0000","last_became_active":"2023-10-14T12:34:44.768177+0000","last_became_peered":"2023-10-14T12:34:44.768177+0000","last_unstale":"2023-10-14T12:34:45.835178+0000","last_undegraded":"2023-10-14T12:34:45.835178+0000","last_fullsized":"2023-10-14T12:34:45.835178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'3","reported_seq":24,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:15.881704+0000","last_change":"2023-10-14T12:35:15.881787+0000","last_active":"2023-10-14T12:35:15.881704+0000","last_peered":"2023-10-14T12:35:15.881704+0000","last_clean":"2023-10-14T12:35:15.881704+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:35:15.881704+0000","last_undegraded":"2023-10-14T12:35:15.881704+0000","last_fullsized":"2023-10-14T12:35:15.881704+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2023-10-14T12:35:15.881615+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2023-10-14T12:35:15.881615+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.881615+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:52.773478+0000","scrub_duration":0.00320886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765428+0000","last_change":"2023-10-14T12:34:44.761812+0000","last_active":"2023-10-14T12:34:45.765428+0000","last_peered":"2023-10-14T12:34:45.765428+0000","last_clean":"2023-10-14T12:34:45.765428+0000","last_became_active":"2023-10-14T12:34:44.761519+0000","last_became_peered":"2023-10-14T12:34:44.761519+0000","last_unstale":"2023-10-14T12:34:45.765428+0000","last_undegraded":"2023-10-14T12:34:45.765428+0000","last_fullsized":"2023-10-14T12:34:45.765428+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:15.845763+0000","last_change":"2023-10-14T12:35:15.845814+0000","last_active":"2023-10-14T12:35:15.845763+0000","last_peered":"2023-10-14T12:35:15.845763+0000","last_clean":"2023-10-14T12:35:15.845763+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:35:15.845763+0000","last_undegraded":"2023-10-14T12:35:15.845763+0000","last_fullsized":"2023-10-14T12:35:15.845763+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2023-10-14T12:35:15.845658+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2023-10-14T12:35:15.845658+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.845658+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:10:06.760055+0000","scrub_duration":0.0023631170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.836037+0000","last_change":"2023-10-14T12:34:44.776057+0000","last_active":"2023-10-14T12:34:45.836037+0000","last_peered":"2023-10-14T12:34:45.836037+0000","last_clean":"2023-10-14T12:34:45.836037+0000","last_became_active":"2023-10-14T12:34:44.775820+0000","last_became_peered":"2023-10-14T12:34:44.775820+0000","last_unstale":"2023-10-14T12:34:45.836037+0000","last_undegraded":"2023-10-14T12:34:45.836037+0000","last_fullsized":"2023-10-14T12:34:45.836037+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:05.605085+0000","last_change":"2023-10-14T12:35:05.605138+0000","last_active":"2023-10-14T12:35:05.605085+0000","last_peered":"2023-10-14T12:35:05.605085+0000","last_clean":"2023-10-14T12:35:05.605085+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:35:05.605085+0000","last_undegraded":"2023-10-14T12:35:05.605085+0000","last_fullsized":"2023-10-14T12:35:05.605085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:05.604984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:05.604984+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.604984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:38.495119+0000","scrub_duration":0.0016590349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:15.622581+0000","last_change":"2023-10-14T12:35:15.622628+0000","last_active":"2023-10-14T12:35:15.622581+0000","last_peered":"2023-10-14T12:35:15.622581+0000","last_clean":"2023-10-14T12:35:15.622581+0000","last_became_active":"2023-10-14T12:34:44.769173+0000","last_became_peered":"2023-10-14T12:34:44.769173+0000","last_unstale":"2023-10-14T12:35:15.622581+0000","last_undegraded":"2023-10-14T12:35:15.622581+0000","last_fullsized":"2023-10-14T12:35:15.622581+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:15.622472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:15.622472+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.622472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:49.901940+0000","scrub_duration":0.001455278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:03.610466+0000","last_change":"2023-10-14T12:35:03.610518+0000","last_active":"2023-10-14T12:35:03.610466+0000","last_peered":"2023-10-14T12:35:03.610466+0000","last_clean":"2023-10-14T12:35:03.610466+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:35:03.610466+0000","last_undegraded":"2023-10-14T12:35:03.610466+0000","last_fullsized":"2023-10-14T12:35:03.610466+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:03.610375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:03.610375+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.610375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:24.974482+0000","scrub_duration":0.0018719749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.835262+0000","last_change":"2023-10-14T12:34:44.763379+0000","last_active":"2023-10-14T12:34:45.835262+0000","last_peered":"2023-10-14T12:34:45.835262+0000","last_clean":"2023-10-14T12:34:45.835262+0000","last_became_active":"2023-10-14T12:34:44.763069+0000","last_became_peered":"2023-10-14T12:34:44.763069+0000","last_unstale":"2023-10-14T12:34:45.835262+0000","last_undegraded":"2023-10-14T12:34:45.835262+0000","last_fullsized":"2023-10-14T12:34:45.835262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:04.330476+0000","last_change":"2023-10-14T12:35:04.330533+0000","last_active":"2023-10-14T12:35:04.330476+0000","last_peered":"2023-10-14T12:35:04.330476+0000","last_clean":"2023-10-14T12:35:04.330476+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:35:04.330476+0000","last_undegraded":"2023-10-14T12:35:04.330476+0000","last_fullsized":"2023-10-14T12:35:04.330476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:04.330386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:04.330386+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.330386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:14.339845+0000","scrub_duration":0.0017371279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:12.451365+0000","last_change":"2023-10-14T12:35:12.451419+0000","last_active":"2023-10-14T12:35:12.451365+0000","last_peered":"2023-10-14T12:35:12.451365+0000","last_clean":"2023-10-14T12:35:12.451365+0000","last_became_active":"2023-10-14T12:34:44.769543+0000","last_became_peered":"2023-10-14T12:34:44.769543+0000","last_unstale":"2023-10-14T12:35:12.451365+0000","last_undegraded":"2023-10-14T12:35:12.451365+0000","last_fullsized":"2023-10-14T12:35:12.451365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:12.451259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:12.451259+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.451259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:23.328462+0000","scrub_duration":0.0019754809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:04.490888+0000","last_change":"2023-10-14T12:35:04.490936+0000","last_active":"2023-10-14T12:35:04.490888+0000","last_peered":"2023-10-14T12:35:04.490888+0000","last_clean":"2023-10-14T12:35:04.490888+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:35:04.490888+0000","last_undegraded":"2023-10-14T12:35:04.490888+0000","last_fullsized":"2023-10-14T12:35:04.490888+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:04.490807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:04.490807+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.490807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:29.942190+0000","scrub_duration":0.0015209589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765138+0000","last_change":"2023-10-14T12:34:44.764824+0000","last_active":"2023-10-14T12:34:45.765138+0000","last_peered":"2023-10-14T12:34:45.765138+0000","last_clean":"2023-10-14T12:34:45.765138+0000","last_became_active":"2023-10-14T12:34:44.764567+0000","last_became_peered":"2023-10-14T12:34:44.764567+0000","last_unstale":"2023-10-14T12:34:45.765138+0000","last_undegraded":"2023-10-14T12:34:45.765138+0000","last_fullsized":"2023-10-14T12:34:45.765138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:04.589190+0000","last_change":"2023-10-14T12:35:04.589228+0000","last_active":"2023-10-14T12:35:04.589190+0000","last_peered":"2023-10-14T12:35:04.589190+0000","last_clean":"2023-10-14T12:35:04.589190+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:35:04.589190+0000","last_undegraded":"2023-10-14T12:35:04.589190+0000","last_fullsized":"2023-10-14T12:35:04.589190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:04.589107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:04.589107+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.589107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:30.144906+0000","scrub_duration":0.0012057680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:34:45.765919+0000","last_change":"2023-10-14T12:34:44.767412+0000","last_active":"2023-10-14T12:34:45.765919+0000","last_peered":"2023-10-14T12:34:45.765919+0000","last_clean":"2023-10-14T12:34:45.765919+0000","last_became_active":"2023-10-14T12:34:44.766080+0000","last_became_peered":"2023-10-14T12:34:44.766080+0000","last_unstale":"2023-10-14T12:34:45.765919+0000","last_undegraded":"2023-10-14T12:34:45.765919+0000","last_fullsized":"2023-10-14T12:34:45.765919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:16.631114+0000","last_change":"2023-10-14T12:35:16.631166+0000","last_active":"2023-10-14T12:35:16.631114+0000","last_peered":"2023-10-14T12:35:16.631114+0000","last_clean":"2023-10-14T12:35:16.631114+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:35:16.631114+0000","last_undegraded":"2023-10-14T12:35:16.631114+0000","last_fullsized":"2023-10-14T12:35:16.631114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:16.630985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:16.630985+0000","last_clean_scrub_stamp":"2023-10-14T12:35:16.630985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:42.785656+0000","scrub_duration":0.00178429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"38'119","reported_seq":194,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:35:04.512628+0000","last_change":"2023-10-14T12:35:04.512686+0000","last_active":"2023-10-14T12:35:04.512628+0000","last_peered":"2023-10-14T12:35:04.512628+0000","last_clean":"2023-10-14T12:35:04.512628+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:35:04.512628+0000","last_undegraded":"2023-10-14T12:35:04.512628+0000","last_fullsized":"2023-10-14T12:35:04.512628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2023-10-14T12:35:04.512543+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2023-10-14T12:35:04.512543+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.512543+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:08.784381+0000","scrub_duration":0.0047596390000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1048576,"data_stored":781306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.52800000000000002}]},{"osd":1,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.495},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.621}]},{"osd":3,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67000000000000004}]},{"osd":4,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39900000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.46400000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":189838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.63500000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.59599999999999997}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.60799999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.42999999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.498}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.56799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":189346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.439},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.372}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66700000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1036288,"data_stored":779658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":26.047000000000001,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":11.007,"5min":11.007,"15min":11.007},"last":0.35599999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":26.007999999999999,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.379},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.309}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":16.370999999999999,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":16.413,"5min":16.413,"15min":16.413},"last":0.41599999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":16.521999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.66900000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":16.577999999999999,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":16.489000000000001,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":16.456,"5min":16.456,"15min":16.456},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.624}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.550999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.64300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":442368,"data_stored":189326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":8.3949999999999996,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.5},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":16.146000000000001,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.47099999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.3249999999999993,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.438},{"interface":"front","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.173999999999999,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2229999999999999,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":8.5150000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.53700000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":16.047999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":8.452,"5min":8.452,"15min":8.452},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":16.117000000000001,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.006,"5min":1.006,"15min":1.006},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":8.4800000000000004,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.60999999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":16.088000000000001,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.63},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.4649999999999999,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":454656,"data_stored":190902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.372},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.28000000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.45700000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47299999999999998}]},{"osd":6,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.50600000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.48799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":446464,"data_stored":189860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.626}]},{"osd":1,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.68600000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.4580000000000002,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.754}]},{"osd":6,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:34:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.48699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":446464,"data_stored":189368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9,"5min":9,"15min":9},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.9589999999999996,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.54200000000000004}]},{"osd":2,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56999999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.496}]},{"osd":4,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.31}]},{"osd":6,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.39000000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.373},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.44}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:35:24.552 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.552 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.553 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.553 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.554 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.554 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.554 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.555 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.555 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.555 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.556 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.556 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.557 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.557 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.557 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.558 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.558 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.558 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.559 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.559 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.560 INFO:tasks.ceph:pgid 6.26 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.560 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.560 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.561 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.561 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.562 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.562 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.562 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.563 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.563 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.564 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.564 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.564 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.565 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.565 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.566 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.566 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.566 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.567 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.567 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.568 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.568 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.568 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-14T12:34:42.714192+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=42, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.569 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.569 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.570 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.570 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.570 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.571 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.571 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:24.572 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T12:35:37.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:35:37.235 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:35:44.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:35:44.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.704+0000 7f33bcf22700 1 Processor -- start 2023-10-14T12:35:44.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.704+0000 7f33bcf22700 1 -- start start 2023-10-14T12:35:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33bcf22700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b806a820 0x7f33b80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33bcf22700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33b815e7f0 0x7f33b806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:44.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33bcf22700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b80cfeb0 con 0x7f33b80ca7d0 2023-10-14T12:35:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33bcf22700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b80ce410 con 0x7f33b815e7f0 2023-10-14T12:35:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33bcf22700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b815ec70 con 0x7f33b806a820 2023-10-14T12:35:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33b659c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b806a820 0x7f33b80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:44.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33b5d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33b815e7f0 0x7f33b806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:44.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33b5d9b700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33b815e7f0 0x7f33b806ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:37380/0 (socket says 172.21.15.72:37380) 2023-10-14T12:35:44.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33b659c700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b806a820 0x7f33b80cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:44876/0 (socket says 172.21.15.72:44876) 2023-10-14T12:35:44.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.705+0000 7f33b5d9b700 1 -- 172.21.15.72:0/1521139281 learned_addr learned my addr 172.21.15.72:0/1521139281 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.706+0000 7f33b5d9b700 1 -- 172.21.15.72:0/1521139281 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b806a820 msgr2=0x7f33b80cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:35:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.706+0000 7f33b5d9b700 1 --2- 172.21.15.72:0/1521139281 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b806a820 0x7f33b80cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:44.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.706+0000 7f33b5d9b700 1 -- 172.21.15.72:0/1521139281 >> v1:172.21.15.123:6789/0 conn(0x7f33b80ca7d0 legacy=0x7f33b8071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.706+0000 7f33b5d9b700 1 -- 172.21.15.72:0/1521139281 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80af9d0 con 0x7f33b815e7f0 2023-10-14T12:35:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.706+0000 7f33b659c700 1 --2- 172.21.15.72:0/1521139281 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b806a820 0x7f33b80cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:35:44.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.706+0000 7f33b5d9b700 1 --2- 172.21.15.72:0/1521139281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b815e7f0 0x7f33b806ac00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0098f0 tx=0x7f33ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d04c965167128e36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:44.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.707+0000 7f33b559a700 1 -- 172.21.15.72:0/1521139281 <== mon.1 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac011830 con 0x7f33b815e7f0 2023-10-14T12:35:44.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.707+0000 7f33b559a700 1 -- 172.21.15.72:0/1521139281 <== mon.1 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac011990 con 0x7f33b815e7f0 2023-10-14T12:35:44.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.707+0000 7f33b559a700 1 -- 172.21.15.72:0/1521139281 <== mon.1 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac011d20 con 0x7f33b815e7f0 2023-10-14T12:35:44.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.708+0000 7f33bcf22700 1 -- 172.21.15.72:0/1521139281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b815e7f0 msgr2=0x7f33b806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:44.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.708+0000 7f33bcf22700 1 --2- 172.21.15.72:0/1521139281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b815e7f0 0x7f33b806ac00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0098f0 tx=0x7f33ac009c00 comp rx=0 tx=0).stop 2023-10-14T12:35:44.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.708+0000 7f33bcf22700 1 -- 172.21.15.72:0/1521139281 shutdown_connections 2023-10-14T12:35:44.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.708+0000 7f33bcf22700 1 --2- 172.21.15.72:0/1521139281 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b806a820 0x7f33b80cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:44.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.708+0000 7f33bcf22700 1 --2- 172.21.15.72:0/1521139281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b815e7f0 0x7f33b806ac00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:44.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.708+0000 7f33bcf22700 1 -- 172.21.15.72:0/1521139281 >> 172.21.15.72:0/1521139281 conn(0x7f33b80d0180 msgr2=0x7f33b80d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:44.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.708+0000 7f33bcf22700 1 -- 172.21.15.72:0/1521139281 shutdown_connections 2023-10-14T12:35:44.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.708+0000 7f33bcf22700 1 -- 172.21.15.72:0/1521139281 wait complete. 2023-10-14T12:35:44.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33bcf22700 1 Processor -- start 2023-10-14T12:35:44.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33bcf22700 1 -- start start 2023-10-14T12:35:44.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33bcf22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806a820 0x7f33b8155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:44.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33bcf22700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33b80ca7d0 0x7f33b8157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:44.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33bcf22700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b815e7f0 0x7f33b815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:44.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33bcf22700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b815d3e0 con 0x7f33b80ca7d0 2023-10-14T12:35:44.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33bcf22700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b81580c0 con 0x7f33b806a820 2023-10-14T12:35:44.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33bcf22700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8155eb0 con 0x7f33b815e7f0 2023-10-14T12:35:44.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33b5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33b80ca7d0 0x7f33b8157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:44.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33b5d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33b80ca7d0 0x7f33b8157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49232/0 (socket says 172.21.15.72:49232) 2023-10-14T12:35:44.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.710+0000 7f33b5d9b700 1 -- 172.21.15.72:0/3748431803 learned_addr learned my addr 172.21.15.72:0/3748431803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:35:44.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33b659c700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806a820 0x7f33b8155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:44.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33b6d9d700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b815e7f0 0x7f33b815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:44.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33b5d9b700 1 -- 172.21.15.72:0/3748431803 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b815e7f0 msgr2=0x7f33b815ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:44.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33b5d9b700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b815e7f0 0x7f33b815ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:44.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33b5d9b700 1 -- 172.21.15.72:0/3748431803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806a820 msgr2=0x7f33b8155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:44.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33b5d9b700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806a820 0x7f33b8155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:44.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33b5d9b700 1 -- 172.21.15.72:0/3748431803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a80094a0 con 0x7f33b80ca7d0 2023-10-14T12:35:44.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33b5d9b700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33b80ca7d0 0x7f33b8157b80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f33ac014040 tx=0x7f33ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:44.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33a6ffd700 1 -- 172.21.15.72:0/3748431803 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac004590 con 0x7f33b80ca7d0 2023-10-14T12:35:44.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33a6ffd700 1 -- 172.21.15.72:0/3748431803 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac01e070 con 0x7f33b80ca7d0 2023-10-14T12:35:44.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac009550 con 0x7f33b80ca7d0 2023-10-14T12:35:44.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33a6ffd700 1 -- 172.21.15.72:0/3748431803 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0038e0 con 0x7f33b80ca7d0 2023-10-14T12:35:44.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.711+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b8156470 con 0x7f33b80ca7d0 2023-10-14T12:35:44.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.712+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b815b100 con 0x7f33b80ca7d0 2023-10-14T12:35:44.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.712+0000 7f33a6ffd700 1 -- 172.21.15.72:0/3748431803 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f33ac003a40 con 0x7f33b80ca7d0 2023-10-14T12:35:44.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.713+0000 7f33a6ffd700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f339806af00 0x7f339806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:35:44.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.713+0000 7f33a6ffd700 1 -- 172.21.15.72:0/3748431803 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f33ac08a630 con 0x7f33b80ca7d0 2023-10-14T12:35:44.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.713+0000 7f33b659c700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f339806af00 0x7f339806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:35:44.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.713+0000 7f33b659c700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f339806af00 0x7f339806d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009d70 tx=0x7f33a8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:35:44.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.717+0000 7f33a6ffd700 1 -- 172.21.15.72:0/3748431803 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f33b815b100 con 0x7f33b80ca7d0 2023-10-14T12:35:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.903+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33b80af410 con 0x7f339806af00 2023-10-14T12:35:44.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.911+0000 7f33a6ffd700 1 -- 172.21.15.72:0/3748431803 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290433 (secure 0 0 0) 0x7f33a80099c0 con 0x7f339806af00 2023-10-14T12:35:44.916 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:35:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f339806af00 msgr2=0x7f339806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f339806af00 0x7f339806d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009d70 tx=0x7f33a8009210 comp rx=0 tx=0).stop 2023-10-14T12:35:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33b80ca7d0 msgr2=0x7f33b8157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:35:44.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33b80ca7d0 0x7f33b8157b80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f33ac014040 tx=0x7f33ac004750 comp rx=0 tx=0).stop 2023-10-14T12:35:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 shutdown_connections 2023-10-14T12:35:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f339806af00 0x7f339806d3c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:44.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f33b815e7f0 0x7f33b815ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806a820 0x7f33b8155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 --2- 172.21.15.72:0/3748431803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33b80ca7d0 0x7f33b8157b80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:35:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 >> 172.21.15.72:0/3748431803 conn(0x7f33b80d0180 msgr2=0x7f33b80cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:35:44.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 shutdown_connections 2023-10-14T12:35:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:35:44.914+0000 7f33bcf22700 1 -- 172.21.15.72:0/3748431803 wait complete. 2023-10-14T12:35:44.923 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:35:44.927 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-10-14T12:35:43.414282+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220968,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753752,"statfs":{"total":773094113280,"available":772867842048,"internally_reserved":0,"allocated":4956160,"data_stored":2800580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003417"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:32.625382+0000","last_change":"2023-10-14T12:35:32.625430+0000","last_active":"2023-10-14T12:35:32.625382+0000","last_peered":"2023-10-14T12:35:32.625382+0000","last_clean":"2023-10-14T12:35:32.625382+0000","last_became_active":"2023-10-14T12:34:44.772874+0000","last_became_peered":"2023-10-14T12:34:44.772874+0000","last_unstale":"2023-10-14T12:35:32.625382+0000","last_undegraded":"2023-10-14T12:35:32.625382+0000","last_fullsized":"2023-10-14T12:35:32.625382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:32.625279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:32.625279+0000","last_clean_scrub_stamp":"2023-10-14T12:35:32.625279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:48.179779+0000","scrub_duration":0.001572445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:23.666074+0000","last_change":"2023-10-14T12:35:23.666120+0000","last_active":"2023-10-14T12:35:23.666074+0000","last_peered":"2023-10-14T12:35:23.666074+0000","last_clean":"2023-10-14T12:35:23.666074+0000","last_became_active":"2023-10-14T12:34:44.765783+0000","last_became_peered":"2023-10-14T12:34:44.765783+0000","last_unstale":"2023-10-14T12:35:23.666074+0000","last_undegraded":"2023-10-14T12:35:23.666074+0000","last_fullsized":"2023-10-14T12:35:23.666074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:23.665980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:23.665980+0000","last_clean_scrub_stamp":"2023-10-14T12:35:23.665980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:11:01.370382+0000","scrub_duration":0.0015131949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:26.615084+0000","last_change":"2023-10-14T12:35:26.615140+0000","last_active":"2023-10-14T12:35:26.615084+0000","last_peered":"2023-10-14T12:35:26.615084+0000","last_clean":"2023-10-14T12:35:26.615084+0000","last_became_active":"2023-10-14T12:34:44.765915+0000","last_became_peered":"2023-10-14T12:34:44.765915+0000","last_unstale":"2023-10-14T12:35:26.615084+0000","last_undegraded":"2023-10-14T12:35:26.615084+0000","last_fullsized":"2023-10-14T12:35:26.615084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:26.614992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:26.614992+0000","last_clean_scrub_stamp":"2023-10-14T12:35:26.614992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:21.170019+0000","scrub_duration":0.0020486910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742751+0000","last_change":"2023-10-14T12:35:18.776321+0000","last_active":"2023-10-14T12:35:20.742751+0000","last_peered":"2023-10-14T12:35:20.742751+0000","last_clean":"2023-10-14T12:35:20.742751+0000","last_became_active":"2023-10-14T12:34:44.776527+0000","last_became_peered":"2023-10-14T12:34:44.776527+0000","last_unstale":"2023-10-14T12:35:20.742751+0000","last_undegraded":"2023-10-14T12:35:20.742751+0000","last_fullsized":"2023-10-14T12:35:20.742751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:18.776173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:18.776173+0000","last_clean_scrub_stamp":"2023-10-14T12:35:18.776173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:28.785632+0000","scrub_duration":0.0018641529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742658+0000","last_change":"2023-10-14T12:35:17.819900+0000","last_active":"2023-10-14T12:35:20.742658+0000","last_peered":"2023-10-14T12:35:20.742658+0000","last_clean":"2023-10-14T12:35:20.742658+0000","last_became_active":"2023-10-14T12:34:44.774508+0000","last_became_peered":"2023-10-14T12:34:44.774508+0000","last_unstale":"2023-10-14T12:35:20.742658+0000","last_undegraded":"2023-10-14T12:35:20.742658+0000","last_fullsized":"2023-10-14T12:35:20.742658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:17.819723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:17.819723+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.819723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:42:17.377314+0000","scrub_duration":0.0021875810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:29.535926+0000","last_change":"2023-10-14T12:35:29.535973+0000","last_active":"2023-10-14T12:35:29.535926+0000","last_peered":"2023-10-14T12:35:29.535926+0000","last_clean":"2023-10-14T12:35:29.535926+0000","last_became_active":"2023-10-14T12:34:44.768717+0000","last_became_peered":"2023-10-14T12:34:44.768717+0000","last_unstale":"2023-10-14T12:35:29.535926+0000","last_undegraded":"2023-10-14T12:35:29.535926+0000","last_fullsized":"2023-10-14T12:35:29.535926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:29.535826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:29.535826+0000","last_clean_scrub_stamp":"2023-10-14T12:35:29.535826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:06.427690+0000","scrub_duration":0.0016056810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:27.900709+0000","last_change":"2023-10-14T12:35:27.900755+0000","last_active":"2023-10-14T12:35:27.900709+0000","last_peered":"2023-10-14T12:35:27.900709+0000","last_clean":"2023-10-14T12:35:27.900709+0000","last_became_active":"2023-10-14T12:34:44.770869+0000","last_became_peered":"2023-10-14T12:34:44.770869+0000","last_unstale":"2023-10-14T12:35:27.900709+0000","last_undegraded":"2023-10-14T12:35:27.900709+0000","last_fullsized":"2023-10-14T12:35:27.900709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:27.900564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:27.900564+0000","last_clean_scrub_stamp":"2023-10-14T12:35:27.900564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:12:09.979854+0000","scrub_duration":0.0019821109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741881+0000","last_change":"2023-10-14T12:35:13.657294+0000","last_active":"2023-10-14T12:35:20.741881+0000","last_peered":"2023-10-14T12:35:20.741881+0000","last_clean":"2023-10-14T12:35:20.741881+0000","last_became_active":"2023-10-14T12:34:44.765917+0000","last_became_peered":"2023-10-14T12:34:44.765917+0000","last_unstale":"2023-10-14T12:35:20.741881+0000","last_undegraded":"2023-10-14T12:35:20.741881+0000","last_fullsized":"2023-10-14T12:35:20.741881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:13.657150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:13.657150+0000","last_clean_scrub_stamp":"2023-10-14T12:35:13.657150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:14.297961+0000","scrub_duration":0.001938305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:22.580558+0000","last_change":"2023-10-14T12:35:22.580606+0000","last_active":"2023-10-14T12:35:22.580558+0000","last_peered":"2023-10-14T12:35:22.580558+0000","last_clean":"2023-10-14T12:35:22.580558+0000","last_became_active":"2023-10-14T12:34:44.768514+0000","last_became_peered":"2023-10-14T12:34:44.768514+0000","last_unstale":"2023-10-14T12:35:22.580558+0000","last_undegraded":"2023-10-14T12:35:22.580558+0000","last_fullsized":"2023-10-14T12:35:22.580558+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:22.580473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:22.580473+0000","last_clean_scrub_stamp":"2023-10-14T12:35:22.580473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:23.221285+0000","scrub_duration":0.001963612,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:37.969925+0000","last_change":"2023-10-14T12:35:37.969974+0000","last_active":"2023-10-14T12:35:37.969925+0000","last_peered":"2023-10-14T12:35:37.969925+0000","last_clean":"2023-10-14T12:35:37.969925+0000","last_became_active":"2023-10-14T12:34:44.764252+0000","last_became_peered":"2023-10-14T12:34:44.764252+0000","last_unstale":"2023-10-14T12:35:37.969925+0000","last_undegraded":"2023-10-14T12:35:37.969925+0000","last_fullsized":"2023-10-14T12:35:37.969925+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:37.969821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:37.969821+0000","last_clean_scrub_stamp":"2023-10-14T12:35:37.969821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:20.406726+0000","scrub_duration":0.001440572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:24.838849+0000","last_change":"2023-10-14T12:35:24.838900+0000","last_active":"2023-10-14T12:35:24.838849+0000","last_peered":"2023-10-14T12:35:24.838849+0000","last_clean":"2023-10-14T12:35:24.838849+0000","last_became_active":"2023-10-14T12:34:44.775897+0000","last_became_peered":"2023-10-14T12:34:44.775897+0000","last_unstale":"2023-10-14T12:35:24.838849+0000","last_undegraded":"2023-10-14T12:35:24.838849+0000","last_fullsized":"2023-10-14T12:35:24.838849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:24.838749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:24.838749+0000","last_clean_scrub_stamp":"2023-10-14T12:35:24.838749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:11:02.543151+0000","scrub_duration":0.001472798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:24.616344+0000","last_change":"2023-10-14T12:35:24.616399+0000","last_active":"2023-10-14T12:35:24.616344+0000","last_peered":"2023-10-14T12:35:24.616344+0000","last_clean":"2023-10-14T12:35:24.616344+0000","last_became_active":"2023-10-14T12:34:44.766208+0000","last_became_peered":"2023-10-14T12:34:44.766208+0000","last_unstale":"2023-10-14T12:35:24.616344+0000","last_undegraded":"2023-10-14T12:35:24.616344+0000","last_fullsized":"2023-10-14T12:35:24.616344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:24.616240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:24.616240+0000","last_clean_scrub_stamp":"2023-10-14T12:35:24.616240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:23.537727+0000","scrub_duration":0.001233849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:23.875226+0000","last_change":"2023-10-14T12:35:23.875269+0000","last_active":"2023-10-14T12:35:23.875226+0000","last_peered":"2023-10-14T12:35:23.875226+0000","last_clean":"2023-10-14T12:35:23.875226+0000","last_became_active":"2023-10-14T12:34:44.766602+0000","last_became_peered":"2023-10-14T12:34:44.766602+0000","last_unstale":"2023-10-14T12:35:23.875226+0000","last_undegraded":"2023-10-14T12:35:23.875226+0000","last_fullsized":"2023-10-14T12:35:23.875226+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:23.875133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:23.875133+0000","last_clean_scrub_stamp":"2023-10-14T12:35:23.875133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:25.936245+0000","scrub_duration":0.001468518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:30.324442+0000","last_change":"2023-10-14T12:35:30.324500+0000","last_active":"2023-10-14T12:35:30.324442+0000","last_peered":"2023-10-14T12:35:30.324442+0000","last_clean":"2023-10-14T12:35:30.324442+0000","last_became_active":"2023-10-14T12:34:44.770368+0000","last_became_peered":"2023-10-14T12:34:44.770368+0000","last_unstale":"2023-10-14T12:35:30.324442+0000","last_undegraded":"2023-10-14T12:35:30.324442+0000","last_fullsized":"2023-10-14T12:35:30.324442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:30.324330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:30.324330+0000","last_clean_scrub_stamp":"2023-10-14T12:35:30.324330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:56.036613+0000","scrub_duration":0.0015868729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741433+0000","last_change":"2023-10-14T12:35:19.890598+0000","last_active":"2023-10-14T12:35:20.741433+0000","last_peered":"2023-10-14T12:35:20.741433+0000","last_clean":"2023-10-14T12:35:20.741433+0000","last_became_active":"2023-10-14T12:34:44.763083+0000","last_became_peered":"2023-10-14T12:34:44.763083+0000","last_unstale":"2023-10-14T12:35:20.741433+0000","last_undegraded":"2023-10-14T12:35:20.741433+0000","last_fullsized":"2023-10-14T12:35:20.741433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.890423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.890423+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.890423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:49:09.301968+0000","scrub_duration":0.001908168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.612110+0000","last_change":"2023-10-14T12:34:44.768707+0000","last_active":"2023-10-14T12:35:20.612110+0000","last_peered":"2023-10-14T12:35:20.612110+0000","last_clean":"2023-10-14T12:35:20.612110+0000","last_became_active":"2023-10-14T12:34:44.768474+0000","last_became_peered":"2023-10-14T12:34:44.768474+0000","last_unstale":"2023-10-14T12:35:20.612110+0000","last_undegraded":"2023-10-14T12:35:20.612110+0000","last_fullsized":"2023-10-14T12:35:20.612110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.612719+0000","last_change":"2023-10-14T12:34:44.771432+0000","last_active":"2023-10-14T12:35:20.612719+0000","last_peered":"2023-10-14T12:35:20.612719+0000","last_clean":"2023-10-14T12:35:20.612719+0000","last_became_active":"2023-10-14T12:34:44.771158+0000","last_became_peered":"2023-10-14T12:34:44.771158+0000","last_unstale":"2023-10-14T12:35:20.612719+0000","last_undegraded":"2023-10-14T12:35:20.612719+0000","last_fullsized":"2023-10-14T12:35:20.612719+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:24.430638+0000","last_change":"2023-10-14T12:35:24.430683+0000","last_active":"2023-10-14T12:35:24.430638+0000","last_peered":"2023-10-14T12:35:24.430638+0000","last_clean":"2023-10-14T12:35:24.430638+0000","last_became_active":"2023-10-14T12:34:44.776263+0000","last_became_peered":"2023-10-14T12:34:44.776263+0000","last_unstale":"2023-10-14T12:35:24.430638+0000","last_undegraded":"2023-10-14T12:35:24.430638+0000","last_fullsized":"2023-10-14T12:35:24.430638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:24.430551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:24.430551+0000","last_clean_scrub_stamp":"2023-10-14T12:35:24.430551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:58.710020+0000","scrub_duration":0.0013352640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.664023+0000","last_change":"2023-10-14T12:35:21.664133+0000","last_active":"2023-10-14T12:35:21.664023+0000","last_peered":"2023-10-14T12:35:21.664023+0000","last_clean":"2023-10-14T12:35:21.664023+0000","last_became_active":"2023-10-14T12:34:44.767035+0000","last_became_peered":"2023-10-14T12:34:44.767035+0000","last_unstale":"2023-10-14T12:35:21.664023+0000","last_undegraded":"2023-10-14T12:35:21.664023+0000","last_fullsized":"2023-10-14T12:35:21.664023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:21.663935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:21.663935+0000","last_clean_scrub_stamp":"2023-10-14T12:35:21.663935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:21.830965+0000","scrub_duration":0.0024545140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610393+0000","last_change":"2023-10-14T12:35:12.349752+0000","last_active":"2023-10-14T12:35:20.610393+0000","last_peered":"2023-10-14T12:35:20.610393+0000","last_clean":"2023-10-14T12:35:20.610393+0000","last_became_active":"2023-10-14T12:34:44.775453+0000","last_became_peered":"2023-10-14T12:34:44.775453+0000","last_unstale":"2023-10-14T12:35:20.610393+0000","last_undegraded":"2023-10-14T12:35:20.610393+0000","last_fullsized":"2023-10-14T12:35:20.610393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:12.349586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:12.349586+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.349586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:45.239721+0000","scrub_duration":0.001482625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:37.007311+0000","last_change":"2023-10-14T12:35:37.007368+0000","last_active":"2023-10-14T12:35:37.007311+0000","last_peered":"2023-10-14T12:35:37.007311+0000","last_clean":"2023-10-14T12:35:37.007311+0000","last_became_active":"2023-10-14T12:34:44.766299+0000","last_became_peered":"2023-10-14T12:34:44.766299+0000","last_unstale":"2023-10-14T12:35:37.007311+0000","last_undegraded":"2023-10-14T12:35:37.007311+0000","last_fullsized":"2023-10-14T12:35:37.007311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:37.007185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:37.007185+0000","last_clean_scrub_stamp":"2023-10-14T12:35:37.007185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:20:08.980630+0000","scrub_duration":0.0021011910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:25.396982+0000","last_change":"2023-10-14T12:35:25.397027+0000","last_active":"2023-10-14T12:35:25.396982+0000","last_peered":"2023-10-14T12:35:25.396982+0000","last_clean":"2023-10-14T12:35:25.396982+0000","last_became_active":"2023-10-14T12:34:44.770033+0000","last_became_peered":"2023-10-14T12:34:44.770033+0000","last_unstale":"2023-10-14T12:35:25.396982+0000","last_undegraded":"2023-10-14T12:35:25.396982+0000","last_fullsized":"2023-10-14T12:35:25.396982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:25.396896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:25.396896+0000","last_clean_scrub_stamp":"2023-10-14T12:35:25.396896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:59.676365+0000","scrub_duration":0.002034592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:36.418692+0000","last_change":"2023-10-14T12:35:36.418740+0000","last_active":"2023-10-14T12:35:36.418692+0000","last_peered":"2023-10-14T12:35:36.418692+0000","last_clean":"2023-10-14T12:35:36.418692+0000","last_became_active":"2023-10-14T12:34:44.767967+0000","last_became_peered":"2023-10-14T12:34:44.767967+0000","last_unstale":"2023-10-14T12:35:36.418692+0000","last_undegraded":"2023-10-14T12:35:36.418692+0000","last_fullsized":"2023-10-14T12:35:36.418692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:36.418603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:36.418603+0000","last_clean_scrub_stamp":"2023-10-14T12:35:36.418603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:44.266004+0000","scrub_duration":0.0016692530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:27.765876+0000","last_change":"2023-10-14T12:35:27.765925+0000","last_active":"2023-10-14T12:35:27.765876+0000","last_peered":"2023-10-14T12:35:27.765876+0000","last_clean":"2023-10-14T12:35:27.765876+0000","last_became_active":"2023-10-14T12:34:44.768304+0000","last_became_peered":"2023-10-14T12:34:44.768304+0000","last_unstale":"2023-10-14T12:35:27.765876+0000","last_undegraded":"2023-10-14T12:35:27.765876+0000","last_fullsized":"2023-10-14T12:35:27.765876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:27.765785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:27.765785+0000","last_clean_scrub_stamp":"2023-10-14T12:35:27.765785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:09.541344+0000","scrub_duration":0.0020278729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610636+0000","last_change":"2023-10-14T12:35:15.404467+0000","last_active":"2023-10-14T12:35:20.610636+0000","last_peered":"2023-10-14T12:35:20.610636+0000","last_clean":"2023-10-14T12:35:20.610636+0000","last_became_active":"2023-10-14T12:34:44.764072+0000","last_became_peered":"2023-10-14T12:34:44.764072+0000","last_unstale":"2023-10-14T12:35:20.610636+0000","last_undegraded":"2023-10-14T12:35:20.610636+0000","last_fullsized":"2023-10-14T12:35:20.610636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:15.404312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:15.404312+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.404312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:26.281514+0000","scrub_duration":0.00201366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:22.537183+0000","last_change":"2023-10-14T12:35:22.537231+0000","last_active":"2023-10-14T12:35:22.537183+0000","last_peered":"2023-10-14T12:35:22.537183+0000","last_clean":"2023-10-14T12:35:22.537183+0000","last_became_active":"2023-10-14T12:34:44.767743+0000","last_became_peered":"2023-10-14T12:34:44.767743+0000","last_unstale":"2023-10-14T12:35:22.537183+0000","last_undegraded":"2023-10-14T12:35:22.537183+0000","last_fullsized":"2023-10-14T12:35:22.537183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:22.537079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:22.537079+0000","last_clean_scrub_stamp":"2023-10-14T12:35:22.537079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:05.359431+0000","scrub_duration":0.0016911929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610609+0000","last_change":"2023-10-14T12:35:19.441376+0000","last_active":"2023-10-14T12:35:20.610609+0000","last_peered":"2023-10-14T12:35:20.610609+0000","last_clean":"2023-10-14T12:35:20.610609+0000","last_became_active":"2023-10-14T12:34:44.766309+0000","last_became_peered":"2023-10-14T12:34:44.766309+0000","last_unstale":"2023-10-14T12:35:20.610609+0000","last_undegraded":"2023-10-14T12:35:20.610609+0000","last_fullsized":"2023-10-14T12:35:20.610609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.441218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.441218+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.441218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:44.997017+0000","scrub_duration":0.0015683240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:30.954708+0000","last_change":"2023-10-14T12:35:30.954758+0000","last_active":"2023-10-14T12:35:30.954708+0000","last_peered":"2023-10-14T12:35:30.954708+0000","last_clean":"2023-10-14T12:35:30.954708+0000","last_became_active":"2023-10-14T12:34:44.765904+0000","last_became_peered":"2023-10-14T12:34:44.765904+0000","last_unstale":"2023-10-14T12:35:30.954708+0000","last_undegraded":"2023-10-14T12:35:30.954708+0000","last_fullsized":"2023-10-14T12:35:30.954708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:30.954606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:30.954606+0000","last_clean_scrub_stamp":"2023-10-14T12:35:30.954606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:51:47.461557+0000","scrub_duration":0.001699255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610386+0000","last_change":"2023-10-14T12:35:17.455157+0000","last_active":"2023-10-14T12:35:20.610386+0000","last_peered":"2023-10-14T12:35:20.610386+0000","last_clean":"2023-10-14T12:35:20.610386+0000","last_became_active":"2023-10-14T12:34:44.764719+0000","last_became_peered":"2023-10-14T12:34:44.764719+0000","last_unstale":"2023-10-14T12:35:20.610386+0000","last_undegraded":"2023-10-14T12:35:20.610386+0000","last_fullsized":"2023-10-14T12:35:20.610386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:17.454997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:17.454997+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.454997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:57.377417+0000","scrub_duration":0.0023420310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610465+0000","last_change":"2023-10-14T12:35:10.332872+0000","last_active":"2023-10-14T12:35:20.610465+0000","last_peered":"2023-10-14T12:35:20.610465+0000","last_clean":"2023-10-14T12:35:20.610465+0000","last_became_active":"2023-10-14T12:34:44.768729+0000","last_became_peered":"2023-10-14T12:34:44.768729+0000","last_unstale":"2023-10-14T12:35:20.610465+0000","last_undegraded":"2023-10-14T12:35:20.610465+0000","last_fullsized":"2023-10-14T12:35:20.610465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:10.332731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:10.332731+0000","last_clean_scrub_stamp":"2023-10-14T12:35:10.332731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.102844+0000","scrub_duration":0.0013980189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:38.487190+0000","last_change":"2023-10-14T12:35:38.487243+0000","last_active":"2023-10-14T12:35:38.487190+0000","last_peered":"2023-10-14T12:35:38.487190+0000","last_clean":"2023-10-14T12:35:38.487190+0000","last_became_active":"2023-10-14T12:34:44.768243+0000","last_became_peered":"2023-10-14T12:34:44.768243+0000","last_unstale":"2023-10-14T12:35:38.487190+0000","last_undegraded":"2023-10-14T12:35:38.487190+0000","last_fullsized":"2023-10-14T12:35:38.487190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:38.487076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:38.487076+0000","last_clean_scrub_stamp":"2023-10-14T12:35:38.487076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:12:20.566365+0000","scrub_duration":0.0019929119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742746+0000","last_change":"2023-10-14T12:35:14.491561+0000","last_active":"2023-10-14T12:35:20.742746+0000","last_peered":"2023-10-14T12:35:20.742746+0000","last_clean":"2023-10-14T12:35:20.742746+0000","last_became_active":"2023-10-14T12:34:44.768423+0000","last_became_peered":"2023-10-14T12:34:44.768423+0000","last_unstale":"2023-10-14T12:35:20.742746+0000","last_undegraded":"2023-10-14T12:35:20.742746+0000","last_fullsized":"2023-10-14T12:35:20.742746+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:14.491409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:14.491409+0000","last_clean_scrub_stamp":"2023-10-14T12:35:14.491409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:23.466129+0000","scrub_duration":0.001502986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.612603+0000","last_change":"2023-10-14T12:34:44.771115+0000","last_active":"2023-10-14T12:35:20.612603+0000","last_peered":"2023-10-14T12:35:20.612603+0000","last_clean":"2023-10-14T12:35:20.612603+0000","last_became_active":"2023-10-14T12:34:44.770846+0000","last_became_peered":"2023-10-14T12:34:44.770846+0000","last_unstale":"2023-10-14T12:35:20.612603+0000","last_undegraded":"2023-10-14T12:35:20.612603+0000","last_fullsized":"2023-10-14T12:35:20.612603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610725+0000","last_change":"2023-10-14T12:35:09.344283+0000","last_active":"2023-10-14T12:35:20.610725+0000","last_peered":"2023-10-14T12:35:20.610725+0000","last_clean":"2023-10-14T12:35:20.610725+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:35:20.610725+0000","last_undegraded":"2023-10-14T12:35:20.610725+0000","last_fullsized":"2023-10-14T12:35:20.610725+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2023-10-14T12:35:09.344122+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2023-10-14T12:35:09.344122+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.344122+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:30.708229+0000","scrub_duration":0.0021377689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743531+0000","last_change":"2023-10-14T12:35:16.489564+0000","last_active":"2023-10-14T12:35:20.743531+0000","last_peered":"2023-10-14T12:35:20.743531+0000","last_clean":"2023-10-14T12:35:20.743531+0000","last_became_active":"2023-10-14T12:34:44.772093+0000","last_became_peered":"2023-10-14T12:34:44.772093+0000","last_unstale":"2023-10-14T12:35:20.743531+0000","last_undegraded":"2023-10-14T12:35:20.743531+0000","last_fullsized":"2023-10-14T12:35:20.743531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:16.489425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:16.489425+0000","last_clean_scrub_stamp":"2023-10-14T12:35:16.489425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:20.761264+0000","scrub_duration":0.001862371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743876+0000","last_change":"2023-10-14T12:35:04.627114+0000","last_active":"2023-10-14T12:35:20.743876+0000","last_peered":"2023-10-14T12:35:20.743876+0000","last_clean":"2023-10-14T12:35:20.743876+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:35:20.743876+0000","last_undegraded":"2023-10-14T12:35:20.743876+0000","last_fullsized":"2023-10-14T12:35:20.743876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:04.626942+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:04.626942+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.626942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:18.397054+0000","scrub_duration":0.0018766779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:36.329163+0000","last_change":"2023-10-14T12:35:36.329209+0000","last_active":"2023-10-14T12:35:36.329163+0000","last_peered":"2023-10-14T12:35:36.329163+0000","last_clean":"2023-10-14T12:35:36.329163+0000","last_became_active":"2023-10-14T12:34:44.775648+0000","last_became_peered":"2023-10-14T12:34:44.775648+0000","last_unstale":"2023-10-14T12:35:36.329163+0000","last_undegraded":"2023-10-14T12:35:36.329163+0000","last_fullsized":"2023-10-14T12:35:36.329163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:36.329056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:36.329056+0000","last_clean_scrub_stamp":"2023-10-14T12:35:36.329056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:35.250543+0000","scrub_duration":0.0014791240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743365+0000","last_change":"2023-10-14T12:35:08.488859+0000","last_active":"2023-10-14T12:35:20.743365+0000","last_peered":"2023-10-14T12:35:20.743365+0000","last_clean":"2023-10-14T12:35:20.743365+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:35:20.743365+0000","last_undegraded":"2023-10-14T12:35:20.743365+0000","last_fullsized":"2023-10-14T12:35:20.743365+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:08.488716+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:08.488716+0000","last_clean_scrub_stamp":"2023-10-14T12:35:08.488716+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:37.867958+0000","scrub_duration":0.0023671130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:29.630287+0000","last_change":"2023-10-14T12:35:29.630332+0000","last_active":"2023-10-14T12:35:29.630287+0000","last_peered":"2023-10-14T12:35:29.630287+0000","last_clean":"2023-10-14T12:35:29.630287+0000","last_became_active":"2023-10-14T12:34:44.765043+0000","last_became_peered":"2023-10-14T12:34:44.765043+0000","last_unstale":"2023-10-14T12:35:29.630287+0000","last_undegraded":"2023-10-14T12:35:29.630287+0000","last_fullsized":"2023-10-14T12:35:29.630287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:29.630199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:29.630199+0000","last_clean_scrub_stamp":"2023-10-14T12:35:29.630199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:27:55.471813+0000","scrub_duration":0.0020247260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.611597+0000","last_change":"2023-10-14T12:35:05.442139+0000","last_active":"2023-10-14T12:35:20.611597+0000","last_peered":"2023-10-14T12:35:20.611597+0000","last_clean":"2023-10-14T12:35:20.611597+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:35:20.611597+0000","last_undegraded":"2023-10-14T12:35:20.611597+0000","last_fullsized":"2023-10-14T12:35:20.611597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:05.442005+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:05.442005+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.442005+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:05.609035+0000","scrub_duration":0.0022538969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741861+0000","last_change":"2023-10-14T12:35:07.594986+0000","last_active":"2023-10-14T12:35:20.741861+0000","last_peered":"2023-10-14T12:35:20.741861+0000","last_clean":"2023-10-14T12:35:20.741861+0000","last_became_active":"2023-10-14T12:34:44.763356+0000","last_became_peered":"2023-10-14T12:34:44.763356+0000","last_unstale":"2023-10-14T12:35:20.741861+0000","last_undegraded":"2023-10-14T12:35:20.741861+0000","last_fullsized":"2023-10-14T12:35:20.741861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:07.594832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:07.594832+0000","last_clean_scrub_stamp":"2023-10-14T12:35:07.594832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:54.639365+0000","scrub_duration":0.001521924,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741704+0000","last_change":"2023-10-14T12:35:14.831305+0000","last_active":"2023-10-14T12:35:20.741704+0000","last_peered":"2023-10-14T12:35:20.741704+0000","last_clean":"2023-10-14T12:35:20.741704+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:35:20.741704+0000","last_undegraded":"2023-10-14T12:35:20.741704+0000","last_fullsized":"2023-10-14T12:35:20.741704+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:14.831136+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:14.831136+0000","last_clean_scrub_stamp":"2023-10-14T12:35:14.831136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:40.543419+0000","scrub_duration":0.0021581809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.907370+0000","last_change":"2023-10-14T12:35:21.907419+0000","last_active":"2023-10-14T12:35:21.907370+0000","last_peered":"2023-10-14T12:35:21.907370+0000","last_clean":"2023-10-14T12:35:21.907370+0000","last_became_active":"2023-10-14T12:34:44.766961+0000","last_became_peered":"2023-10-14T12:34:44.766961+0000","last_unstale":"2023-10-14T12:35:21.907370+0000","last_undegraded":"2023-10-14T12:35:21.907370+0000","last_fullsized":"2023-10-14T12:35:21.907370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:21.907266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:21.907266+0000","last_clean_scrub_stamp":"2023-10-14T12:35:21.907266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:42.192840+0000","scrub_duration":0.0018686900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":24,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:25.578614+0000","last_change":"2023-10-14T12:35:25.578664+0000","last_active":"2023-10-14T12:35:25.578614+0000","last_peered":"2023-10-14T12:35:25.578614+0000","last_clean":"2023-10-14T12:35:25.578614+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:35:25.578614+0000","last_undegraded":"2023-10-14T12:35:25.578614+0000","last_fullsized":"2023-10-14T12:35:25.578614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:25.578511+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:25.578511+0000","last_clean_scrub_stamp":"2023-10-14T12:35:25.578511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:26.219323+0000","scrub_duration":0.0017173760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:24.396492+0000","last_change":"2023-10-14T12:35:24.396544+0000","last_active":"2023-10-14T12:35:24.396492+0000","last_peered":"2023-10-14T12:35:24.396492+0000","last_clean":"2023-10-14T12:35:24.396492+0000","last_became_active":"2023-10-14T12:34:44.770030+0000","last_became_peered":"2023-10-14T12:34:44.770030+0000","last_unstale":"2023-10-14T12:35:24.396492+0000","last_undegraded":"2023-10-14T12:35:24.396492+0000","last_fullsized":"2023-10-14T12:35:24.396492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:24.396391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:24.396391+0000","last_clean_scrub_stamp":"2023-10-14T12:35:24.396391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:49.952190+0000","scrub_duration":0.00140879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743700+0000","last_change":"2023-10-14T12:35:13.472623+0000","last_active":"2023-10-14T12:35:20.743700+0000","last_peered":"2023-10-14T12:35:20.743700+0000","last_clean":"2023-10-14T12:35:20.743700+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:35:20.743700+0000","last_undegraded":"2023-10-14T12:35:20.743700+0000","last_fullsized":"2023-10-14T12:35:20.743700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:13.472474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:13.472474+0000","last_clean_scrub_stamp":"2023-10-14T12:35:13.472474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:43.300344+0000","scrub_duration":0.0017954729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.679900+0000","last_change":"2023-10-14T12:35:21.679948+0000","last_active":"2023-10-14T12:35:21.679900+0000","last_peered":"2023-10-14T12:35:21.679900+0000","last_clean":"2023-10-14T12:35:21.679900+0000","last_became_active":"2023-10-14T12:34:44.761308+0000","last_became_peered":"2023-10-14T12:34:44.761308+0000","last_unstale":"2023-10-14T12:35:21.679900+0000","last_undegraded":"2023-10-14T12:35:21.679900+0000","last_fullsized":"2023-10-14T12:35:21.679900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:21.679814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:21.679814+0000","last_clean_scrub_stamp":"2023-10-14T12:35:21.679814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:16:58.875674+0000","scrub_duration":0.0021800249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610684+0000","last_change":"2023-10-14T12:35:06.455925+0000","last_active":"2023-10-14T12:35:20.610684+0000","last_peered":"2023-10-14T12:35:20.610684+0000","last_clean":"2023-10-14T12:35:20.610684+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:35:20.610684+0000","last_undegraded":"2023-10-14T12:35:20.610684+0000","last_fullsized":"2023-10-14T12:35:20.610684+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:06.455787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:06.455787+0000","last_clean_scrub_stamp":"2023-10-14T12:35:06.455787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:54.240104+0000","scrub_duration":0.0017672090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:37.801766+0000","last_change":"2023-10-14T12:35:37.801832+0000","last_active":"2023-10-14T12:35:37.801766+0000","last_peered":"2023-10-14T12:35:37.801766+0000","last_clean":"2023-10-14T12:35:37.801766+0000","last_became_active":"2023-10-14T12:34:44.776592+0000","last_became_peered":"2023-10-14T12:34:44.776592+0000","last_unstale":"2023-10-14T12:35:37.801766+0000","last_undegraded":"2023-10-14T12:35:37.801766+0000","last_fullsized":"2023-10-14T12:35:37.801766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:37.801620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:37.801620+0000","last_clean_scrub_stamp":"2023-10-14T12:35:37.801620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:48.678823+0000","scrub_duration":0.0022632490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743132+0000","last_change":"2023-10-14T12:35:09.634042+0000","last_active":"2023-10-14T12:35:20.743132+0000","last_peered":"2023-10-14T12:35:20.743132+0000","last_clean":"2023-10-14T12:35:20.743132+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:35:20.743132+0000","last_undegraded":"2023-10-14T12:35:20.743132+0000","last_fullsized":"2023-10-14T12:35:20.743132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:09.633882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:09.633882+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.633882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:37.630913+0000","scrub_duration":0.0016000669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:33.523606+0000","last_change":"2023-10-14T12:35:33.523678+0000","last_active":"2023-10-14T12:35:33.523606+0000","last_peered":"2023-10-14T12:35:33.523606+0000","last_clean":"2023-10-14T12:35:33.523606+0000","last_became_active":"2023-10-14T12:34:44.763408+0000","last_became_peered":"2023-10-14T12:34:44.763408+0000","last_unstale":"2023-10-14T12:35:33.523606+0000","last_undegraded":"2023-10-14T12:35:33.523606+0000","last_fullsized":"2023-10-14T12:35:33.523606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:33.523500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:33.523500+0000","last_clean_scrub_stamp":"2023-10-14T12:35:33.523500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:43.609495+0000","scrub_duration":0.0016054210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742027+0000","last_change":"2023-10-14T12:35:06.805234+0000","last_active":"2023-10-14T12:35:20.742027+0000","last_peered":"2023-10-14T12:35:20.742027+0000","last_clean":"2023-10-14T12:35:20.742027+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:35:20.742027+0000","last_undegraded":"2023-10-14T12:35:20.742027+0000","last_fullsized":"2023-10-14T12:35:20.742027+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:06.805056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:06.805056+0000","last_clean_scrub_stamp":"2023-10-14T12:35:06.805056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:32.360854+0000","scrub_duration":0.001935003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743834+0000","last_change":"2023-10-14T12:35:17.654663+0000","last_active":"2023-10-14T12:35:20.743834+0000","last_peered":"2023-10-14T12:35:20.743834+0000","last_clean":"2023-10-14T12:35:20.743834+0000","last_became_active":"2023-10-14T12:34:44.764455+0000","last_became_peered":"2023-10-14T12:34:44.764455+0000","last_unstale":"2023-10-14T12:35:20.743834+0000","last_undegraded":"2023-10-14T12:35:20.743834+0000","last_fullsized":"2023-10-14T12:35:20.743834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:17.654436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:17.654436+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.654436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:43.809107+0000","scrub_duration":0.0021283600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741953+0000","last_change":"2023-10-14T12:35:09.745066+0000","last_active":"2023-10-14T12:35:20.741953+0000","last_peered":"2023-10-14T12:35:20.741953+0000","last_clean":"2023-10-14T12:35:20.741953+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:35:20.741953+0000","last_undegraded":"2023-10-14T12:35:20.741953+0000","last_fullsized":"2023-10-14T12:35:20.741953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2023-10-14T12:35:09.744908+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2023-10-14T12:35:09.744908+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.744908+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:44.024377+0000","scrub_duration":0.0024157639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:38.313312+0000","last_change":"2023-10-14T12:35:38.313414+0000","last_active":"2023-10-14T12:35:38.313312+0000","last_peered":"2023-10-14T12:35:38.313312+0000","last_clean":"2023-10-14T12:35:38.313312+0000","last_became_active":"2023-10-14T12:34:44.774253+0000","last_became_peered":"2023-10-14T12:34:44.774253+0000","last_unstale":"2023-10-14T12:35:38.313312+0000","last_undegraded":"2023-10-14T12:35:38.313312+0000","last_fullsized":"2023-10-14T12:35:38.313312+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:38.313190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:38.313190+0000","last_clean_scrub_stamp":"2023-10-14T12:35:38.313190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:58.598764+0000","scrub_duration":0.0021105640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742077+0000","last_change":"2023-10-14T12:35:03.578668+0000","last_active":"2023-10-14T12:35:20.742077+0000","last_peered":"2023-10-14T12:35:20.742077+0000","last_clean":"2023-10-14T12:35:20.742077+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:35:20.742077+0000","last_undegraded":"2023-10-14T12:35:20.742077+0000","last_fullsized":"2023-10-14T12:35:20.742077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2023-10-14T12:35:03.578503+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2023-10-14T12:35:03.578503+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.578503+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:07.850341+0000","scrub_duration":0.003262222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.625419+0000","last_change":"2023-10-14T12:35:21.625419+0000","last_active":"2023-10-14T12:35:21.625419+0000","last_peered":"2023-10-14T12:35:21.625419+0000","last_clean":"2023-10-14T12:35:21.625419+0000","last_became_active":"2023-10-14T12:35:21.625031+0000","last_became_peered":"2023-10-14T12:35:21.625031+0000","last_unstale":"2023-10-14T12:35:21.625419+0000","last_undegraded":"2023-10-14T12:35:21.625419+0000","last_fullsized":"2023-10-14T12:35:21.625419+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.643481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.643481+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.643481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:44:49.847820+0000","scrub_duration":0.0018957640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742308+0000","last_change":"2023-10-14T12:35:10.618248+0000","last_active":"2023-10-14T12:35:20.742308+0000","last_peered":"2023-10-14T12:35:20.742308+0000","last_clean":"2023-10-14T12:35:20.742308+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:35:20.742308+0000","last_undegraded":"2023-10-14T12:35:20.742308+0000","last_fullsized":"2023-10-14T12:35:20.742308+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:10.618045+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:10.618045+0000","last_clean_scrub_stamp":"2023-10-14T12:35:10.618045+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:35.811911+0000","scrub_duration":0.0024294249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:28.590299+0000","last_change":"2023-10-14T12:35:28.590344+0000","last_active":"2023-10-14T12:35:28.590299+0000","last_peered":"2023-10-14T12:35:28.590299+0000","last_clean":"2023-10-14T12:35:28.590299+0000","last_became_active":"2023-10-14T12:34:44.772662+0000","last_became_peered":"2023-10-14T12:34:44.772662+0000","last_unstale":"2023-10-14T12:35:28.590299+0000","last_undegraded":"2023-10-14T12:35:28.590299+0000","last_fullsized":"2023-10-14T12:35:28.590299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:28.590211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:28.590211+0000","last_clean_scrub_stamp":"2023-10-14T12:35:28.590211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:50.591901+0000","scrub_duration":0.001468511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743537+0000","last_change":"2023-10-14T12:35:07.455189+0000","last_active":"2023-10-14T12:35:20.743537+0000","last_peered":"2023-10-14T12:35:20.743537+0000","last_clean":"2023-10-14T12:35:20.743537+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:35:20.743537+0000","last_undegraded":"2023-10-14T12:35:20.743537+0000","last_fullsized":"2023-10-14T12:35:20.743537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:07.455036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:07.455036+0000","last_clean_scrub_stamp":"2023-10-14T12:35:07.455036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:49.230595+0000","scrub_duration":0.0021334510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.612288+0000","last_change":"2023-10-14T12:34:44.761488+0000","last_active":"2023-10-14T12:35:20.612288+0000","last_peered":"2023-10-14T12:35:20.612288+0000","last_clean":"2023-10-14T12:35:20.612288+0000","last_became_active":"2023-10-14T12:34:44.761153+0000","last_became_peered":"2023-10-14T12:34:44.761153+0000","last_unstale":"2023-10-14T12:35:20.612288+0000","last_undegraded":"2023-10-14T12:35:20.612288+0000","last_fullsized":"2023-10-14T12:35:20.612288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610955+0000","last_change":"2023-10-14T12:35:05.297709+0000","last_active":"2023-10-14T12:35:20.610955+0000","last_peered":"2023-10-14T12:35:20.610955+0000","last_clean":"2023-10-14T12:35:20.610955+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:35:20.610955+0000","last_undegraded":"2023-10-14T12:35:20.610955+0000","last_fullsized":"2023-10-14T12:35:20.610955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:05.297555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:05.297555+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.297555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:30.748938+0000","scrub_duration":0.0015276039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741983+0000","last_change":"2023-10-14T12:35:12.665284+0000","last_active":"2023-10-14T12:35:20.741983+0000","last_peered":"2023-10-14T12:35:20.741983+0000","last_clean":"2023-10-14T12:35:20.741983+0000","last_became_active":"2023-10-14T12:34:44.762396+0000","last_became_peered":"2023-10-14T12:34:44.762396+0000","last_unstale":"2023-10-14T12:35:20.741983+0000","last_undegraded":"2023-10-14T12:35:20.741983+0000","last_fullsized":"2023-10-14T12:35:20.741983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:12.665092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:12.665092+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.665092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:44:42.869431+0000","scrub_duration":0.0015451849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.612208+0000","last_change":"2023-10-14T12:35:12.618433+0000","last_active":"2023-10-14T12:35:20.612208+0000","last_peered":"2023-10-14T12:35:20.612208+0000","last_clean":"2023-10-14T12:35:20.612208+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:35:20.612208+0000","last_undegraded":"2023-10-14T12:35:20.612208+0000","last_fullsized":"2023-10-14T12:35:20.612208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2023-10-14T12:35:12.618230+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2023-10-14T12:35:12.618230+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.618230+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:46.897698+0000","scrub_duration":0.0023501519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:26.617902+0000","last_change":"2023-10-14T12:35:26.617994+0000","last_active":"2023-10-14T12:35:26.617902+0000","last_peered":"2023-10-14T12:35:26.617902+0000","last_clean":"2023-10-14T12:35:26.617902+0000","last_became_active":"2023-10-14T12:34:44.761558+0000","last_became_peered":"2023-10-14T12:34:44.761558+0000","last_unstale":"2023-10-14T12:35:26.617902+0000","last_undegraded":"2023-10-14T12:35:26.617902+0000","last_fullsized":"2023-10-14T12:35:26.617902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:26.617780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:26.617780+0000","last_clean_scrub_stamp":"2023-10-14T12:35:26.617780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:34.150032+0000","scrub_duration":0.001642599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742151+0000","last_change":"2023-10-14T12:35:17.909923+0000","last_active":"2023-10-14T12:35:20.742151+0000","last_peered":"2023-10-14T12:35:20.742151+0000","last_clean":"2023-10-14T12:35:20.742151+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:35:20.742151+0000","last_undegraded":"2023-10-14T12:35:20.742151+0000","last_fullsized":"2023-10-14T12:35:20.742151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2023-10-14T12:35:17.909780+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2023-10-14T12:35:17.909780+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.909780+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:20.253027+0000","scrub_duration":0.003061299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:31.957870+0000","last_change":"2023-10-14T12:35:31.957919+0000","last_active":"2023-10-14T12:35:31.957870+0000","last_peered":"2023-10-14T12:35:31.957870+0000","last_clean":"2023-10-14T12:35:31.957870+0000","last_became_active":"2023-10-14T12:34:44.766119+0000","last_became_peered":"2023-10-14T12:34:44.766119+0000","last_unstale":"2023-10-14T12:35:31.957870+0000","last_undegraded":"2023-10-14T12:35:31.957870+0000","last_fullsized":"2023-10-14T12:35:31.957870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:31.957771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:31.957771+0000","last_clean_scrub_stamp":"2023-10-14T12:35:31.957771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:11:54.954193+0000","scrub_duration":0.0019928910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.611117+0000","last_change":"2023-10-14T12:35:10.457346+0000","last_active":"2023-10-14T12:35:20.611117+0000","last_peered":"2023-10-14T12:35:20.611117+0000","last_clean":"2023-10-14T12:35:20.611117+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:35:20.611117+0000","last_undegraded":"2023-10-14T12:35:20.611117+0000","last_fullsized":"2023-10-14T12:35:20.611117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:10.457168+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:10.457168+0000","last_clean_scrub_stamp":"2023-10-14T12:35:10.457168+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:03.430833+0000","scrub_duration":0.0019522529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:35.297975+0000","last_change":"2023-10-14T12:35:35.298023+0000","last_active":"2023-10-14T12:35:35.297975+0000","last_peered":"2023-10-14T12:35:35.297975+0000","last_clean":"2023-10-14T12:35:35.297975+0000","last_became_active":"2023-10-14T12:34:44.775417+0000","last_became_peered":"2023-10-14T12:34:44.775417+0000","last_unstale":"2023-10-14T12:35:35.297975+0000","last_undegraded":"2023-10-14T12:35:35.297975+0000","last_fullsized":"2023-10-14T12:35:35.297975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:35.297826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:35.297826+0000","last_clean_scrub_stamp":"2023-10-14T12:35:35.297826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:24.542361+0000","scrub_duration":0.0021972239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743056+0000","last_change":"2023-10-14T12:35:03.955073+0000","last_active":"2023-10-14T12:35:20.743056+0000","last_peered":"2023-10-14T12:35:20.743056+0000","last_clean":"2023-10-14T12:35:20.743056+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:35:20.743056+0000","last_undegraded":"2023-10-14T12:35:20.743056+0000","last_fullsized":"2023-10-14T12:35:20.743056+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:03.954904+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:03.954904+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.954904+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:08:04.403532+0000","scrub_duration":0.0020523210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743415+0000","last_change":"2023-10-14T12:35:19.739828+0000","last_active":"2023-10-14T12:35:20.743415+0000","last_peered":"2023-10-14T12:35:20.743415+0000","last_clean":"2023-10-14T12:35:20.743415+0000","last_became_active":"2023-10-14T12:34:44.768157+0000","last_became_peered":"2023-10-14T12:34:44.768157+0000","last_unstale":"2023-10-14T12:35:20.743415+0000","last_undegraded":"2023-10-14T12:35:20.743415+0000","last_fullsized":"2023-10-14T12:35:20.743415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.739681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.739681+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.739681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:45.191064+0000","scrub_duration":0.0015638480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743254+0000","last_change":"2023-10-14T12:35:03.525669+0000","last_active":"2023-10-14T12:35:20.743254+0000","last_peered":"2023-10-14T12:35:20.743254+0000","last_clean":"2023-10-14T12:35:20.743254+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:35:20.743254+0000","last_undegraded":"2023-10-14T12:35:20.743254+0000","last_fullsized":"2023-10-14T12:35:20.743254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:03.525531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:03.525531+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.525531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:03.692561+0000","scrub_duration":0.001920871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:31.533841+0000","last_change":"2023-10-14T12:35:31.533890+0000","last_active":"2023-10-14T12:35:31.533841+0000","last_peered":"2023-10-14T12:35:31.533841+0000","last_clean":"2023-10-14T12:35:31.533841+0000","last_became_active":"2023-10-14T12:34:44.768087+0000","last_became_peered":"2023-10-14T12:34:44.768087+0000","last_unstale":"2023-10-14T12:35:31.533841+0000","last_undegraded":"2023-10-14T12:35:31.533841+0000","last_fullsized":"2023-10-14T12:35:31.533841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:31.533743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:31.533743+0000","last_clean_scrub_stamp":"2023-10-14T12:35:31.533743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:08.729604+0000","scrub_duration":0.001859596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742766+0000","last_change":"2023-10-14T12:35:13.929420+0000","last_active":"2023-10-14T12:35:20.742766+0000","last_peered":"2023-10-14T12:35:20.742766+0000","last_clean":"2023-10-14T12:35:20.742766+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:35:20.742766+0000","last_undegraded":"2023-10-14T12:35:20.742766+0000","last_fullsized":"2023-10-14T12:35:20.742766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:13.929259+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:13.929259+0000","last_clean_scrub_stamp":"2023-10-14T12:35:13.929259+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:16.370492+0000","scrub_duration":0.0017402209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743418+0000","last_change":"2023-10-14T12:35:14.626155+0000","last_active":"2023-10-14T12:35:20.743418+0000","last_peered":"2023-10-14T12:35:20.743418+0000","last_clean":"2023-10-14T12:35:20.743418+0000","last_became_active":"2023-10-14T12:34:44.760736+0000","last_became_peered":"2023-10-14T12:34:44.760736+0000","last_unstale":"2023-10-14T12:35:20.743418+0000","last_undegraded":"2023-10-14T12:35:20.743418+0000","last_fullsized":"2023-10-14T12:35:20.743418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:14.625962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:14.625962+0000","last_clean_scrub_stamp":"2023-10-14T12:35:14.625962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:40.181761+0000","scrub_duration":0.0022190119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741962+0000","last_change":"2023-10-14T12:35:09.900686+0000","last_active":"2023-10-14T12:35:20.741962+0000","last_peered":"2023-10-14T12:35:20.741962+0000","last_clean":"2023-10-14T12:35:20.741962+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:35:20.741962+0000","last_undegraded":"2023-10-14T12:35:20.741962+0000","last_fullsized":"2023-10-14T12:35:20.741962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:09.900545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:09.900545+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.900545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:44:10.260487+0000","scrub_duration":0.0017821200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:33.006081+0000","last_change":"2023-10-14T12:35:33.006130+0000","last_active":"2023-10-14T12:35:33.006081+0000","last_peered":"2023-10-14T12:35:33.006081+0000","last_clean":"2023-10-14T12:35:33.006081+0000","last_became_active":"2023-10-14T12:34:44.764069+0000","last_became_peered":"2023-10-14T12:34:44.764069+0000","last_unstale":"2023-10-14T12:35:33.006081+0000","last_undegraded":"2023-10-14T12:35:33.006081+0000","last_fullsized":"2023-10-14T12:35:33.006081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:33.005986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:33.005986+0000","last_clean_scrub_stamp":"2023-10-14T12:35:33.005986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:53:38.824740+0000","scrub_duration":0.001434992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:27.519272+0000","last_change":"2023-10-14T12:35:27.519314+0000","last_active":"2023-10-14T12:35:27.519272+0000","last_peered":"2023-10-14T12:35:27.519272+0000","last_clean":"2023-10-14T12:35:27.519272+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:35:27.519272+0000","last_undegraded":"2023-10-14T12:35:27.519272+0000","last_fullsized":"2023-10-14T12:35:27.519272+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:27.519175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:27.519175+0000","last_clean_scrub_stamp":"2023-10-14T12:35:27.519175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:26.440662+0000","scrub_duration":0.0014840750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742108+0000","last_change":"2023-10-14T12:35:19.675606+0000","last_active":"2023-10-14T12:35:20.742108+0000","last_peered":"2023-10-14T12:35:20.742108+0000","last_clean":"2023-10-14T12:35:20.742108+0000","last_became_active":"2023-10-14T12:34:44.767802+0000","last_became_peered":"2023-10-14T12:34:44.767802+0000","last_unstale":"2023-10-14T12:35:20.742108+0000","last_undegraded":"2023-10-14T12:35:20.742108+0000","last_fullsized":"2023-10-14T12:35:20.742108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.675479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.675479+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.675479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:49:09.087024+0000","scrub_duration":0.001720671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742406+0000","last_change":"2023-10-14T12:35:05.914546+0000","last_active":"2023-10-14T12:35:20.742406+0000","last_peered":"2023-10-14T12:35:20.742406+0000","last_clean":"2023-10-14T12:35:20.742406+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:35:20.742406+0000","last_undegraded":"2023-10-14T12:35:20.742406+0000","last_fullsized":"2023-10-14T12:35:20.742406+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:05.914344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:05.914344+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.914344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:45.061194+0000","scrub_duration":0.001652747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:23.539005+0000","last_change":"2023-10-14T12:35:23.539056+0000","last_active":"2023-10-14T12:35:23.539005+0000","last_peered":"2023-10-14T12:35:23.539005+0000","last_clean":"2023-10-14T12:35:23.539005+0000","last_became_active":"2023-10-14T12:34:44.768177+0000","last_became_peered":"2023-10-14T12:34:44.768177+0000","last_unstale":"2023-10-14T12:35:23.539005+0000","last_undegraded":"2023-10-14T12:35:23.539005+0000","last_fullsized":"2023-10-14T12:35:23.539005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:23.538899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:23.538899+0000","last_clean_scrub_stamp":"2023-10-14T12:35:23.538899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:49.693570+0000","scrub_duration":0.001906324,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'3","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742179+0000","last_change":"2023-10-14T12:35:15.881787+0000","last_active":"2023-10-14T12:35:20.742179+0000","last_peered":"2023-10-14T12:35:20.742179+0000","last_clean":"2023-10-14T12:35:20.742179+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:35:20.742179+0000","last_undegraded":"2023-10-14T12:35:20.742179+0000","last_fullsized":"2023-10-14T12:35:20.742179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2023-10-14T12:35:15.881615+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2023-10-14T12:35:15.881615+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.881615+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:52.773478+0000","scrub_duration":0.00320886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.612660+0000","last_change":"2023-10-14T12:34:44.761812+0000","last_active":"2023-10-14T12:35:20.612660+0000","last_peered":"2023-10-14T12:35:20.612660+0000","last_clean":"2023-10-14T12:35:20.612660+0000","last_became_active":"2023-10-14T12:34:44.761519+0000","last_became_peered":"2023-10-14T12:34:44.761519+0000","last_unstale":"2023-10-14T12:35:20.612660+0000","last_undegraded":"2023-10-14T12:35:20.612660+0000","last_fullsized":"2023-10-14T12:35:20.612660+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743256+0000","last_change":"2023-10-14T12:35:15.845814+0000","last_active":"2023-10-14T12:35:20.743256+0000","last_peered":"2023-10-14T12:35:20.743256+0000","last_clean":"2023-10-14T12:35:20.743256+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:35:20.743256+0000","last_undegraded":"2023-10-14T12:35:20.743256+0000","last_fullsized":"2023-10-14T12:35:20.743256+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2023-10-14T12:35:15.845658+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2023-10-14T12:35:15.845658+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.845658+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:10:06.760055+0000","scrub_duration":0.0023631170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:22.633234+0000","last_change":"2023-10-14T12:35:22.633308+0000","last_active":"2023-10-14T12:35:22.633234+0000","last_peered":"2023-10-14T12:35:22.633234+0000","last_clean":"2023-10-14T12:35:22.633234+0000","last_became_active":"2023-10-14T12:34:44.775820+0000","last_became_peered":"2023-10-14T12:34:44.775820+0000","last_unstale":"2023-10-14T12:35:22.633234+0000","last_undegraded":"2023-10-14T12:35:22.633234+0000","last_fullsized":"2023-10-14T12:35:22.633234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:22.633132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:22.633132+0000","last_clean_scrub_stamp":"2023-10-14T12:35:22.633132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:24.694245+0000","scrub_duration":0.001910274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743905+0000","last_change":"2023-10-14T12:35:05.605138+0000","last_active":"2023-10-14T12:35:20.743905+0000","last_peered":"2023-10-14T12:35:20.743905+0000","last_clean":"2023-10-14T12:35:20.743905+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:35:20.743905+0000","last_undegraded":"2023-10-14T12:35:20.743905+0000","last_fullsized":"2023-10-14T12:35:20.743905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:05.604984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:05.604984+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.604984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:38.495119+0000","scrub_duration":0.0016590349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741774+0000","last_change":"2023-10-14T12:35:15.622628+0000","last_active":"2023-10-14T12:35:20.741774+0000","last_peered":"2023-10-14T12:35:20.741774+0000","last_clean":"2023-10-14T12:35:20.741774+0000","last_became_active":"2023-10-14T12:34:44.769173+0000","last_became_peered":"2023-10-14T12:34:44.769173+0000","last_unstale":"2023-10-14T12:35:20.741774+0000","last_undegraded":"2023-10-14T12:35:20.741774+0000","last_fullsized":"2023-10-14T12:35:20.741774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:15.622472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:15.622472+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.622472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:49.901940+0000","scrub_duration":0.001455278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743693+0000","last_change":"2023-10-14T12:35:03.610518+0000","last_active":"2023-10-14T12:35:20.743693+0000","last_peered":"2023-10-14T12:35:20.743693+0000","last_clean":"2023-10-14T12:35:20.743693+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:35:20.743693+0000","last_undegraded":"2023-10-14T12:35:20.743693+0000","last_fullsized":"2023-10-14T12:35:20.743693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:03.610375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:03.610375+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.610375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:24.974482+0000","scrub_duration":0.0018719749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:27.584571+0000","last_change":"2023-10-14T12:35:27.584618+0000","last_active":"2023-10-14T12:35:27.584571+0000","last_peered":"2023-10-14T12:35:27.584571+0000","last_clean":"2023-10-14T12:35:27.584571+0000","last_became_active":"2023-10-14T12:34:44.763069+0000","last_became_peered":"2023-10-14T12:34:44.763069+0000","last_unstale":"2023-10-14T12:35:27.584571+0000","last_undegraded":"2023-10-14T12:35:27.584571+0000","last_fullsized":"2023-10-14T12:35:27.584571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:27.584475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:27.584475+0000","last_clean_scrub_stamp":"2023-10-14T12:35:27.584475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:53.296758+0000","scrub_duration":0.0020698489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.611476+0000","last_change":"2023-10-14T12:35:04.330533+0000","last_active":"2023-10-14T12:35:20.611476+0000","last_peered":"2023-10-14T12:35:20.611476+0000","last_clean":"2023-10-14T12:35:20.611476+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:35:20.611476+0000","last_undegraded":"2023-10-14T12:35:20.611476+0000","last_fullsized":"2023-10-14T12:35:20.611476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:04.330386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:04.330386+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.330386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:14.339845+0000","scrub_duration":0.0017371279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610813+0000","last_change":"2023-10-14T12:35:12.451419+0000","last_active":"2023-10-14T12:35:20.610813+0000","last_peered":"2023-10-14T12:35:20.610813+0000","last_clean":"2023-10-14T12:35:20.610813+0000","last_became_active":"2023-10-14T12:34:44.769543+0000","last_became_peered":"2023-10-14T12:34:44.769543+0000","last_unstale":"2023-10-14T12:35:20.610813+0000","last_undegraded":"2023-10-14T12:35:20.610813+0000","last_fullsized":"2023-10-14T12:35:20.610813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:12.451259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:12.451259+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.451259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:23.328462+0000","scrub_duration":0.0019754809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610478+0000","last_change":"2023-10-14T12:35:04.490936+0000","last_active":"2023-10-14T12:35:20.610478+0000","last_peered":"2023-10-14T12:35:20.610478+0000","last_clean":"2023-10-14T12:35:20.610478+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:35:20.610478+0000","last_undegraded":"2023-10-14T12:35:20.610478+0000","last_fullsized":"2023-10-14T12:35:20.610478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:04.490807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:04.490807+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.490807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:29.942190+0000","scrub_duration":0.0015209589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:29.542752+0000","last_change":"2023-10-14T12:35:29.542800+0000","last_active":"2023-10-14T12:35:29.542752+0000","last_peered":"2023-10-14T12:35:29.542752+0000","last_clean":"2023-10-14T12:35:29.542752+0000","last_became_active":"2023-10-14T12:34:44.764567+0000","last_became_peered":"2023-10-14T12:34:44.764567+0000","last_unstale":"2023-10-14T12:35:29.542752+0000","last_undegraded":"2023-10-14T12:35:29.542752+0000","last_fullsized":"2023-10-14T12:35:29.542752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:29.542636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:29.542636+0000","last_clean_scrub_stamp":"2023-10-14T12:35:29.542636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:24.097663+0000","scrub_duration":0.0015181229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741976+0000","last_change":"2023-10-14T12:35:04.589228+0000","last_active":"2023-10-14T12:35:20.741976+0000","last_peered":"2023-10-14T12:35:20.741976+0000","last_clean":"2023-10-14T12:35:20.741976+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:35:20.741976+0000","last_undegraded":"2023-10-14T12:35:20.741976+0000","last_fullsized":"2023-10-14T12:35:20.741976+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:04.589107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:04.589107+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.589107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:30.144906+0000","scrub_duration":0.0012057680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742023+0000","last_change":"2023-10-14T12:34:44.767412+0000","last_active":"2023-10-14T12:35:20.742023+0000","last_peered":"2023-10-14T12:35:20.742023+0000","last_clean":"2023-10-14T12:35:20.742023+0000","last_became_active":"2023-10-14T12:34:44.766080+0000","last_became_peered":"2023-10-14T12:34:44.766080+0000","last_unstale":"2023-10-14T12:35:20.742023+0000","last_undegraded":"2023-10-14T12:35:20.742023+0000","last_fullsized":"2023-10-14T12:35:20.742023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:34:43.715979+0000","last_clean_scrub_stamp":"2023-10-14T12:34:43.715979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.612663+0000","last_change":"2023-10-14T12:35:16.631166+0000","last_active":"2023-10-14T12:35:20.612663+0000","last_peered":"2023-10-14T12:35:20.612663+0000","last_clean":"2023-10-14T12:35:20.612663+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:35:20.612663+0000","last_undegraded":"2023-10-14T12:35:20.612663+0000","last_fullsized":"2023-10-14T12:35:20.612663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:16.630985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:16.630985+0000","last_clean_scrub_stamp":"2023-10-14T12:35:16.630985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:42.785656+0000","scrub_duration":0.00178429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"38'119","reported_seq":197,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.621714+0000","last_change":"2023-10-14T12:35:04.512686+0000","last_active":"2023-10-14T12:35:21.621714+0000","last_peered":"2023-10-14T12:35:21.621714+0000","last_clean":"2023-10-14T12:35:21.621714+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:35:21.621714+0000","last_undegraded":"2023-10-14T12:35:21.621714+0000","last_fullsized":"2023-10-14T12:35:21.621714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2023-10-14T12:35:04.512543+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2023-10-14T12:35:04.512543+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.512543+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:08.784381+0000","scrub_duration":0.0047596390000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":793928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.499,"15min":0.48799999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.496},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.69099999999999995}]},{"osd":1,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.47799999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72999999999999998,"5min":1.48,"15min":1.48},"last":0.51900000000000002}]},{"osd":3,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":0.74299999999999999,"15min":0.623},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":19.899000000000001,"5min":19.899000000000001,"15min":19.899000000000001},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.626}]},{"osd":5,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72299999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":0.751,"15min":0.751},"last":0.54200000000000004}]},{"osd":6,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.57299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":466944,"data_stored":202460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.72099999999999997}]},{"osd":1,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.47099999999999997},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71299999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.75800000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73099999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.44,"5min":0.374,"15min":0.374},"max":{"1min":0.72999999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.67800000000000005}]},{"osd":3,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.434,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74199999999999999,"5min":1.863,"15min":1.863},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77000000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.747}]},{"osd":4,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.877,"5min":1.079,"15min":1.079},"last":0.496}]},{"osd":5,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71399999999999997,"5min":1.179,"15min":1.179},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.748,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.622},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.71499999999999997,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":466944,"data_stored":201968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33400000000000002,"15min":0.33000000000000002},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.32700000000000001},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.317,"15min":0.31},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.41599999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.27200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.443}]},{"osd":4,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.442,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.874,"15min":0.874},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85299999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.59799999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68500000000000005}]},{"osd":6,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.46300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91100000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.626},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89600000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1060864,"data_stored":792280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":1.403,"15min":1.581},"min":{"1min":0.23100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.496,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.79300000000000004,"15min":0.86399999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.53500000000000003,"5min":11.007,"15min":11.007},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":1.4259999999999999,"15min":1.603},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.45700000000000002,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.371,"15min":0.36699999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":1.0349999999999999,"15min":1.143},"min":{"1min":0.28599999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54500000000000004,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.436,"5min":1.079,"15min":1.1859999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.56000000000000005,"5min":16.413,"15min":16.413},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79100000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":1.2629999999999999,"15min":1.375},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.72399999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.76600000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":1.246,"15min":1.357},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.755,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":1.2509999999999999,"15min":1.359},"min":{"1min":0.46999999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.752,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.69399999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":1.2629999999999999,"15min":1.375},"min":{"1min":0.42899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73999999999999999,"5min":16.456,"15min":16.456},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.625,"15min":0.63},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77600000000000002,"5min":1.018,"15min":1.018},"last":0.78600000000000003}]},{"osd":7,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.76000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":1.256,"15min":1.3680000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72499999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.67500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":466944,"data_stored":201948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.70299999999999996,"15min":0.75700000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.67300000000000004,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.38},{"interface":"front","average":{"1min":0.39500000000000002,"5min":1.0549999999999999,"15min":1.165},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57999999999999996,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.27500000000000002}]},{"osd":1,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.71099999999999997,"15min":0.76300000000000001},"min":{"1min":0.28799999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55600000000000005,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.39700000000000002,"5min":1.0820000000000001,"15min":1.196},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53200000000000003,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.34699999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.56799999999999995,"15min":0.59599999999999997},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52400000000000002,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.76000000000000001,"15min":0.81399999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56200000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.314}]},{"osd":4,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.2350000000000001,"15min":1.343},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72999999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.74099999999999999,"15min":0.76700000000000002},"min":{"1min":0.46400000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.873,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.92700000000000005,"15min":0.97899999999999998},"min":{"1min":0.46700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78500000000000003,"5min":8.452,"15min":8.452},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":1.2769999999999999,"15min":1.391},"min":{"1min":0.46800000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81599999999999995,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.748,"15min":0.77800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73999999999999999,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.93000000000000005,"15min":0.97999999999999998},"min":{"1min":0.49399999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.58899999999999997}]},{"osd":7,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":1.3149999999999999,"15min":1.429},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80400000000000005,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.80200000000000005,"15min":0.82799999999999996},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83099999999999996,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.57599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":203524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.20899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48699999999999999,"5min":0.498,"15min":0.498},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.35099999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.24099999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.66600000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61799999999999999,"5min":1.052,"15min":1.052},"last":0.42399999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":0.62,"15min":0.62},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.433,"15min":0.433},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61199999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.65100000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.623,"15min":0.629},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80600000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.62}]},{"osd":6,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92600000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86099999999999999,"5min":1.298,"15min":1.298},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":1.272,"15min":1.272},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88100000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":471040,"data_stored":202482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.51700000000000002,"15min":0.504},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.498},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.745,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41599999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.751,"15min":0.77500000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78400000000000003,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.40699999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.745,"5min":0.874,"15min":0.874},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.47199999999999998,"15min":0.45600000000000002},"min":{"1min":0.41299999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.376},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80800000000000005,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.54100000000000004}]},{"osd":3,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76300000000000001,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84899999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83899999999999997,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.34000000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88600000000000001,"5min":1.26,"15min":1.26},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46300000000000002}]},{"osd":7,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.73499999999999999,"15min":0.75600000000000001},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89400000000000002,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.55500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":471040,"data_stored":201990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.82099999999999995,"15min":0.875},"min":{"1min":0.31900000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":9,"15min":9},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71799999999999997,"5min":1.054,"15min":1.054},"last":0.74299999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.67000000000000004,"15min":0.69599999999999995},"min":{"1min":0.38600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.63500000000000001,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71299999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.73199999999999998}]},{"osd":2,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.45000000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70999999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.41399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.83499999999999996}]},{"osd":4,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.873,"15min":0.873},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.58699999999999997,"15min":0.59799999999999998},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.63400000000000001,"15min":0.64600000000000002},"min":{"1min":0.373,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79300000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.81799999999999995,"5min":1.159,"15min":1.159},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:35:44.934 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:44.935 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:44.935 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:44.936 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:44.937 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:44.937 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-10-14T12:34:43.715979+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=43, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=34, tm_sec=58, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T12:35:44.938 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T12:36:04.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:36:05.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.072+0000 7f1da64a2700 1 Processor -- start 2023-10-14T12:36:05.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.072+0000 7f1da64a2700 1 -- start start 2023-10-14T12:36:05.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da64a2700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1da00ca7d0 0x7f1da00cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da64a2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da015f000 0x7f1da015f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da64a2700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da00726b0 con 0x7f1da006a820 2023-10-14T12:36:05.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da64a2700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da015ca20 con 0x7f1da00ca7d0 2023-10-14T12:36:05.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da64a2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00718f0 con 0x7f1da015f000 2023-10-14T12:36:05.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da4a3f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da015f000 0x7f1da015f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1d9f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1da00ca7d0 0x7f1da00cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da4a3f700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da015f000 0x7f1da015f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3301/0 says I am v2:172.21.15.72:44894/0 (socket says 172.21.15.72:44894) 2023-10-14T12:36:05.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1d9f7fe700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1da00ca7d0 0x7f1da00cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.72:37392/0 (socket says 172.21.15.72:37392) 2023-10-14T12:36:05.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da4a3f700 1 -- 172.21.15.72:0/1104178908 learned_addr learned my addr 172.21.15.72:0/1104178908 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:36:05.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da4a3f700 1 -- 172.21.15.72:0/1104178908 >> v2:172.21.15.123:3300/0 conn(0x7f1da00ca7d0 msgr2=0x7f1da00cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:36:05.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da4a3f700 1 --2- 172.21.15.72:0/1104178908 >> v2:172.21.15.123:3300/0 conn(0x7f1da00ca7d0 0x7f1da00cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da4a3f700 1 -- 172.21.15.72:0/1104178908 >> v1:172.21.15.123:6789/0 conn(0x7f1da006a820 legacy=0x7f1da006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1da4a3f700 1 -- 172.21.15.72:0/1104178908 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0071bd0 con 0x7f1da015f000 2023-10-14T12:36:05.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.073+0000 7f1d9f7fe700 1 --2- 172.21.15.72:0/1104178908 >> v2:172.21.15.123:3300/0 conn(0x7f1da00ca7d0 0x7f1da00cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:36:05.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1da4a3f700 1 --2- 172.21.15.72:0/1104178908 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da015f000 0x7f1da015f450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009e50 tx=0x7f1d9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62af1ff02422859 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:36:05.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1d9effd700 1 -- 172.21.15.72:0/1104178908 <== mon.2 v2:172.21.15.123:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800e070 con 0x7f1da015f000 2023-10-14T12:36:05.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1d9effd700 1 -- 172.21.15.72:0/1104178908 <== mon.2 v2:172.21.15.123:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9800b910 con 0x7f1da015f000 2023-10-14T12:36:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1d9effd700 1 -- 172.21.15.72:0/1104178908 <== mon.2 v2:172.21.15.123:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800bcc0 con 0x7f1da015f000 2023-10-14T12:36:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1da64a2700 1 -- 172.21.15.72:0/1104178908 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da015f000 msgr2=0x7f1da015f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1da64a2700 1 --2- 172.21.15.72:0/1104178908 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da015f000 0x7f1da015f450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009e50 tx=0x7f1d9800b330 comp rx=0 tx=0).stop 2023-10-14T12:36:05.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1da64a2700 1 -- 172.21.15.72:0/1104178908 shutdown_connections 2023-10-14T12:36:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1da64a2700 1 --2- 172.21.15.72:0/1104178908 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da015f000 0x7f1da015f450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1da64a2700 1 --2- 172.21.15.72:0/1104178908 >> v2:172.21.15.123:3300/0 conn(0x7f1da00ca7d0 0x7f1da00cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1da64a2700 1 -- 172.21.15.72:0/1104178908 >> 172.21.15.72:0/1104178908 conn(0x7f1da00d0180 msgr2=0x7f1da00d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:36:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.074+0000 7f1da64a2700 1 -- 172.21.15.72:0/1104178908 shutdown_connections 2023-10-14T12:36:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.075+0000 7f1da64a2700 1 -- 172.21.15.72:0/1104178908 wait complete. 2023-10-14T12:36:05.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.076+0000 7f1da64a2700 1 Processor -- start 2023-10-14T12:36:05.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.076+0000 7f1da64a2700 1 -- start start 2023-10-14T12:36:05.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da64a2700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da006a820 0x7f1da00c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da64a2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da00ca7d0 0x7f1da00c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da64a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da015f000 0x7f1da00c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da64a2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da014d0a0 con 0x7f1da015f000 2023-10-14T12:36:05.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da64a2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01f3f80 con 0x7f1da00ca7d0 2023-10-14T12:36:05.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da64a2700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da014d2f0 con 0x7f1da006a820 2023-10-14T12:36:05.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da4a3f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da015f000 0x7f1da00c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da4a3f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da015f000 0x7f1da00c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49248/0 (socket says 172.21.15.72:49248) 2023-10-14T12:36:05.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da4a3f700 1 -- 172.21.15.72:0/2734786045 learned_addr learned my addr 172.21.15.72:0/2734786045 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:36:05.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1d9f7fe700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da00ca7d0 0x7f1da00c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1d9ffff700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da006a820 0x7f1da00c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da4a3f700 1 -- 172.21.15.72:0/2734786045 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da006a820 msgr2=0x7f1da00c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da4a3f700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da006a820 0x7f1da00c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da4a3f700 1 -- 172.21.15.72:0/2734786045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da00ca7d0 msgr2=0x7f1da00c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da4a3f700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da00ca7d0 0x7f1da00c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da4a3f700 1 -- 172.21.15.72:0/2734786045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900094a0 con 0x7f1da015f000 2023-10-14T12:36:05.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da4a3f700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da015f000 0x7f1da00c4d00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800b370 tx=0x7f1d98004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:36:05.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1d9cff9700 1 -- 172.21.15.72:0/2734786045 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98004840 con 0x7f1da015f000 2023-10-14T12:36:05.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1d9cff9700 1 -- 172.21.15.72:0/2734786045 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d980092e0 con 0x7f1da015f000 2023-10-14T12:36:05.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d98009b30 con 0x7f1da015f000 2023-10-14T12:36:05.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1d9cff9700 1 -- 172.21.15.72:0/2734786045 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d980049c0 con 0x7f1da015f000 2023-10-14T12:36:05.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.077+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da014d8b0 con 0x7f1da015f000 2023-10-14T12:36:05.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.078+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da0067d10 con 0x7f1da015f000 2023-10-14T12:36:05.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.079+0000 7f1d9cff9700 1 -- 172.21.15.72:0/2734786045 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d9801b670 con 0x7f1da015f000 2023-10-14T12:36:05.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.079+0000 7f1d9cff9700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d8c06af00 0x7f1d8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.079+0000 7f1d9cff9700 1 -- 172.21.15.72:0/2734786045 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f1d9808ac70 con 0x7f1da015f000 2023-10-14T12:36:05.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.079+0000 7f1d9ffff700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d8c06af00 0x7f1d8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.080+0000 7f1d9ffff700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d8c06af00 0x7f1d8c06d3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1d94007fd0 tx=0x7f1d94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:36:05.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.084+0000 7f1d9cff9700 1 -- 172.21.15.72:0/2734786045 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d98055ba0 con 0x7f1da015f000 2023-10-14T12:36:05.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.269+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 --> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1da0072190 con 0x7f1d8c06af00 2023-10-14T12:36:05.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.277+0000 7f1d9cff9700 1 -- 172.21.15.72:0/2734786045 <== mgr.4104 v2:172.21.15.72:6832/2999014877 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290785 (secure 0 0 0) 0x7f1d94001560 con 0x7f1d8c06af00 2023-10-14T12:36:05.281 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:36:05.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d8c06af00 msgr2=0x7f1d8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d8c06af00 0x7f1d8c06d3c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1d94007fd0 tx=0x7f1d94009040 comp rx=0 tx=0).stop 2023-10-14T12:36:05.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da015f000 msgr2=0x7f1da00c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da015f000 0x7f1da00c4d00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800b370 tx=0x7f1d98004b20 comp rx=0 tx=0).stop 2023-10-14T12:36:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 shutdown_connections 2023-10-14T12:36:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f1d8c06af00 0x7f1d8c06d3c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1da015f000 0x7f1da00c4d00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f1da006a820 0x7f1da00c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 --2- 172.21.15.72:0/2734786045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1da00ca7d0 0x7f1da00c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 >> 172.21.15.72:0/2734786045 conn(0x7f1da00d0180 msgr2=0x7f1da015e000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:36:05.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 shutdown_connections 2023-10-14T12:36:05.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.280+0000 7f1da64a2700 1 -- 172.21.15.72:0/2734786045 wait complete. 2023-10-14T12:36:05.288 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-10-14T12:36:05.292 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-10-14T12:36:03.419917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220968,"kb_used_data":4840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753752,"statfs":{"total":773094113280,"available":772867842048,"internally_reserved":0,"allocated":4956160,"data_stored":2800580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003468"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:32.625382+0000","last_change":"2023-10-14T12:35:32.625430+0000","last_active":"2023-10-14T12:35:32.625382+0000","last_peered":"2023-10-14T12:35:32.625382+0000","last_clean":"2023-10-14T12:35:32.625382+0000","last_became_active":"2023-10-14T12:34:44.772874+0000","last_became_peered":"2023-10-14T12:34:44.772874+0000","last_unstale":"2023-10-14T12:35:32.625382+0000","last_undegraded":"2023-10-14T12:35:32.625382+0000","last_fullsized":"2023-10-14T12:35:32.625382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:32.625279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:32.625279+0000","last_clean_scrub_stamp":"2023-10-14T12:35:32.625279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:48.179779+0000","scrub_duration":0.001572445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:23.666074+0000","last_change":"2023-10-14T12:35:23.666120+0000","last_active":"2023-10-14T12:35:23.666074+0000","last_peered":"2023-10-14T12:35:23.666074+0000","last_clean":"2023-10-14T12:35:23.666074+0000","last_became_active":"2023-10-14T12:34:44.765783+0000","last_became_peered":"2023-10-14T12:34:44.765783+0000","last_unstale":"2023-10-14T12:35:23.666074+0000","last_undegraded":"2023-10-14T12:35:23.666074+0000","last_fullsized":"2023-10-14T12:35:23.666074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:23.665980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:23.665980+0000","last_clean_scrub_stamp":"2023-10-14T12:35:23.665980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:11:01.370382+0000","scrub_duration":0.0015131949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:26.615084+0000","last_change":"2023-10-14T12:35:26.615140+0000","last_active":"2023-10-14T12:35:26.615084+0000","last_peered":"2023-10-14T12:35:26.615084+0000","last_clean":"2023-10-14T12:35:26.615084+0000","last_became_active":"2023-10-14T12:34:44.765915+0000","last_became_peered":"2023-10-14T12:34:44.765915+0000","last_unstale":"2023-10-14T12:35:26.615084+0000","last_undegraded":"2023-10-14T12:35:26.615084+0000","last_fullsized":"2023-10-14T12:35:26.615084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:26.614992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:26.614992+0000","last_clean_scrub_stamp":"2023-10-14T12:35:26.614992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:21.170019+0000","scrub_duration":0.0020486910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742751+0000","last_change":"2023-10-14T12:35:18.776321+0000","last_active":"2023-10-14T12:35:20.742751+0000","last_peered":"2023-10-14T12:35:20.742751+0000","last_clean":"2023-10-14T12:35:20.742751+0000","last_became_active":"2023-10-14T12:34:44.776527+0000","last_became_peered":"2023-10-14T12:34:44.776527+0000","last_unstale":"2023-10-14T12:35:20.742751+0000","last_undegraded":"2023-10-14T12:35:20.742751+0000","last_fullsized":"2023-10-14T12:35:20.742751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:18.776173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:18.776173+0000","last_clean_scrub_stamp":"2023-10-14T12:35:18.776173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:28.785632+0000","scrub_duration":0.0018641529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742658+0000","last_change":"2023-10-14T12:35:17.819900+0000","last_active":"2023-10-14T12:35:20.742658+0000","last_peered":"2023-10-14T12:35:20.742658+0000","last_clean":"2023-10-14T12:35:20.742658+0000","last_became_active":"2023-10-14T12:34:44.774508+0000","last_became_peered":"2023-10-14T12:34:44.774508+0000","last_unstale":"2023-10-14T12:35:20.742658+0000","last_undegraded":"2023-10-14T12:35:20.742658+0000","last_fullsized":"2023-10-14T12:35:20.742658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:17.819723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:17.819723+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.819723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:42:17.377314+0000","scrub_duration":0.0021875810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:29.535926+0000","last_change":"2023-10-14T12:35:29.535973+0000","last_active":"2023-10-14T12:35:29.535926+0000","last_peered":"2023-10-14T12:35:29.535926+0000","last_clean":"2023-10-14T12:35:29.535926+0000","last_became_active":"2023-10-14T12:34:44.768717+0000","last_became_peered":"2023-10-14T12:34:44.768717+0000","last_unstale":"2023-10-14T12:35:29.535926+0000","last_undegraded":"2023-10-14T12:35:29.535926+0000","last_fullsized":"2023-10-14T12:35:29.535926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:29.535826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:29.535826+0000","last_clean_scrub_stamp":"2023-10-14T12:35:29.535826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:37:06.427690+0000","scrub_duration":0.0016056810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:27.900709+0000","last_change":"2023-10-14T12:35:27.900755+0000","last_active":"2023-10-14T12:35:27.900709+0000","last_peered":"2023-10-14T12:35:27.900709+0000","last_clean":"2023-10-14T12:35:27.900709+0000","last_became_active":"2023-10-14T12:34:44.770869+0000","last_became_peered":"2023-10-14T12:34:44.770869+0000","last_unstale":"2023-10-14T12:35:27.900709+0000","last_undegraded":"2023-10-14T12:35:27.900709+0000","last_fullsized":"2023-10-14T12:35:27.900709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:27.900564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:27.900564+0000","last_clean_scrub_stamp":"2023-10-14T12:35:27.900564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:12:09.979854+0000","scrub_duration":0.0019821109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741881+0000","last_change":"2023-10-14T12:35:13.657294+0000","last_active":"2023-10-14T12:35:20.741881+0000","last_peered":"2023-10-14T12:35:20.741881+0000","last_clean":"2023-10-14T12:35:20.741881+0000","last_became_active":"2023-10-14T12:34:44.765917+0000","last_became_peered":"2023-10-14T12:34:44.765917+0000","last_unstale":"2023-10-14T12:35:20.741881+0000","last_undegraded":"2023-10-14T12:35:20.741881+0000","last_fullsized":"2023-10-14T12:35:20.741881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:13.657150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:13.657150+0000","last_clean_scrub_stamp":"2023-10-14T12:35:13.657150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:14.297961+0000","scrub_duration":0.001938305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:22.580558+0000","last_change":"2023-10-14T12:35:22.580606+0000","last_active":"2023-10-14T12:35:22.580558+0000","last_peered":"2023-10-14T12:35:22.580558+0000","last_clean":"2023-10-14T12:35:22.580558+0000","last_became_active":"2023-10-14T12:34:44.768514+0000","last_became_peered":"2023-10-14T12:34:44.768514+0000","last_unstale":"2023-10-14T12:35:22.580558+0000","last_undegraded":"2023-10-14T12:35:22.580558+0000","last_fullsized":"2023-10-14T12:35:22.580558+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:22.580473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:22.580473+0000","last_clean_scrub_stamp":"2023-10-14T12:35:22.580473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:23.221285+0000","scrub_duration":0.001963612,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:37.969925+0000","last_change":"2023-10-14T12:35:37.969974+0000","last_active":"2023-10-14T12:35:37.969925+0000","last_peered":"2023-10-14T12:35:37.969925+0000","last_clean":"2023-10-14T12:35:37.969925+0000","last_became_active":"2023-10-14T12:34:44.764252+0000","last_became_peered":"2023-10-14T12:34:44.764252+0000","last_unstale":"2023-10-14T12:35:37.969925+0000","last_undegraded":"2023-10-14T12:35:37.969925+0000","last_fullsized":"2023-10-14T12:35:37.969925+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:37.969821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:37.969821+0000","last_clean_scrub_stamp":"2023-10-14T12:35:37.969821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:20.406726+0000","scrub_duration":0.001440572,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:24.838849+0000","last_change":"2023-10-14T12:35:24.838900+0000","last_active":"2023-10-14T12:35:24.838849+0000","last_peered":"2023-10-14T12:35:24.838849+0000","last_clean":"2023-10-14T12:35:24.838849+0000","last_became_active":"2023-10-14T12:34:44.775897+0000","last_became_peered":"2023-10-14T12:34:44.775897+0000","last_unstale":"2023-10-14T12:35:24.838849+0000","last_undegraded":"2023-10-14T12:35:24.838849+0000","last_fullsized":"2023-10-14T12:35:24.838849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:24.838749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:24.838749+0000","last_clean_scrub_stamp":"2023-10-14T12:35:24.838749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:11:02.543151+0000","scrub_duration":0.001472798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:24.616344+0000","last_change":"2023-10-14T12:35:24.616399+0000","last_active":"2023-10-14T12:35:24.616344+0000","last_peered":"2023-10-14T12:35:24.616344+0000","last_clean":"2023-10-14T12:35:24.616344+0000","last_became_active":"2023-10-14T12:34:44.766208+0000","last_became_peered":"2023-10-14T12:34:44.766208+0000","last_unstale":"2023-10-14T12:35:24.616344+0000","last_undegraded":"2023-10-14T12:35:24.616344+0000","last_fullsized":"2023-10-14T12:35:24.616344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:24.616240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:24.616240+0000","last_clean_scrub_stamp":"2023-10-14T12:35:24.616240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:23.537727+0000","scrub_duration":0.001233849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:23.875226+0000","last_change":"2023-10-14T12:35:23.875269+0000","last_active":"2023-10-14T12:35:23.875226+0000","last_peered":"2023-10-14T12:35:23.875226+0000","last_clean":"2023-10-14T12:35:23.875226+0000","last_became_active":"2023-10-14T12:34:44.766602+0000","last_became_peered":"2023-10-14T12:34:44.766602+0000","last_unstale":"2023-10-14T12:35:23.875226+0000","last_undegraded":"2023-10-14T12:35:23.875226+0000","last_fullsized":"2023-10-14T12:35:23.875226+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:23.875133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:23.875133+0000","last_clean_scrub_stamp":"2023-10-14T12:35:23.875133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:25.936245+0000","scrub_duration":0.001468518,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:30.324442+0000","last_change":"2023-10-14T12:35:30.324500+0000","last_active":"2023-10-14T12:35:30.324442+0000","last_peered":"2023-10-14T12:35:30.324442+0000","last_clean":"2023-10-14T12:35:30.324442+0000","last_became_active":"2023-10-14T12:34:44.770368+0000","last_became_peered":"2023-10-14T12:34:44.770368+0000","last_unstale":"2023-10-14T12:35:30.324442+0000","last_undegraded":"2023-10-14T12:35:30.324442+0000","last_fullsized":"2023-10-14T12:35:30.324442+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:30.324330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:30.324330+0000","last_clean_scrub_stamp":"2023-10-14T12:35:30.324330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:56.036613+0000","scrub_duration":0.0015868729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741433+0000","last_change":"2023-10-14T12:35:19.890598+0000","last_active":"2023-10-14T12:35:20.741433+0000","last_peered":"2023-10-14T12:35:20.741433+0000","last_clean":"2023-10-14T12:35:20.741433+0000","last_became_active":"2023-10-14T12:34:44.763083+0000","last_became_peered":"2023-10-14T12:34:44.763083+0000","last_unstale":"2023-10-14T12:35:20.741433+0000","last_undegraded":"2023-10-14T12:35:20.741433+0000","last_fullsized":"2023-10-14T12:35:20.741433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.890423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.890423+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.890423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:49:09.301968+0000","scrub_duration":0.001908168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:43.505731+0000","last_change":"2023-10-14T12:35:43.505775+0000","last_active":"2023-10-14T12:35:43.505731+0000","last_peered":"2023-10-14T12:35:43.505731+0000","last_clean":"2023-10-14T12:35:43.505731+0000","last_became_active":"2023-10-14T12:34:44.768474+0000","last_became_peered":"2023-10-14T12:34:44.768474+0000","last_unstale":"2023-10-14T12:35:43.505731+0000","last_undegraded":"2023-10-14T12:35:43.505731+0000","last_fullsized":"2023-10-14T12:35:43.505731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:43.505616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:43.505616+0000","last_clean_scrub_stamp":"2023-10-14T12:35:43.505616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:12:06.502037+0000","scrub_duration":0.001559249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:47.465224+0000","last_change":"2023-10-14T12:35:47.465270+0000","last_active":"2023-10-14T12:35:47.465224+0000","last_peered":"2023-10-14T12:35:47.465224+0000","last_clean":"2023-10-14T12:35:47.465224+0000","last_became_active":"2023-10-14T12:34:44.771158+0000","last_became_peered":"2023-10-14T12:34:44.771158+0000","last_unstale":"2023-10-14T12:35:47.465224+0000","last_undegraded":"2023-10-14T12:35:47.465224+0000","last_fullsized":"2023-10-14T12:35:47.465224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:47.465122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:47.465122+0000","last_clean_scrub_stamp":"2023-10-14T12:35:47.465122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:31:47.586185+0000","scrub_duration":0.001579406,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:24.430638+0000","last_change":"2023-10-14T12:35:24.430683+0000","last_active":"2023-10-14T12:35:24.430638+0000","last_peered":"2023-10-14T12:35:24.430638+0000","last_clean":"2023-10-14T12:35:24.430638+0000","last_became_active":"2023-10-14T12:34:44.776263+0000","last_became_peered":"2023-10-14T12:34:44.776263+0000","last_unstale":"2023-10-14T12:35:24.430638+0000","last_undegraded":"2023-10-14T12:35:24.430638+0000","last_fullsized":"2023-10-14T12:35:24.430638+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:24.430551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:24.430551+0000","last_clean_scrub_stamp":"2023-10-14T12:35:24.430551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:58.710020+0000","scrub_duration":0.0013352640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.664023+0000","last_change":"2023-10-14T12:35:21.664133+0000","last_active":"2023-10-14T12:35:21.664023+0000","last_peered":"2023-10-14T12:35:21.664023+0000","last_clean":"2023-10-14T12:35:21.664023+0000","last_became_active":"2023-10-14T12:34:44.767035+0000","last_became_peered":"2023-10-14T12:34:44.767035+0000","last_unstale":"2023-10-14T12:35:21.664023+0000","last_undegraded":"2023-10-14T12:35:21.664023+0000","last_fullsized":"2023-10-14T12:35:21.664023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:21.663935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:21.663935+0000","last_clean_scrub_stamp":"2023-10-14T12:35:21.663935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:21.830965+0000","scrub_duration":0.0024545140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610393+0000","last_change":"2023-10-14T12:35:12.349752+0000","last_active":"2023-10-14T12:35:20.610393+0000","last_peered":"2023-10-14T12:35:20.610393+0000","last_clean":"2023-10-14T12:35:20.610393+0000","last_became_active":"2023-10-14T12:34:44.775453+0000","last_became_peered":"2023-10-14T12:34:44.775453+0000","last_unstale":"2023-10-14T12:35:20.610393+0000","last_undegraded":"2023-10-14T12:35:20.610393+0000","last_fullsized":"2023-10-14T12:35:20.610393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:12.349586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:12.349586+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.349586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:45.239721+0000","scrub_duration":0.001482625,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:37.007311+0000","last_change":"2023-10-14T12:35:37.007368+0000","last_active":"2023-10-14T12:35:37.007311+0000","last_peered":"2023-10-14T12:35:37.007311+0000","last_clean":"2023-10-14T12:35:37.007311+0000","last_became_active":"2023-10-14T12:34:44.766299+0000","last_became_peered":"2023-10-14T12:34:44.766299+0000","last_unstale":"2023-10-14T12:35:37.007311+0000","last_undegraded":"2023-10-14T12:35:37.007311+0000","last_fullsized":"2023-10-14T12:35:37.007311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:37.007185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:37.007185+0000","last_clean_scrub_stamp":"2023-10-14T12:35:37.007185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:20:08.980630+0000","scrub_duration":0.0021011910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:25.396982+0000","last_change":"2023-10-14T12:35:25.397027+0000","last_active":"2023-10-14T12:35:25.396982+0000","last_peered":"2023-10-14T12:35:25.396982+0000","last_clean":"2023-10-14T12:35:25.396982+0000","last_became_active":"2023-10-14T12:34:44.770033+0000","last_became_peered":"2023-10-14T12:34:44.770033+0000","last_unstale":"2023-10-14T12:35:25.396982+0000","last_undegraded":"2023-10-14T12:35:25.396982+0000","last_fullsized":"2023-10-14T12:35:25.396982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:25.396896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:25.396896+0000","last_clean_scrub_stamp":"2023-10-14T12:35:25.396896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:59.676365+0000","scrub_duration":0.002034592,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:36.418692+0000","last_change":"2023-10-14T12:35:36.418740+0000","last_active":"2023-10-14T12:35:36.418692+0000","last_peered":"2023-10-14T12:35:36.418692+0000","last_clean":"2023-10-14T12:35:36.418692+0000","last_became_active":"2023-10-14T12:34:44.767967+0000","last_became_peered":"2023-10-14T12:34:44.767967+0000","last_unstale":"2023-10-14T12:35:36.418692+0000","last_undegraded":"2023-10-14T12:35:36.418692+0000","last_fullsized":"2023-10-14T12:35:36.418692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:36.418603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:36.418603+0000","last_clean_scrub_stamp":"2023-10-14T12:35:36.418603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:44.266004+0000","scrub_duration":0.0016692530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:27.765876+0000","last_change":"2023-10-14T12:35:27.765925+0000","last_active":"2023-10-14T12:35:27.765876+0000","last_peered":"2023-10-14T12:35:27.765876+0000","last_clean":"2023-10-14T12:35:27.765876+0000","last_became_active":"2023-10-14T12:34:44.768304+0000","last_became_peered":"2023-10-14T12:34:44.768304+0000","last_unstale":"2023-10-14T12:35:27.765876+0000","last_undegraded":"2023-10-14T12:35:27.765876+0000","last_fullsized":"2023-10-14T12:35:27.765876+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:27.765785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:27.765785+0000","last_clean_scrub_stamp":"2023-10-14T12:35:27.765785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:33:09.541344+0000","scrub_duration":0.0020278729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610636+0000","last_change":"2023-10-14T12:35:15.404467+0000","last_active":"2023-10-14T12:35:20.610636+0000","last_peered":"2023-10-14T12:35:20.610636+0000","last_clean":"2023-10-14T12:35:20.610636+0000","last_became_active":"2023-10-14T12:34:44.764072+0000","last_became_peered":"2023-10-14T12:34:44.764072+0000","last_unstale":"2023-10-14T12:35:20.610636+0000","last_undegraded":"2023-10-14T12:35:20.610636+0000","last_fullsized":"2023-10-14T12:35:20.610636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:15.404312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:15.404312+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.404312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:26.281514+0000","scrub_duration":0.00201366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:22.537183+0000","last_change":"2023-10-14T12:35:22.537231+0000","last_active":"2023-10-14T12:35:22.537183+0000","last_peered":"2023-10-14T12:35:22.537183+0000","last_clean":"2023-10-14T12:35:22.537183+0000","last_became_active":"2023-10-14T12:34:44.767743+0000","last_became_peered":"2023-10-14T12:34:44.767743+0000","last_unstale":"2023-10-14T12:35:22.537183+0000","last_undegraded":"2023-10-14T12:35:22.537183+0000","last_fullsized":"2023-10-14T12:35:22.537183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:22.537079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:22.537079+0000","last_clean_scrub_stamp":"2023-10-14T12:35:22.537079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:05.359431+0000","scrub_duration":0.0016911929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610609+0000","last_change":"2023-10-14T12:35:19.441376+0000","last_active":"2023-10-14T12:35:20.610609+0000","last_peered":"2023-10-14T12:35:20.610609+0000","last_clean":"2023-10-14T12:35:20.610609+0000","last_became_active":"2023-10-14T12:34:44.766309+0000","last_became_peered":"2023-10-14T12:34:44.766309+0000","last_unstale":"2023-10-14T12:35:20.610609+0000","last_undegraded":"2023-10-14T12:35:20.610609+0000","last_fullsized":"2023-10-14T12:35:20.610609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.441218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.441218+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.441218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:44.997017+0000","scrub_duration":0.0015683240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:30.954708+0000","last_change":"2023-10-14T12:35:30.954758+0000","last_active":"2023-10-14T12:35:30.954708+0000","last_peered":"2023-10-14T12:35:30.954708+0000","last_clean":"2023-10-14T12:35:30.954708+0000","last_became_active":"2023-10-14T12:34:44.765904+0000","last_became_peered":"2023-10-14T12:34:44.765904+0000","last_unstale":"2023-10-14T12:35:30.954708+0000","last_undegraded":"2023-10-14T12:35:30.954708+0000","last_fullsized":"2023-10-14T12:35:30.954708+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:30.954606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:30.954606+0000","last_clean_scrub_stamp":"2023-10-14T12:35:30.954606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:51:47.461557+0000","scrub_duration":0.001699255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610386+0000","last_change":"2023-10-14T12:35:17.455157+0000","last_active":"2023-10-14T12:35:20.610386+0000","last_peered":"2023-10-14T12:35:20.610386+0000","last_clean":"2023-10-14T12:35:20.610386+0000","last_became_active":"2023-10-14T12:34:44.764719+0000","last_became_peered":"2023-10-14T12:34:44.764719+0000","last_unstale":"2023-10-14T12:35:20.610386+0000","last_undegraded":"2023-10-14T12:35:20.610386+0000","last_fullsized":"2023-10-14T12:35:20.610386+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:17.454997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:17.454997+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.454997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:57.377417+0000","scrub_duration":0.0023420310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610465+0000","last_change":"2023-10-14T12:35:10.332872+0000","last_active":"2023-10-14T12:35:20.610465+0000","last_peered":"2023-10-14T12:35:20.610465+0000","last_clean":"2023-10-14T12:35:20.610465+0000","last_became_active":"2023-10-14T12:34:44.768729+0000","last_became_peered":"2023-10-14T12:34:44.768729+0000","last_unstale":"2023-10-14T12:35:20.610465+0000","last_undegraded":"2023-10-14T12:35:20.610465+0000","last_fullsized":"2023-10-14T12:35:20.610465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:10.332731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:10.332731+0000","last_clean_scrub_stamp":"2023-10-14T12:35:10.332731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.102844+0000","scrub_duration":0.0013980189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:38.487190+0000","last_change":"2023-10-14T12:35:38.487243+0000","last_active":"2023-10-14T12:35:38.487190+0000","last_peered":"2023-10-14T12:35:38.487190+0000","last_clean":"2023-10-14T12:35:38.487190+0000","last_became_active":"2023-10-14T12:34:44.768243+0000","last_became_peered":"2023-10-14T12:34:44.768243+0000","last_unstale":"2023-10-14T12:35:38.487190+0000","last_undegraded":"2023-10-14T12:35:38.487190+0000","last_fullsized":"2023-10-14T12:35:38.487190+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:38.487076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:38.487076+0000","last_clean_scrub_stamp":"2023-10-14T12:35:38.487076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:12:20.566365+0000","scrub_duration":0.0019929119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742746+0000","last_change":"2023-10-14T12:35:14.491561+0000","last_active":"2023-10-14T12:35:20.742746+0000","last_peered":"2023-10-14T12:35:20.742746+0000","last_clean":"2023-10-14T12:35:20.742746+0000","last_became_active":"2023-10-14T12:34:44.768423+0000","last_became_peered":"2023-10-14T12:34:44.768423+0000","last_unstale":"2023-10-14T12:35:20.742746+0000","last_undegraded":"2023-10-14T12:35:20.742746+0000","last_fullsized":"2023-10-14T12:35:20.742746+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:14.491409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:14.491409+0000","last_clean_scrub_stamp":"2023-10-14T12:35:14.491409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:23.466129+0000","scrub_duration":0.001502986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:55.363107+0000","last_change":"2023-10-14T12:35:55.363168+0000","last_active":"2023-10-14T12:35:55.363107+0000","last_peered":"2023-10-14T12:35:55.363107+0000","last_clean":"2023-10-14T12:35:55.363107+0000","last_became_active":"2023-10-14T12:34:44.770846+0000","last_became_peered":"2023-10-14T12:34:44.770846+0000","last_unstale":"2023-10-14T12:35:55.363107+0000","last_undegraded":"2023-10-14T12:35:55.363107+0000","last_fullsized":"2023-10-14T12:35:55.363107+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:55.362978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:55.362978+0000","last_clean_scrub_stamp":"2023-10-14T12:35:55.362978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:19:50.882245+0000","scrub_duration":0.0016711149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610725+0000","last_change":"2023-10-14T12:35:09.344283+0000","last_active":"2023-10-14T12:35:20.610725+0000","last_peered":"2023-10-14T12:35:20.610725+0000","last_clean":"2023-10-14T12:35:20.610725+0000","last_became_active":"2023-10-14T12:34:43.742090+0000","last_became_peered":"2023-10-14T12:34:43.742090+0000","last_unstale":"2023-10-14T12:35:20.610725+0000","last_undegraded":"2023-10-14T12:35:20.610725+0000","last_fullsized":"2023-10-14T12:35:20.610725+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2023-10-14T12:35:09.344122+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2023-10-14T12:35:09.344122+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.344122+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:30.708229+0000","scrub_duration":0.0021377689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743531+0000","last_change":"2023-10-14T12:35:16.489564+0000","last_active":"2023-10-14T12:35:20.743531+0000","last_peered":"2023-10-14T12:35:20.743531+0000","last_clean":"2023-10-14T12:35:20.743531+0000","last_became_active":"2023-10-14T12:34:44.772093+0000","last_became_peered":"2023-10-14T12:34:44.772093+0000","last_unstale":"2023-10-14T12:35:20.743531+0000","last_undegraded":"2023-10-14T12:35:20.743531+0000","last_fullsized":"2023-10-14T12:35:20.743531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:16.489425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:16.489425+0000","last_clean_scrub_stamp":"2023-10-14T12:35:16.489425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:20.761264+0000","scrub_duration":0.001862371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743876+0000","last_change":"2023-10-14T12:35:04.627114+0000","last_active":"2023-10-14T12:35:20.743876+0000","last_peered":"2023-10-14T12:35:20.743876+0000","last_clean":"2023-10-14T12:35:20.743876+0000","last_became_active":"2023-10-14T12:34:43.740537+0000","last_became_peered":"2023-10-14T12:34:43.740537+0000","last_unstale":"2023-10-14T12:35:20.743876+0000","last_undegraded":"2023-10-14T12:35:20.743876+0000","last_fullsized":"2023-10-14T12:35:20.743876+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:04.626942+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:04.626942+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.626942+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:18.397054+0000","scrub_duration":0.0018766779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:36.329163+0000","last_change":"2023-10-14T12:35:36.329209+0000","last_active":"2023-10-14T12:35:36.329163+0000","last_peered":"2023-10-14T12:35:36.329163+0000","last_clean":"2023-10-14T12:35:36.329163+0000","last_became_active":"2023-10-14T12:34:44.775648+0000","last_became_peered":"2023-10-14T12:34:44.775648+0000","last_unstale":"2023-10-14T12:35:36.329163+0000","last_undegraded":"2023-10-14T12:35:36.329163+0000","last_fullsized":"2023-10-14T12:35:36.329163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:36.329056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:36.329056+0000","last_clean_scrub_stamp":"2023-10-14T12:35:36.329056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:35.250543+0000","scrub_duration":0.0014791240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743365+0000","last_change":"2023-10-14T12:35:08.488859+0000","last_active":"2023-10-14T12:35:20.743365+0000","last_peered":"2023-10-14T12:35:20.743365+0000","last_clean":"2023-10-14T12:35:20.743365+0000","last_became_active":"2023-10-14T12:34:43.737611+0000","last_became_peered":"2023-10-14T12:34:43.737611+0000","last_unstale":"2023-10-14T12:35:20.743365+0000","last_undegraded":"2023-10-14T12:35:20.743365+0000","last_fullsized":"2023-10-14T12:35:20.743365+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:08.488716+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:08.488716+0000","last_clean_scrub_stamp":"2023-10-14T12:35:08.488716+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:15:37.867958+0000","scrub_duration":0.0023671130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:29.630287+0000","last_change":"2023-10-14T12:35:29.630332+0000","last_active":"2023-10-14T12:35:29.630287+0000","last_peered":"2023-10-14T12:35:29.630287+0000","last_clean":"2023-10-14T12:35:29.630287+0000","last_became_active":"2023-10-14T12:34:44.765043+0000","last_became_peered":"2023-10-14T12:34:44.765043+0000","last_unstale":"2023-10-14T12:35:29.630287+0000","last_undegraded":"2023-10-14T12:35:29.630287+0000","last_fullsized":"2023-10-14T12:35:29.630287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:29.630199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:29.630199+0000","last_clean_scrub_stamp":"2023-10-14T12:35:29.630199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:27:55.471813+0000","scrub_duration":0.0020247260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.611597+0000","last_change":"2023-10-14T12:35:05.442139+0000","last_active":"2023-10-14T12:35:20.611597+0000","last_peered":"2023-10-14T12:35:20.611597+0000","last_clean":"2023-10-14T12:35:20.611597+0000","last_became_active":"2023-10-14T12:34:43.737725+0000","last_became_peered":"2023-10-14T12:34:43.737725+0000","last_unstale":"2023-10-14T12:35:20.611597+0000","last_undegraded":"2023-10-14T12:35:20.611597+0000","last_fullsized":"2023-10-14T12:35:20.611597+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:05.442005+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:05.442005+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.442005+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:05.609035+0000","scrub_duration":0.0022538969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741861+0000","last_change":"2023-10-14T12:35:07.594986+0000","last_active":"2023-10-14T12:35:20.741861+0000","last_peered":"2023-10-14T12:35:20.741861+0000","last_clean":"2023-10-14T12:35:20.741861+0000","last_became_active":"2023-10-14T12:34:44.763356+0000","last_became_peered":"2023-10-14T12:34:44.763356+0000","last_unstale":"2023-10-14T12:35:20.741861+0000","last_undegraded":"2023-10-14T12:35:20.741861+0000","last_fullsized":"2023-10-14T12:35:20.741861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:07.594832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:07.594832+0000","last_clean_scrub_stamp":"2023-10-14T12:35:07.594832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:28:54.639365+0000","scrub_duration":0.001521924,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741704+0000","last_change":"2023-10-14T12:35:14.831305+0000","last_active":"2023-10-14T12:35:20.741704+0000","last_peered":"2023-10-14T12:35:20.741704+0000","last_clean":"2023-10-14T12:35:20.741704+0000","last_became_active":"2023-10-14T12:34:43.738436+0000","last_became_peered":"2023-10-14T12:34:43.738436+0000","last_unstale":"2023-10-14T12:35:20.741704+0000","last_undegraded":"2023-10-14T12:35:20.741704+0000","last_fullsized":"2023-10-14T12:35:20.741704+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:14.831136+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:14.831136+0000","last_clean_scrub_stamp":"2023-10-14T12:35:14.831136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:40.543419+0000","scrub_duration":0.0021581809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.907370+0000","last_change":"2023-10-14T12:35:21.907419+0000","last_active":"2023-10-14T12:35:21.907370+0000","last_peered":"2023-10-14T12:35:21.907370+0000","last_clean":"2023-10-14T12:35:21.907370+0000","last_became_active":"2023-10-14T12:34:44.766961+0000","last_became_peered":"2023-10-14T12:34:44.766961+0000","last_unstale":"2023-10-14T12:35:21.907370+0000","last_undegraded":"2023-10-14T12:35:21.907370+0000","last_fullsized":"2023-10-14T12:35:21.907370+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:21.907266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:21.907266+0000","last_clean_scrub_stamp":"2023-10-14T12:35:21.907266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:42.192840+0000","scrub_duration":0.0018686900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":24,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:25.578614+0000","last_change":"2023-10-14T12:35:25.578664+0000","last_active":"2023-10-14T12:35:25.578614+0000","last_peered":"2023-10-14T12:35:25.578614+0000","last_clean":"2023-10-14T12:35:25.578614+0000","last_became_active":"2023-10-14T12:34:43.747444+0000","last_became_peered":"2023-10-14T12:34:43.747444+0000","last_unstale":"2023-10-14T12:35:25.578614+0000","last_undegraded":"2023-10-14T12:35:25.578614+0000","last_fullsized":"2023-10-14T12:35:25.578614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:25.578511+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:25.578511+0000","last_clean_scrub_stamp":"2023-10-14T12:35:25.578511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:09:26.219323+0000","scrub_duration":0.0017173760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:24.396492+0000","last_change":"2023-10-14T12:35:24.396544+0000","last_active":"2023-10-14T12:35:24.396492+0000","last_peered":"2023-10-14T12:35:24.396492+0000","last_clean":"2023-10-14T12:35:24.396492+0000","last_became_active":"2023-10-14T12:34:44.770030+0000","last_became_peered":"2023-10-14T12:34:44.770030+0000","last_unstale":"2023-10-14T12:35:24.396492+0000","last_undegraded":"2023-10-14T12:35:24.396492+0000","last_fullsized":"2023-10-14T12:35:24.396492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:24.396391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:24.396391+0000","last_clean_scrub_stamp":"2023-10-14T12:35:24.396391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:49.952190+0000","scrub_duration":0.00140879,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743700+0000","last_change":"2023-10-14T12:35:13.472623+0000","last_active":"2023-10-14T12:35:20.743700+0000","last_peered":"2023-10-14T12:35:20.743700+0000","last_clean":"2023-10-14T12:35:20.743700+0000","last_became_active":"2023-10-14T12:34:43.737956+0000","last_became_peered":"2023-10-14T12:34:43.737956+0000","last_unstale":"2023-10-14T12:35:20.743700+0000","last_undegraded":"2023-10-14T12:35:20.743700+0000","last_fullsized":"2023-10-14T12:35:20.743700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:13.472474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:13.472474+0000","last_clean_scrub_stamp":"2023-10-14T12:35:13.472474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:43.300344+0000","scrub_duration":0.0017954729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.679900+0000","last_change":"2023-10-14T12:35:21.679948+0000","last_active":"2023-10-14T12:35:21.679900+0000","last_peered":"2023-10-14T12:35:21.679900+0000","last_clean":"2023-10-14T12:35:21.679900+0000","last_became_active":"2023-10-14T12:34:44.761308+0000","last_became_peered":"2023-10-14T12:34:44.761308+0000","last_unstale":"2023-10-14T12:35:21.679900+0000","last_undegraded":"2023-10-14T12:35:21.679900+0000","last_fullsized":"2023-10-14T12:35:21.679900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:21.679814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:21.679814+0000","last_clean_scrub_stamp":"2023-10-14T12:35:21.679814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:16:58.875674+0000","scrub_duration":0.0021800249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610684+0000","last_change":"2023-10-14T12:35:06.455925+0000","last_active":"2023-10-14T12:35:20.610684+0000","last_peered":"2023-10-14T12:35:20.610684+0000","last_clean":"2023-10-14T12:35:20.610684+0000","last_became_active":"2023-10-14T12:34:43.737150+0000","last_became_peered":"2023-10-14T12:34:43.737150+0000","last_unstale":"2023-10-14T12:35:20.610684+0000","last_undegraded":"2023-10-14T12:35:20.610684+0000","last_fullsized":"2023-10-14T12:35:20.610684+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:06.455787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:06.455787+0000","last_clean_scrub_stamp":"2023-10-14T12:35:06.455787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:54.240104+0000","scrub_duration":0.0017672090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:37.801766+0000","last_change":"2023-10-14T12:35:37.801832+0000","last_active":"2023-10-14T12:35:37.801766+0000","last_peered":"2023-10-14T12:35:37.801766+0000","last_clean":"2023-10-14T12:35:37.801766+0000","last_became_active":"2023-10-14T12:34:44.776592+0000","last_became_peered":"2023-10-14T12:34:44.776592+0000","last_unstale":"2023-10-14T12:35:37.801766+0000","last_undegraded":"2023-10-14T12:35:37.801766+0000","last_fullsized":"2023-10-14T12:35:37.801766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:37.801620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:37.801620+0000","last_clean_scrub_stamp":"2023-10-14T12:35:37.801620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:48.678823+0000","scrub_duration":0.0022632490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743132+0000","last_change":"2023-10-14T12:35:09.634042+0000","last_active":"2023-10-14T12:35:20.743132+0000","last_peered":"2023-10-14T12:35:20.743132+0000","last_clean":"2023-10-14T12:35:20.743132+0000","last_became_active":"2023-10-14T12:34:43.733739+0000","last_became_peered":"2023-10-14T12:34:43.733739+0000","last_unstale":"2023-10-14T12:35:20.743132+0000","last_undegraded":"2023-10-14T12:35:20.743132+0000","last_fullsized":"2023-10-14T12:35:20.743132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:09.633882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:09.633882+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.633882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:44:37.630913+0000","scrub_duration":0.0016000669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:33.523606+0000","last_change":"2023-10-14T12:35:33.523678+0000","last_active":"2023-10-14T12:35:33.523606+0000","last_peered":"2023-10-14T12:35:33.523606+0000","last_clean":"2023-10-14T12:35:33.523606+0000","last_became_active":"2023-10-14T12:34:44.763408+0000","last_became_peered":"2023-10-14T12:34:44.763408+0000","last_unstale":"2023-10-14T12:35:33.523606+0000","last_undegraded":"2023-10-14T12:35:33.523606+0000","last_fullsized":"2023-10-14T12:35:33.523606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:33.523500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:33.523500+0000","last_clean_scrub_stamp":"2023-10-14T12:35:33.523500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:12:43.609495+0000","scrub_duration":0.0016054210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742027+0000","last_change":"2023-10-14T12:35:06.805234+0000","last_active":"2023-10-14T12:35:20.742027+0000","last_peered":"2023-10-14T12:35:20.742027+0000","last_clean":"2023-10-14T12:35:20.742027+0000","last_became_active":"2023-10-14T12:34:43.734599+0000","last_became_peered":"2023-10-14T12:34:43.734599+0000","last_unstale":"2023-10-14T12:35:20.742027+0000","last_undegraded":"2023-10-14T12:35:20.742027+0000","last_fullsized":"2023-10-14T12:35:20.742027+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:06.805056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:06.805056+0000","last_clean_scrub_stamp":"2023-10-14T12:35:06.805056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:32.360854+0000","scrub_duration":0.001935003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743834+0000","last_change":"2023-10-14T12:35:17.654663+0000","last_active":"2023-10-14T12:35:20.743834+0000","last_peered":"2023-10-14T12:35:20.743834+0000","last_clean":"2023-10-14T12:35:20.743834+0000","last_became_active":"2023-10-14T12:34:44.764455+0000","last_became_peered":"2023-10-14T12:34:44.764455+0000","last_unstale":"2023-10-14T12:35:20.743834+0000","last_undegraded":"2023-10-14T12:35:20.743834+0000","last_fullsized":"2023-10-14T12:35:20.743834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:17.654436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:17.654436+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.654436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:43.809107+0000","scrub_duration":0.0021283600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741953+0000","last_change":"2023-10-14T12:35:09.745066+0000","last_active":"2023-10-14T12:35:20.741953+0000","last_peered":"2023-10-14T12:35:20.741953+0000","last_clean":"2023-10-14T12:35:20.741953+0000","last_became_active":"2023-10-14T12:34:43.735698+0000","last_became_peered":"2023-10-14T12:34:43.735698+0000","last_unstale":"2023-10-14T12:35:20.741953+0000","last_undegraded":"2023-10-14T12:35:20.741953+0000","last_fullsized":"2023-10-14T12:35:20.741953+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2023-10-14T12:35:09.744908+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2023-10-14T12:35:09.744908+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.744908+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:44.024377+0000","scrub_duration":0.0024157639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:38.313312+0000","last_change":"2023-10-14T12:35:38.313414+0000","last_active":"2023-10-14T12:35:38.313312+0000","last_peered":"2023-10-14T12:35:38.313312+0000","last_clean":"2023-10-14T12:35:38.313312+0000","last_became_active":"2023-10-14T12:34:44.774253+0000","last_became_peered":"2023-10-14T12:34:44.774253+0000","last_unstale":"2023-10-14T12:35:38.313312+0000","last_undegraded":"2023-10-14T12:35:38.313312+0000","last_fullsized":"2023-10-14T12:35:38.313312+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:38.313190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:38.313190+0000","last_clean_scrub_stamp":"2023-10-14T12:35:38.313190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:59:58.598764+0000","scrub_duration":0.0021105640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742077+0000","last_change":"2023-10-14T12:35:03.578668+0000","last_active":"2023-10-14T12:35:20.742077+0000","last_peered":"2023-10-14T12:35:20.742077+0000","last_clean":"2023-10-14T12:35:20.742077+0000","last_became_active":"2023-10-14T12:34:43.741236+0000","last_became_peered":"2023-10-14T12:34:43.741236+0000","last_unstale":"2023-10-14T12:35:20.742077+0000","last_undegraded":"2023-10-14T12:35:20.742077+0000","last_fullsized":"2023-10-14T12:35:20.742077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2023-10-14T12:35:03.578503+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2023-10-14T12:35:03.578503+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.578503+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:07.850341+0000","scrub_duration":0.003262222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.625419+0000","last_change":"2023-10-14T12:35:21.625419+0000","last_active":"2023-10-14T12:35:21.625419+0000","last_peered":"2023-10-14T12:35:21.625419+0000","last_clean":"2023-10-14T12:35:21.625419+0000","last_became_active":"2023-10-14T12:35:21.625031+0000","last_became_peered":"2023-10-14T12:35:21.625031+0000","last_unstale":"2023-10-14T12:35:21.625419+0000","last_undegraded":"2023-10-14T12:35:21.625419+0000","last_fullsized":"2023-10-14T12:35:21.625419+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.643481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.643481+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.643481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:44:49.847820+0000","scrub_duration":0.0018957640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742308+0000","last_change":"2023-10-14T12:35:10.618248+0000","last_active":"2023-10-14T12:35:20.742308+0000","last_peered":"2023-10-14T12:35:20.742308+0000","last_clean":"2023-10-14T12:35:20.742308+0000","last_became_active":"2023-10-14T12:34:43.738387+0000","last_became_peered":"2023-10-14T12:34:43.738387+0000","last_unstale":"2023-10-14T12:35:20.742308+0000","last_undegraded":"2023-10-14T12:35:20.742308+0000","last_fullsized":"2023-10-14T12:35:20.742308+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:10.618045+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:10.618045+0000","last_clean_scrub_stamp":"2023-10-14T12:35:10.618045+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:35.811911+0000","scrub_duration":0.0024294249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:28.590299+0000","last_change":"2023-10-14T12:35:28.590344+0000","last_active":"2023-10-14T12:35:28.590299+0000","last_peered":"2023-10-14T12:35:28.590299+0000","last_clean":"2023-10-14T12:35:28.590299+0000","last_became_active":"2023-10-14T12:34:44.772662+0000","last_became_peered":"2023-10-14T12:34:44.772662+0000","last_unstale":"2023-10-14T12:35:28.590299+0000","last_undegraded":"2023-10-14T12:35:28.590299+0000","last_fullsized":"2023-10-14T12:35:28.590299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:28.590211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:28.590211+0000","last_clean_scrub_stamp":"2023-10-14T12:35:28.590211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:50.591901+0000","scrub_duration":0.001468511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743537+0000","last_change":"2023-10-14T12:35:07.455189+0000","last_active":"2023-10-14T12:35:20.743537+0000","last_peered":"2023-10-14T12:35:20.743537+0000","last_clean":"2023-10-14T12:35:20.743537+0000","last_became_active":"2023-10-14T12:34:43.738075+0000","last_became_peered":"2023-10-14T12:34:43.738075+0000","last_unstale":"2023-10-14T12:35:20.743537+0000","last_undegraded":"2023-10-14T12:35:20.743537+0000","last_fullsized":"2023-10-14T12:35:20.743537+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:07.455036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:07.455036+0000","last_clean_scrub_stamp":"2023-10-14T12:35:07.455036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:32:49.230595+0000","scrub_duration":0.0021334510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:54.392849+0000","last_change":"2023-10-14T12:35:54.392896+0000","last_active":"2023-10-14T12:35:54.392849+0000","last_peered":"2023-10-14T12:35:54.392849+0000","last_clean":"2023-10-14T12:35:54.392849+0000","last_became_active":"2023-10-14T12:34:44.761153+0000","last_became_peered":"2023-10-14T12:34:44.761153+0000","last_unstale":"2023-10-14T12:35:54.392849+0000","last_undegraded":"2023-10-14T12:35:54.392849+0000","last_fullsized":"2023-10-14T12:35:54.392849+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:54.392744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:54.392744+0000","last_clean_scrub_stamp":"2023-10-14T12:35:54.392744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:39:36.829649+0000","scrub_duration":0.0021164389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610955+0000","last_change":"2023-10-14T12:35:05.297709+0000","last_active":"2023-10-14T12:35:20.610955+0000","last_peered":"2023-10-14T12:35:20.610955+0000","last_clean":"2023-10-14T12:35:20.610955+0000","last_became_active":"2023-10-14T12:34:43.742075+0000","last_became_peered":"2023-10-14T12:34:43.742075+0000","last_unstale":"2023-10-14T12:35:20.610955+0000","last_undegraded":"2023-10-14T12:35:20.610955+0000","last_fullsized":"2023-10-14T12:35:20.610955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:05.297555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:05.297555+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.297555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:30.748938+0000","scrub_duration":0.0015276039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741983+0000","last_change":"2023-10-14T12:35:12.665284+0000","last_active":"2023-10-14T12:35:20.741983+0000","last_peered":"2023-10-14T12:35:20.741983+0000","last_clean":"2023-10-14T12:35:20.741983+0000","last_became_active":"2023-10-14T12:34:44.762396+0000","last_became_peered":"2023-10-14T12:34:44.762396+0000","last_unstale":"2023-10-14T12:35:20.741983+0000","last_undegraded":"2023-10-14T12:35:20.741983+0000","last_fullsized":"2023-10-14T12:35:20.741983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:12.665092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:12.665092+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.665092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:44:42.869431+0000","scrub_duration":0.0015451849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.612208+0000","last_change":"2023-10-14T12:35:12.618433+0000","last_active":"2023-10-14T12:35:20.612208+0000","last_peered":"2023-10-14T12:35:20.612208+0000","last_clean":"2023-10-14T12:35:20.612208+0000","last_became_active":"2023-10-14T12:34:43.745611+0000","last_became_peered":"2023-10-14T12:34:43.745611+0000","last_unstale":"2023-10-14T12:35:20.612208+0000","last_undegraded":"2023-10-14T12:35:20.612208+0000","last_fullsized":"2023-10-14T12:35:20.612208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2023-10-14T12:35:12.618230+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2023-10-14T12:35:12.618230+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.618230+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:46.897698+0000","scrub_duration":0.0023501519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:26.617902+0000","last_change":"2023-10-14T12:35:26.617994+0000","last_active":"2023-10-14T12:35:26.617902+0000","last_peered":"2023-10-14T12:35:26.617902+0000","last_clean":"2023-10-14T12:35:26.617902+0000","last_became_active":"2023-10-14T12:34:44.761558+0000","last_became_peered":"2023-10-14T12:34:44.761558+0000","last_unstale":"2023-10-14T12:35:26.617902+0000","last_undegraded":"2023-10-14T12:35:26.617902+0000","last_fullsized":"2023-10-14T12:35:26.617902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:26.617780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:26.617780+0000","last_clean_scrub_stamp":"2023-10-14T12:35:26.617780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:34.150032+0000","scrub_duration":0.001642599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742151+0000","last_change":"2023-10-14T12:35:17.909923+0000","last_active":"2023-10-14T12:35:20.742151+0000","last_peered":"2023-10-14T12:35:20.742151+0000","last_clean":"2023-10-14T12:35:20.742151+0000","last_became_active":"2023-10-14T12:34:43.743174+0000","last_became_peered":"2023-10-14T12:34:43.743174+0000","last_unstale":"2023-10-14T12:35:20.742151+0000","last_undegraded":"2023-10-14T12:35:20.742151+0000","last_fullsized":"2023-10-14T12:35:20.742151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2023-10-14T12:35:17.909780+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2023-10-14T12:35:17.909780+0000","last_clean_scrub_stamp":"2023-10-14T12:35:17.909780+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:20.253027+0000","scrub_duration":0.003061299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:31.957870+0000","last_change":"2023-10-14T12:35:31.957919+0000","last_active":"2023-10-14T12:35:31.957870+0000","last_peered":"2023-10-14T12:35:31.957870+0000","last_clean":"2023-10-14T12:35:31.957870+0000","last_became_active":"2023-10-14T12:34:44.766119+0000","last_became_peered":"2023-10-14T12:34:44.766119+0000","last_unstale":"2023-10-14T12:35:31.957870+0000","last_undegraded":"2023-10-14T12:35:31.957870+0000","last_fullsized":"2023-10-14T12:35:31.957870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:31.957771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:31.957771+0000","last_clean_scrub_stamp":"2023-10-14T12:35:31.957771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:11:54.954193+0000","scrub_duration":0.0019928910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.611117+0000","last_change":"2023-10-14T12:35:10.457346+0000","last_active":"2023-10-14T12:35:20.611117+0000","last_peered":"2023-10-14T12:35:20.611117+0000","last_clean":"2023-10-14T12:35:20.611117+0000","last_became_active":"2023-10-14T12:34:43.737720+0000","last_became_peered":"2023-10-14T12:34:43.737720+0000","last_unstale":"2023-10-14T12:35:20.611117+0000","last_undegraded":"2023-10-14T12:35:20.611117+0000","last_fullsized":"2023-10-14T12:35:20.611117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:10.457168+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:10.457168+0000","last_clean_scrub_stamp":"2023-10-14T12:35:10.457168+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:56:03.430833+0000","scrub_duration":0.0019522529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:35.297975+0000","last_change":"2023-10-14T12:35:35.298023+0000","last_active":"2023-10-14T12:35:35.297975+0000","last_peered":"2023-10-14T12:35:35.297975+0000","last_clean":"2023-10-14T12:35:35.297975+0000","last_became_active":"2023-10-14T12:34:44.775417+0000","last_became_peered":"2023-10-14T12:34:44.775417+0000","last_unstale":"2023-10-14T12:35:35.297975+0000","last_undegraded":"2023-10-14T12:35:35.297975+0000","last_fullsized":"2023-10-14T12:35:35.297975+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:35.297826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:35.297826+0000","last_clean_scrub_stamp":"2023-10-14T12:35:35.297826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:25:24.542361+0000","scrub_duration":0.0021972239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743056+0000","last_change":"2023-10-14T12:35:03.955073+0000","last_active":"2023-10-14T12:35:20.743056+0000","last_peered":"2023-10-14T12:35:20.743056+0000","last_clean":"2023-10-14T12:35:20.743056+0000","last_became_active":"2023-10-14T12:34:43.743895+0000","last_became_peered":"2023-10-14T12:34:43.743895+0000","last_unstale":"2023-10-14T12:35:20.743056+0000","last_undegraded":"2023-10-14T12:35:20.743056+0000","last_fullsized":"2023-10-14T12:35:20.743056+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'1","last_scrub_stamp":"2023-10-14T12:35:03.954904+0000","last_deep_scrub":"37'1","last_deep_scrub_stamp":"2023-10-14T12:35:03.954904+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.954904+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:08:04.403532+0000","scrub_duration":0.0020523210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743415+0000","last_change":"2023-10-14T12:35:19.739828+0000","last_active":"2023-10-14T12:35:20.743415+0000","last_peered":"2023-10-14T12:35:20.743415+0000","last_clean":"2023-10-14T12:35:20.743415+0000","last_became_active":"2023-10-14T12:34:44.768157+0000","last_became_peered":"2023-10-14T12:34:44.768157+0000","last_unstale":"2023-10-14T12:35:20.743415+0000","last_undegraded":"2023-10-14T12:35:20.743415+0000","last_fullsized":"2023-10-14T12:35:20.743415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.739681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.739681+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.739681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:45.191064+0000","scrub_duration":0.0015638480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743254+0000","last_change":"2023-10-14T12:35:03.525669+0000","last_active":"2023-10-14T12:35:20.743254+0000","last_peered":"2023-10-14T12:35:20.743254+0000","last_clean":"2023-10-14T12:35:20.743254+0000","last_became_active":"2023-10-14T12:34:43.738785+0000","last_became_peered":"2023-10-14T12:34:43.738785+0000","last_unstale":"2023-10-14T12:35:20.743254+0000","last_undegraded":"2023-10-14T12:35:20.743254+0000","last_fullsized":"2023-10-14T12:35:20.743254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:03.525531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:03.525531+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.525531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:59:03.692561+0000","scrub_duration":0.001920871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:31.533841+0000","last_change":"2023-10-14T12:35:31.533890+0000","last_active":"2023-10-14T12:35:31.533841+0000","last_peered":"2023-10-14T12:35:31.533841+0000","last_clean":"2023-10-14T12:35:31.533841+0000","last_became_active":"2023-10-14T12:34:44.768087+0000","last_became_peered":"2023-10-14T12:34:44.768087+0000","last_unstale":"2023-10-14T12:35:31.533841+0000","last_undegraded":"2023-10-14T12:35:31.533841+0000","last_fullsized":"2023-10-14T12:35:31.533841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:31.533743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:31.533743+0000","last_clean_scrub_stamp":"2023-10-14T12:35:31.533743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:08.729604+0000","scrub_duration":0.001859596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742766+0000","last_change":"2023-10-14T12:35:13.929420+0000","last_active":"2023-10-14T12:35:20.742766+0000","last_peered":"2023-10-14T12:35:20.742766+0000","last_clean":"2023-10-14T12:35:20.742766+0000","last_became_active":"2023-10-14T12:34:43.738748+0000","last_became_peered":"2023-10-14T12:34:43.738748+0000","last_unstale":"2023-10-14T12:35:20.742766+0000","last_undegraded":"2023-10-14T12:35:20.742766+0000","last_fullsized":"2023-10-14T12:35:20.742766+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2023-10-14T12:35:13.929259+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2023-10-14T12:35:13.929259+0000","last_clean_scrub_stamp":"2023-10-14T12:35:13.929259+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:34:16.370492+0000","scrub_duration":0.0017402209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743418+0000","last_change":"2023-10-14T12:35:14.626155+0000","last_active":"2023-10-14T12:35:20.743418+0000","last_peered":"2023-10-14T12:35:20.743418+0000","last_clean":"2023-10-14T12:35:20.743418+0000","last_became_active":"2023-10-14T12:34:44.760736+0000","last_became_peered":"2023-10-14T12:34:44.760736+0000","last_unstale":"2023-10-14T12:35:20.743418+0000","last_undegraded":"2023-10-14T12:35:20.743418+0000","last_fullsized":"2023-10-14T12:35:20.743418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:14.625962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:14.625962+0000","last_clean_scrub_stamp":"2023-10-14T12:35:14.625962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:40.181761+0000","scrub_duration":0.0022190119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741962+0000","last_change":"2023-10-14T12:35:09.900686+0000","last_active":"2023-10-14T12:35:20.741962+0000","last_peered":"2023-10-14T12:35:20.741962+0000","last_clean":"2023-10-14T12:35:20.741962+0000","last_became_active":"2023-10-14T12:34:43.738856+0000","last_became_peered":"2023-10-14T12:34:43.738856+0000","last_unstale":"2023-10-14T12:35:20.741962+0000","last_undegraded":"2023-10-14T12:35:20.741962+0000","last_fullsized":"2023-10-14T12:35:20.741962+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:09.900545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:09.900545+0000","last_clean_scrub_stamp":"2023-10-14T12:35:09.900545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:44:10.260487+0000","scrub_duration":0.0017821200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:33.006081+0000","last_change":"2023-10-14T12:35:33.006130+0000","last_active":"2023-10-14T12:35:33.006081+0000","last_peered":"2023-10-14T12:35:33.006081+0000","last_clean":"2023-10-14T12:35:33.006081+0000","last_became_active":"2023-10-14T12:34:44.764069+0000","last_became_peered":"2023-10-14T12:34:44.764069+0000","last_unstale":"2023-10-14T12:35:33.006081+0000","last_undegraded":"2023-10-14T12:35:33.006081+0000","last_fullsized":"2023-10-14T12:35:33.006081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:33.005986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:33.005986+0000","last_clean_scrub_stamp":"2023-10-14T12:35:33.005986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:53:38.824740+0000","scrub_duration":0.001434992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:27.519272+0000","last_change":"2023-10-14T12:35:27.519314+0000","last_active":"2023-10-14T12:35:27.519272+0000","last_peered":"2023-10-14T12:35:27.519272+0000","last_clean":"2023-10-14T12:35:27.519272+0000","last_became_active":"2023-10-14T12:34:43.747556+0000","last_became_peered":"2023-10-14T12:34:43.747556+0000","last_unstale":"2023-10-14T12:35:27.519272+0000","last_undegraded":"2023-10-14T12:35:27.519272+0000","last_fullsized":"2023-10-14T12:35:27.519272+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:27.519175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:27.519175+0000","last_clean_scrub_stamp":"2023-10-14T12:35:27.519175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:02:26.440662+0000","scrub_duration":0.0014840750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742108+0000","last_change":"2023-10-14T12:35:19.675606+0000","last_active":"2023-10-14T12:35:20.742108+0000","last_peered":"2023-10-14T12:35:20.742108+0000","last_clean":"2023-10-14T12:35:20.742108+0000","last_became_active":"2023-10-14T12:34:44.767802+0000","last_became_peered":"2023-10-14T12:34:44.767802+0000","last_unstale":"2023-10-14T12:35:20.742108+0000","last_undegraded":"2023-10-14T12:35:20.742108+0000","last_fullsized":"2023-10-14T12:35:20.742108+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:19.675479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:19.675479+0000","last_clean_scrub_stamp":"2023-10-14T12:35:19.675479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:49:09.087024+0000","scrub_duration":0.001720671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742406+0000","last_change":"2023-10-14T12:35:05.914546+0000","last_active":"2023-10-14T12:35:20.742406+0000","last_peered":"2023-10-14T12:35:20.742406+0000","last_clean":"2023-10-14T12:35:20.742406+0000","last_became_active":"2023-10-14T12:34:43.737250+0000","last_became_peered":"2023-10-14T12:34:43.737250+0000","last_unstale":"2023-10-14T12:35:20.742406+0000","last_undegraded":"2023-10-14T12:35:20.742406+0000","last_fullsized":"2023-10-14T12:35:20.742406+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:05.914344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:05.914344+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.914344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:45.061194+0000","scrub_duration":0.001652747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:23.539005+0000","last_change":"2023-10-14T12:35:23.539056+0000","last_active":"2023-10-14T12:35:23.539005+0000","last_peered":"2023-10-14T12:35:23.539005+0000","last_clean":"2023-10-14T12:35:23.539005+0000","last_became_active":"2023-10-14T12:34:44.768177+0000","last_became_peered":"2023-10-14T12:34:44.768177+0000","last_unstale":"2023-10-14T12:35:23.539005+0000","last_undegraded":"2023-10-14T12:35:23.539005+0000","last_fullsized":"2023-10-14T12:35:23.539005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:23.538899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:23.538899+0000","last_clean_scrub_stamp":"2023-10-14T12:35:23.538899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:49.693570+0000","scrub_duration":0.001906324,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'3","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.742179+0000","last_change":"2023-10-14T12:35:15.881787+0000","last_active":"2023-10-14T12:35:20.742179+0000","last_peered":"2023-10-14T12:35:20.742179+0000","last_clean":"2023-10-14T12:35:20.742179+0000","last_became_active":"2023-10-14T12:34:43.735431+0000","last_became_peered":"2023-10-14T12:34:43.735431+0000","last_unstale":"2023-10-14T12:35:20.742179+0000","last_undegraded":"2023-10-14T12:35:20.742179+0000","last_fullsized":"2023-10-14T12:35:20.742179+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2023-10-14T12:35:15.881615+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2023-10-14T12:35:15.881615+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.881615+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:36:52.773478+0000","scrub_duration":0.00320886,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:56.371160+0000","last_change":"2023-10-14T12:35:56.371204+0000","last_active":"2023-10-14T12:35:56.371160+0000","last_peered":"2023-10-14T12:35:56.371160+0000","last_clean":"2023-10-14T12:35:56.371160+0000","last_became_active":"2023-10-14T12:34:44.761519+0000","last_became_peered":"2023-10-14T12:34:44.761519+0000","last_unstale":"2023-10-14T12:35:56.371160+0000","last_undegraded":"2023-10-14T12:35:56.371160+0000","last_fullsized":"2023-10-14T12:35:56.371160+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:56.371058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:56.371058+0000","last_clean_scrub_stamp":"2023-10-14T12:35:56.371058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:27:54.697558+0000","scrub_duration":0.0015854809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743256+0000","last_change":"2023-10-14T12:35:15.845814+0000","last_active":"2023-10-14T12:35:20.743256+0000","last_peered":"2023-10-14T12:35:20.743256+0000","last_clean":"2023-10-14T12:35:20.743256+0000","last_became_active":"2023-10-14T12:34:43.735483+0000","last_became_peered":"2023-10-14T12:34:43.735483+0000","last_unstale":"2023-10-14T12:35:20.743256+0000","last_undegraded":"2023-10-14T12:35:20.743256+0000","last_fullsized":"2023-10-14T12:35:20.743256+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2023-10-14T12:35:15.845658+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2023-10-14T12:35:15.845658+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.845658+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:10:06.760055+0000","scrub_duration":0.0023631170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:22.633234+0000","last_change":"2023-10-14T12:35:22.633308+0000","last_active":"2023-10-14T12:35:22.633234+0000","last_peered":"2023-10-14T12:35:22.633234+0000","last_clean":"2023-10-14T12:35:22.633234+0000","last_became_active":"2023-10-14T12:34:44.775820+0000","last_became_peered":"2023-10-14T12:34:44.775820+0000","last_unstale":"2023-10-14T12:35:22.633234+0000","last_undegraded":"2023-10-14T12:35:22.633234+0000","last_fullsized":"2023-10-14T12:35:22.633234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:22.633132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:22.633132+0000","last_clean_scrub_stamp":"2023-10-14T12:35:22.633132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:57:24.694245+0000","scrub_duration":0.001910274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743905+0000","last_change":"2023-10-14T12:35:05.605138+0000","last_active":"2023-10-14T12:35:20.743905+0000","last_peered":"2023-10-14T12:35:20.743905+0000","last_clean":"2023-10-14T12:35:20.743905+0000","last_became_active":"2023-10-14T12:34:43.736531+0000","last_became_peered":"2023-10-14T12:34:43.736531+0000","last_unstale":"2023-10-14T12:35:20.743905+0000","last_undegraded":"2023-10-14T12:35:20.743905+0000","last_fullsized":"2023-10-14T12:35:20.743905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:05.604984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:05.604984+0000","last_clean_scrub_stamp":"2023-10-14T12:35:05.604984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:30:38.495119+0000","scrub_duration":0.0016590349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741774+0000","last_change":"2023-10-14T12:35:15.622628+0000","last_active":"2023-10-14T12:35:20.741774+0000","last_peered":"2023-10-14T12:35:20.741774+0000","last_clean":"2023-10-14T12:35:20.741774+0000","last_became_active":"2023-10-14T12:34:44.769173+0000","last_became_peered":"2023-10-14T12:34:44.769173+0000","last_unstale":"2023-10-14T12:35:20.741774+0000","last_undegraded":"2023-10-14T12:35:20.741774+0000","last_fullsized":"2023-10-14T12:35:20.741774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:15.622472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:15.622472+0000","last_clean_scrub_stamp":"2023-10-14T12:35:15.622472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:38:49.901940+0000","scrub_duration":0.001455278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.743693+0000","last_change":"2023-10-14T12:35:03.610518+0000","last_active":"2023-10-14T12:35:20.743693+0000","last_peered":"2023-10-14T12:35:20.743693+0000","last_clean":"2023-10-14T12:35:20.743693+0000","last_became_active":"2023-10-14T12:34:43.736716+0000","last_became_peered":"2023-10-14T12:34:43.736716+0000","last_unstale":"2023-10-14T12:35:20.743693+0000","last_undegraded":"2023-10-14T12:35:20.743693+0000","last_fullsized":"2023-10-14T12:35:20.743693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:03.610375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:03.610375+0000","last_clean_scrub_stamp":"2023-10-14T12:35:03.610375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:32:24.974482+0000","scrub_duration":0.0018719749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:27.584571+0000","last_change":"2023-10-14T12:35:27.584618+0000","last_active":"2023-10-14T12:35:27.584571+0000","last_peered":"2023-10-14T12:35:27.584571+0000","last_clean":"2023-10-14T12:35:27.584571+0000","last_became_active":"2023-10-14T12:34:44.763069+0000","last_became_peered":"2023-10-14T12:34:44.763069+0000","last_unstale":"2023-10-14T12:35:27.584571+0000","last_undegraded":"2023-10-14T12:35:27.584571+0000","last_fullsized":"2023-10-14T12:35:27.584571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:27.584475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:27.584475+0000","last_clean_scrub_stamp":"2023-10-14T12:35:27.584475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:08:53.296758+0000","scrub_duration":0.0020698489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.611476+0000","last_change":"2023-10-14T12:35:04.330533+0000","last_active":"2023-10-14T12:35:20.611476+0000","last_peered":"2023-10-14T12:35:20.611476+0000","last_clean":"2023-10-14T12:35:20.611476+0000","last_became_active":"2023-10-14T12:34:43.740426+0000","last_became_peered":"2023-10-14T12:34:43.740426+0000","last_unstale":"2023-10-14T12:35:20.611476+0000","last_undegraded":"2023-10-14T12:35:20.611476+0000","last_fullsized":"2023-10-14T12:35:20.611476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:04.330386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:04.330386+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.330386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:53:14.339845+0000","scrub_duration":0.0017371279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610813+0000","last_change":"2023-10-14T12:35:12.451419+0000","last_active":"2023-10-14T12:35:20.610813+0000","last_peered":"2023-10-14T12:35:20.610813+0000","last_clean":"2023-10-14T12:35:20.610813+0000","last_became_active":"2023-10-14T12:34:44.769543+0000","last_became_peered":"2023-10-14T12:34:44.769543+0000","last_unstale":"2023-10-14T12:35:20.610813+0000","last_undegraded":"2023-10-14T12:35:20.610813+0000","last_fullsized":"2023-10-14T12:35:20.610813+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:12.451259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:12.451259+0000","last_clean_scrub_stamp":"2023-10-14T12:35:12.451259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:23.328462+0000","scrub_duration":0.0019754809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.610478+0000","last_change":"2023-10-14T12:35:04.490936+0000","last_active":"2023-10-14T12:35:20.610478+0000","last_peered":"2023-10-14T12:35:20.610478+0000","last_clean":"2023-10-14T12:35:20.610478+0000","last_became_active":"2023-10-14T12:34:43.737417+0000","last_became_peered":"2023-10-14T12:34:43.737417+0000","last_unstale":"2023-10-14T12:35:20.610478+0000","last_undegraded":"2023-10-14T12:35:20.610478+0000","last_fullsized":"2023-10-14T12:35:20.610478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:04.490807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:04.490807+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.490807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:29.942190+0000","scrub_duration":0.0015209589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:29.542752+0000","last_change":"2023-10-14T12:35:29.542800+0000","last_active":"2023-10-14T12:35:29.542752+0000","last_peered":"2023-10-14T12:35:29.542752+0000","last_clean":"2023-10-14T12:35:29.542752+0000","last_became_active":"2023-10-14T12:34:44.764567+0000","last_became_peered":"2023-10-14T12:34:44.764567+0000","last_unstale":"2023-10-14T12:35:29.542752+0000","last_undegraded":"2023-10-14T12:35:29.542752+0000","last_fullsized":"2023-10-14T12:35:29.542752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:29.542636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:29.542636+0000","last_clean_scrub_stamp":"2023-10-14T12:35:29.542636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:49:24.097663+0000","scrub_duration":0.0015181229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.741976+0000","last_change":"2023-10-14T12:35:04.589228+0000","last_active":"2023-10-14T12:35:20.741976+0000","last_peered":"2023-10-14T12:35:20.741976+0000","last_clean":"2023-10-14T12:35:20.741976+0000","last_became_active":"2023-10-14T12:34:43.732893+0000","last_became_peered":"2023-10-14T12:34:43.732893+0000","last_unstale":"2023-10-14T12:35:20.741976+0000","last_undegraded":"2023-10-14T12:35:20.741976+0000","last_fullsized":"2023-10-14T12:35:20.741976+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:04.589107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:04.589107+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.589107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:30.144906+0000","scrub_duration":0.0012057680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:40.959341+0000","last_change":"2023-10-14T12:35:40.959394+0000","last_active":"2023-10-14T12:35:40.959341+0000","last_peered":"2023-10-14T12:35:40.959341+0000","last_clean":"2023-10-14T12:35:40.959341+0000","last_became_active":"2023-10-14T12:34:44.766080+0000","last_became_peered":"2023-10-14T12:34:44.766080+0000","last_unstale":"2023-10-14T12:35:40.959341+0000","last_undegraded":"2023-10-14T12:35:40.959341+0000","last_fullsized":"2023-10-14T12:35:40.959341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:40.959247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:40.959247+0000","last_clean_scrub_stamp":"2023-10-14T12:35:40.959247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:27:39.285746+0000","scrub_duration":0.0021571429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:35:20.612663+0000","last_change":"2023-10-14T12:35:16.631166+0000","last_active":"2023-10-14T12:35:20.612663+0000","last_peered":"2023-10-14T12:35:20.612663+0000","last_clean":"2023-10-14T12:35:20.612663+0000","last_became_active":"2023-10-14T12:34:43.744694+0000","last_became_peered":"2023-10-14T12:34:43.744694+0000","last_unstale":"2023-10-14T12:35:20.612663+0000","last_undegraded":"2023-10-14T12:35:20.612663+0000","last_fullsized":"2023-10-14T12:35:20.612663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:35:16.630985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:35:16.630985+0000","last_clean_scrub_stamp":"2023-10-14T12:35:16.630985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:01:42.785656+0000","scrub_duration":0.00178429,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"38'119","reported_seq":197,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:35:21.621714+0000","last_change":"2023-10-14T12:35:04.512686+0000","last_active":"2023-10-14T12:35:21.621714+0000","last_peered":"2023-10-14T12:35:21.621714+0000","last_clean":"2023-10-14T12:35:21.621714+0000","last_became_active":"2023-10-14T12:33:27.350774+0000","last_became_peered":"2023-10-14T12:33:27.350774+0000","last_unstale":"2023-10-14T12:35:21.621714+0000","last_undegraded":"2023-10-14T12:35:21.621714+0000","last_fullsized":"2023-10-14T12:35:21.621714+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2023-10-14T12:35:04.512543+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2023-10-14T12:35:04.512543+0000","last_clean_scrub_stamp":"2023-10-14T12:35:04.512543+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:28:08.784381+0000","scrub_duration":0.0047596390000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":793928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.499,"15min":0.48799999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.65200000000000002}]},{"osd":1,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77100000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.47799999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.624}]},{"osd":2,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.50700000000000001,"15min":0.495},"min":{"1min":0.38800000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72999999999999998,"5min":1.48,"15min":1.48},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.4650000000000001,"5min":0.74299999999999999,"15min":0.623},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":19.899000000000001,"5min":19.899000000000001,"15min":19.899000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.495,"15min":0.497},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60699999999999998,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51900000000000002}]},{"osd":5,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.54000000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72299999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":0.751,"15min":0.751},"last":0.54900000000000004}]},{"osd":6,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57799999999999996,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.59699999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":466944,"data_stored":202460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67600000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.42899999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.47099999999999997},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71299999999999997,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67500000000000004}]},{"osd":2,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73099999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.52500000000000002},"min":{"1min":0.44,"5min":0.374,"15min":0.374},"max":{"1min":0.72999999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.434,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.74199999999999999,"5min":1.863,"15min":1.863},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.58099999999999996},"min":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77000000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.877,"5min":1.079,"15min":1.079},"last":0.40600000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71399999999999997,"5min":1.179,"15min":1.179},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.748,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59899999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60599999999999998,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.85099999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.71499999999999997,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.50700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":466944,"data_stored":201968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33400000000000002,"15min":0.33000000000000002},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33100000000000002,"15min":0.32700000000000001},"min":{"1min":0.23300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.40200000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.317,"15min":0.31},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.35799999999999998},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38300000000000001,"15min":0.378},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.27200000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.442,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.874,"15min":0.874},"last":0.753},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.57199999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.84999999999999998}]},{"osd":5,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60199999999999998,"15min":0.59399999999999997},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85299999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.59799999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76700000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.56399999999999995,"15min":0.55500000000000005},"min":{"1min":0.46300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.83599999999999997}]},{"osd":7,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58499999999999996,"15min":0.57599999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91100000000000003,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.628,"15min":0.624},"min":{"1min":0.45600000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89600000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.80900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1060864,"data_stored":792280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":1.403,"15min":1.581},"min":{"1min":0.23100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.496,"5min":26.047000000000001,"15min":26.047000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.79300000000000004,"15min":0.86399999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.53500000000000003,"5min":11.007,"15min":11.007},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":1.4259999999999999,"15min":1.603},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.45700000000000002,"5min":26.007999999999999,"15min":26.007999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.371,"15min":0.36699999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.434}]},{"osd":3,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":1.0349999999999999,"15min":1.143},"min":{"1min":0.28599999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54500000000000004,"5min":16.370999999999999,"15min":16.370999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.436,"5min":1.079,"15min":1.1859999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.56000000000000005,"5min":16.413,"15min":16.413},"last":0.41699999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79100000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":1.2629999999999999,"15min":1.375},"min":{"1min":0.40500000000000003,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.72399999999999998,"5min":16.521999999999998,"15min":16.521999999999998},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":1.246,"15min":1.357},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.755,"5min":16.577999999999999,"15min":16.577999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":1.2509999999999999,"15min":1.359},"min":{"1min":0.46999999999999997,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.752,"5min":16.489000000000001,"15min":16.489000000000001},"last":0.73399999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":1.2629999999999999,"15min":1.375},"min":{"1min":0.42899999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.73999999999999999,"5min":16.456,"15min":16.456},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.625,"15min":0.63},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77600000000000002,"5min":1.018,"15min":1.018},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.622,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.76000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":1.256,"15min":1.3680000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72499999999999998,"5min":16.550999999999998,"15min":16.550999999999998},"last":0.61599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":466944,"data_stored":201948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.70299999999999996,"15min":0.75700000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.67300000000000004,"5min":8.3949999999999996,"15min":8.3949999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":1.0549999999999999,"15min":1.165},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57999999999999996,"5min":16.146000000000001,"15min":16.146000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.71099999999999997,"15min":0.76300000000000001},"min":{"1min":0.28799999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55600000000000005,"5min":8.3249999999999993,"15min":8.3249999999999993},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.39700000000000002,"5min":1.0820000000000001,"15min":1.196},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53200000000000003,"5min":16.173999999999999,"15min":16.173999999999999},"last":0.47399999999999998}]},{"osd":3,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.56799999999999995,"15min":0.59599999999999997},"min":{"1min":0.26600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52400000000000002,"5min":5.2229999999999999,"15min":5.2229999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.76000000000000001,"15min":0.81399999999999995},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56200000000000006,"5min":8.5150000000000006,"15min":8.5150000000000006},"last":0.44500000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":1.2350000000000001,"15min":1.343},"min":{"1min":0.443,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72999999999999998,"5min":16.047999999999998,"15min":16.047999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.74099999999999999,"15min":0.76700000000000002},"min":{"1min":0.46400000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.873,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.92700000000000005,"15min":0.97899999999999998},"min":{"1min":0.46700000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.78500000000000003,"5min":8.452,"15min":8.452},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":1.2769999999999999,"15min":1.391},"min":{"1min":0.46800000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81599999999999995,"5min":16.117000000000001,"15min":16.117000000000001},"last":0.56599999999999995}]},{"osd":6,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.748,"15min":0.77800000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.73999999999999999,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.623},{"interface":"front","average":{"1min":0.628,"5min":0.93000000000000005,"15min":0.97999999999999998},"min":{"1min":0.49399999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.55500000000000005}]},{"osd":7,"last update":"Sat Oct 14 12:35:30 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":1.3149999999999999,"15min":1.429},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80400000000000005,"5min":16.088000000000001,"15min":16.088000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.80200000000000005,"15min":0.82799999999999996},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83099999999999996,"5min":4.4649999999999999,"15min":4.4649999999999999},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":203524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.33400000000000002,"15min":0.33600000000000002},"min":{"1min":0.20899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.48699999999999999,"5min":0.498,"15min":0.498},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34300000000000003},"min":{"1min":0.255,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.38300000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.36799999999999999,"15min":0.36699999999999999},"min":{"1min":0.24099999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.66600000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61799999999999999,"5min":1.052,"15min":1.052},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.40400000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.60799999999999998,"5min":0.62,"15min":0.62},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.433,"15min":0.433},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61199999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48299999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76500000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.52900000000000003}]},{"osd":5,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.623,"15min":0.629},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80600000000000005,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92600000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86099999999999999,"5min":1.298,"15min":1.298},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Oct 14 12:35:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.79800000000000004,"5min":1.272,"15min":1.272},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.88100000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.621}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":471040,"data_stored":202482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.51700000000000002,"15min":0.504},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.745,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.751,"15min":0.77500000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78400000000000003,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.40699999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.745,"5min":0.874,"15min":0.874},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.47199999999999998,"15min":0.45600000000000002},"min":{"1min":0.41299999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80800000000000005,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.40799999999999997}]},{"osd":3,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.76300000000000001,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.624},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84899999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.436}]},{"osd":5,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65500000000000003,"15min":0.66400000000000003},"min":{"1min":0.36699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83899999999999997,"5min":3.4580000000000002,"15min":3.4580000000000002},"last":0.44900000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88600000000000001,"5min":1.26,"15min":1.26},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.44900000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56999999999999995}]},{"osd":7,"last update":"Sat Oct 14 12:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.73499999999999999,"15min":0.75600000000000001},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89400000000000002,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64400000000000002,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.60099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":471040,"data_stored":201990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.82099999999999995,"15min":0.875},"min":{"1min":0.31900000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70799999999999996,"5min":9,"15min":9},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71799999999999997,"5min":1.054,"15min":1.054},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.67000000000000004,"15min":0.69599999999999995},"min":{"1min":0.38600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.63500000000000001,"5min":4.9589999999999996,"15min":4.9589999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71299999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.76000000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.45000000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.997,"15min":0.997},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70999999999999996,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.42099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.41399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.746}]},{"osd":4,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.51500000000000001},"min":{"1min":0.33800000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.374},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.42599999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.84899999999999998,"5min":0.873,"15min":0.873},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.58699999999999997,"15min":0.59799999999999998},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71199999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.52900000000000003}]},{"osd":7,"last update":"Sat Oct 14 12:35:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.63400000000000001,"15min":0.64600000000000002},"min":{"1min":0.373,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79300000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.81799999999999995,"5min":1.159,"15min":1.159},"last":0.64300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:36:05.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T12:36:05.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.473+0000 7f3d62a49700 1 Processor -- start 2023-10-14T12:36:05.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.473+0000 7f3d62a49700 1 -- start start 2023-10-14T12:36:05.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d62a49700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d5c15a250 0x7f3d5c0717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d62a49700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d5c15dec0 0x7f3d5c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d62a49700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15e350 0x7f3d5c06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d62a49700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0cb510 con 0x7f3d5c15a250 2023-10-14T12:36:05.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d62a49700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0cba90 con 0x7f3d5c15dec0 2023-10-14T12:36:05.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d62a49700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c15ee40 con 0x7f3d5c15e350 2023-10-14T12:36:05.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d5bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d5c15a250 0x7f3d5c0717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d5bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d5c15a250 0x7f3d5c0717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49252/0 (socket says 172.21.15.72:49252) 2023-10-14T12:36:05.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d5bfff700 1 -- 172.21.15.72:0/2419532238 learned_addr learned my addr 172.21.15.72:0/2419532238 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:36:05.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d5b7fe700 1 --2- 172.21.15.72:0/2419532238 >> v2:172.21.15.123:3300/0 conn(0x7f3d5c15dec0 0x7f3d5c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d60fe6700 1 --2- 172.21.15.72:0/2419532238 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15e350 0x7f3d5c06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d5bfff700 1 -- 172.21.15.72:0/2419532238 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15e350 msgr2=0x7f3d5c06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:36:05.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d5bfff700 1 --2- 172.21.15.72:0/2419532238 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15e350 0x7f3d5c06daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d5bfff700 1 -- 172.21.15.72:0/2419532238 >> v2:172.21.15.123:3300/0 conn(0x7f3d5c15dec0 msgr2=0x7f3d5c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:36:05.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d5bfff700 1 --2- 172.21.15.72:0/2419532238 >> v2:172.21.15.123:3300/0 conn(0x7f3d5c15dec0 0x7f3d5c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.474+0000 7f3d5bfff700 1 -- 172.21.15.72:0/2419532238 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c15e880 con 0x7f3d5c15a250 2023-10-14T12:36:05.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d5bfff700 1 --2- 172.21.15.72:0/2419532238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15a250 0x7f3d5c0717b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0af840 tx=0x7f3d5000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728d1c34d23b0411 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:36:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d5affd700 1 -- 172.21.15.72:0/2419532238 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000dc70 con 0x7f3d5c15a250 2023-10-14T12:36:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d5affd700 1 -- 172.21.15.72:0/2419532238 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5000ddd0 con 0x7f3d5c15a250 2023-10-14T12:36:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d5affd700 1 -- 172.21.15.72:0/2419532238 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50010690 con 0x7f3d5c15a250 2023-10-14T12:36:05.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d62a49700 1 -- 172.21.15.72:0/2419532238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15a250 msgr2=0x7f3d5c0717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d62a49700 1 --2- 172.21.15.72:0/2419532238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15a250 0x7f3d5c0717b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0af840 tx=0x7f3d5000be70 comp rx=0 tx=0).stop 2023-10-14T12:36:05.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d62a49700 1 -- 172.21.15.72:0/2419532238 shutdown_connections 2023-10-14T12:36:05.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d62a49700 1 --2- 172.21.15.72:0/2419532238 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15e350 0x7f3d5c06daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d62a49700 1 --2- 172.21.15.72:0/2419532238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15a250 0x7f3d5c0717b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d62a49700 1 --2- 172.21.15.72:0/2419532238 >> v2:172.21.15.123:3300/0 conn(0x7f3d5c15dec0 0x7f3d5c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d62a49700 1 -- 172.21.15.72:0/2419532238 >> 172.21.15.72:0/2419532238 conn(0x7f3d5c0ccbe0 msgr2=0x7f3d5c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:36:05.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d62a49700 1 -- 172.21.15.72:0/2419532238 shutdown_connections 2023-10-14T12:36:05.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.475+0000 7f3d62a49700 1 -- 172.21.15.72:0/2419532238 wait complete. 2023-10-14T12:36:05.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.477+0000 7f3d62a49700 1 Processor -- start 2023-10-14T12:36:05.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.477+0000 7f3d62a49700 1 -- start start 2023-10-14T12:36:05.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.477+0000 7f3d62a49700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15a250 0x7f3d5c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.477+0000 7f3d62a49700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15dec0 0x7f3d5c0aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.477+0000 7f3d62a49700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d5c15e350 0x7f3d5c0c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.477+0000 7f3d62a49700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0acbf0 con 0x7f3d5c15dec0 2023-10-14T12:36:05.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.477+0000 7f3d62a49700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0aced0 con 0x7f3d5c15e350 2023-10-14T12:36:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.477+0000 7f3d62a49700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0ad1b0 con 0x7f3d5c15a250 2023-10-14T12:36:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15dec0 0x7f3d5c0aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15dec0 0x7f3d5c0aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49260/0 (socket says 172.21.15.72:49260) 2023-10-14T12:36:05.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5b7fe700 1 -- 172.21.15.72:0/4270150663 learned_addr learned my addr 172.21.15.72:0/4270150663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:36:05.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d60fe6700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d5c15e350 0x7f3d5c0c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5bfff700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15a250 0x7f3d5c0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5b7fe700 1 -- 172.21.15.72:0/4270150663 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15a250 msgr2=0x7f3d5c0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5b7fe700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15a250 0x7f3d5c0adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5b7fe700 1 -- 172.21.15.72:0/4270150663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d5c15e350 msgr2=0x7f3d5c0c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5b7fe700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d5c15e350 0x7f3d5c0c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5b7fe700 1 -- 172.21.15.72:0/4270150663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5000b7f0 con 0x7f3d5c15dec0 2023-10-14T12:36:05.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5bfff700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15a250 0x7f3d5c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:36:05.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d5b7fe700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15dec0 0x7f3d5c0aecd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00e9b0 tx=0x7f3d4c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:36:05.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d58ff9700 1 -- 172.21.15.72:0/4270150663 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c009710 con 0x7f3d5c15dec0 2023-10-14T12:36:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d58ff9700 1 -- 172.21.15.72:0/4270150663 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c00c850 con 0x7f3d5c15dec0 2023-10-14T12:36:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c0ad490 con 0x7f3d5c15dec0 2023-10-14T12:36:05.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d58ff9700 1 -- 172.21.15.72:0/4270150663 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c00cbc0 con 0x7f3d5c15dec0 2023-10-14T12:36:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.478+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c0ac8c0 con 0x7f3d5c15dec0 2023-10-14T12:36:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.479+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c04ebb0 con 0x7f3d5c15dec0 2023-10-14T12:36:05.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.480+0000 7f3d58ff9700 1 -- 172.21.15.72:0/4270150663 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d4c00cd20 con 0x7f3d5c15dec0 2023-10-14T12:36:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.480+0000 7f3d58ff9700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d4806af00 0x7f3d4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.480+0000 7f3d58ff9700 1 -- 172.21.15.72:0/4270150663 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f3d4c089840 con 0x7f3d5c15dec0 2023-10-14T12:36:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.480+0000 7f3d5bfff700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d4806af00 0x7f3d4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.480+0000 7f3d5bfff700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d4806af00 0x7f3d4806d3c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000beb0 tx=0x7f3d5001b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:36:05.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.484+0000 7f3d58ff9700 1 -- 172.21.15.72:0/4270150663 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d4c054780 con 0x7f3d5c15dec0 2023-10-14T12:36:05.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.675+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3d5c0b60e0 con 0x7f3d5c15dec0 2023-10-14T12:36:05.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.678+0000 7f3d58ff9700 1 -- 172.21.15.72:0/4270150663 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3d4c0210c0 con 0x7f3d5c15dec0 2023-10-14T12:36:05.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.680+0000 7f3d58ff9700 1 -- 172.21.15.72:0/4270150663 <== mon.0 v2:172.21.15.72:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3d4c054780 con 0x7f3d5c15dec0 2023-10-14T12:36:05.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d4806af00 msgr2=0x7f3d4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d4806af00 0x7f3d4806d3c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000beb0 tx=0x7f3d5001b040 comp rx=0 tx=0).stop 2023-10-14T12:36:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15dec0 msgr2=0x7f3d5c0aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15dec0 0x7f3d5c0aecd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00e9b0 tx=0x7f3d4c00ed70 comp rx=0 tx=0).stop 2023-10-14T12:36:05.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 shutdown_connections 2023-10-14T12:36:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f3d4806af00 0x7f3d4806d3c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d5c15e350 0x7f3d5c0c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f3d5c15a250 0x7f3d5c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 --2- 172.21.15.72:0/4270150663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d5c15dec0 0x7f3d5c0aecd0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 >> 172.21.15.72:0/4270150663 conn(0x7f3d5c0ccbe0 msgr2=0x7f3d5c06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:36:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 shutdown_connections 2023-10-14T12:36:05.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.681+0000 7f3d62a49700 1 -- 172.21.15.72:0/4270150663 wait complete. 2023-10-14T12:36:05.693 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T12:36:05.694 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:36:05.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.815+0000 7f5fea9b1700 1 Processor -- start 2023-10-14T12:36:05.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.815+0000 7f5fea9b1700 1 -- start start 2023-10-14T12:36:05.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.816+0000 7f5fea9b1700 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5fe406dce0 0x7f5fe40665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.816+0000 7f5fea9b1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe415dc40 con 0x7f5fe40cd6e0 2023-10-14T12:36:05.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.816+0000 7f5fea9b1700 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe406e230 con 0x7f5fe40caa00 2023-10-14T12:36:05.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.816+0000 7f5fea9b1700 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe406e510 con 0x7f5fe406dce0 2023-10-14T12:36:05.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.816+0000 7f5fe3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5fe40cd6e0 0x7f5fe40cdac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:55566/0 (socket says 172.21.15.72:55566) 2023-10-14T12:36:05.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.816+0000 7f5fe3fff700 1 -- 172.21.15.72:0/1929429208 learned_addr learned my addr 172.21.15.72:0/1929429208 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T12:36:05.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987184542 0 0) 0x7f5fe415dc40 con 0x7f5fe40cd6e0 2023-10-14T12:36:05.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd00035b0 con 0x7f5fe40cd6e0 2023-10-14T12:36:05.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe37fe700 1 --2- 172.21.15.72:0/1929429208 >> v2:172.21.15.123:3300/0 conn(0x7f5fe406dce0 0x7f5fe40665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2068473705 0 0) 0x7f5fd00035b0 con 0x7f5fe40cd6e0 2023-10-14T12:36:05.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 >> v2:172.21.15.123:3300/0 conn(0x7f5fe406dce0 msgr2=0x7f5fe40665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:36:05.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 --2- 172.21.15.72:0/1929429208 >> v2:172.21.15.123:3300/0 conn(0x7f5fe406dce0 0x7f5fe40665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 >> v1:172.21.15.123:6789/0 conn(0x7f5fe40caa00 legacy=0x7f5fe40caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:36:05.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe40ca200 con 0x7f5fe40cd6e0 2023-10-14T12:36:05.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1855532747 0 0) 0x7f5fd4001670 con 0x7f5fe40cd6e0 2023-10-14T12:36:05.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe37fe700 1 --2- 172.21.15.72:0/1929429208 >> v2:172.21.15.123:3300/0 conn(0x7f5fe406dce0 0x7f5fe40665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:36:05.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 >> v1:172.21.15.72:6789/0 conn(0x7f5fe40cd6e0 legacy=0x7f5fe40cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fd0003a00 0x7f5fd0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0004850 0x7f5fd0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd0005210 0x7f5fd000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe406e510 con 0x7f5fd0003a00 2023-10-14T12:36:05.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd000c140 con 0x7f5fd0005210 2023-10-14T12:36:05.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd000c300 con 0x7f5fd0004850 2023-10-14T12:36:05.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe3fff700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fd0003a00 0x7f5fd0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe8f4e700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd0005210 0x7f5fd000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe37fe700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0004850 0x7f5fd0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe3fff700 1 -- 172.21.15.72:0/1929429208 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0004850 msgr2=0x7f5fd0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:36:05.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe3fff700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0004850 0x7f5fd0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe3fff700 1 -- 172.21.15.72:0/1929429208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd0005210 msgr2=0x7f5fd000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:36:05.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe3fff700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fd0005210 0x7f5fd000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe3fff700 1 -- 172.21.15.72:0/1929429208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00035b0 con 0x7f5fd0003a00 2023-10-14T12:36:05.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe8f4e700 1 -- 172.21.15.72:0/1929429208 reap_dead start 2023-10-14T12:36:05.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe37fe700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0004850 0x7f5fd0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:36:05.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.817+0000 7f5fe3fff700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fd0003a00 0x7f5fd0003e00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4001eb0 tx=0x7f5fd0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f923cda557fc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:36:05.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400ce00 con 0x7f5fd0003a00 2023-10-14T12:36:05.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5fd4005960 con 0x7f5fd0003a00 2023-10-14T12:36:05.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fe2ffd700 1 -- 172.21.15.72:0/1929429208 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4005d30 con 0x7f5fd0003a00 2023-10-14T12:36:05.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fea9b1700 1 -- 172.21.15.72:0/1929429208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fd0003a00 msgr2=0x7f5fd0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fea9b1700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fd0003a00 0x7f5fd0003e00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4001eb0 tx=0x7f5fd0005880 comp rx=0 tx=0).stop 2023-10-14T12:36:05.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fea9b1700 1 -- 172.21.15.72:0/1929429208 shutdown_connections 2023-10-14T12:36:05.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fea9b1700 1 --2- 172.21.15.72:0/1929429208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fd0003a00 0x7f5fd0003e00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fea9b1700 1 -- 172.21.15.72:0/1929429208 >> 172.21.15.72:0/1929429208 conn(0x7f5fe40cc590 msgr2=0x7f5fe40cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:36:05.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fea9b1700 1 -- 172.21.15.72:0/1929429208 shutdown_connections 2023-10-14T12:36:05.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.818+0000 7f5fea9b1700 1 -- 172.21.15.72:0/1929429208 wait complete. 2023-10-14T12:36:05.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.819+0000 7f5fea9b1700 1 Processor -- start 2023-10-14T12:36:05.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fea9b1700 1 -- start start 2023-10-14T12:36:05.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fea9b1700 1 --2- >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0003a00 0x7f5fe40b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fea9b1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fe40b2d30 0x7f5fe40b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fea9b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe40b4a10 0x7f5fe40b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fea9b1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe415f890 con 0x7f5fe40b2d30 2023-10-14T12:36:05.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fea9b1700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe414da20 con 0x7f5fe40b4a10 2023-10-14T12:36:05.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fea9b1700 1 -- --> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40b53b0 con 0x7f5fd0003a00 2023-10-14T12:36:05.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fe37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fe40b2d30 0x7f5fe40b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fe37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fe40b2d30 0x7f5fe40b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:49280/0 (socket says 172.21.15.72:49280) 2023-10-14T12:36:05.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fe37fe700 1 -- 172.21.15.72:0/111001797 learned_addr learned my addr 172.21.15.72:0/111001797 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T12:36:05.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.820+0000 7f5fe3fff700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0003a00 0x7f5fe40b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe8f4e700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe40b4a10 0x7f5fe40b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe37fe700 1 -- 172.21.15.72:0/111001797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0003a00 msgr2=0x7f5fe40b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe37fe700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0003a00 0x7f5fe40b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe37fe700 1 -- 172.21.15.72:0/111001797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe40b4a10 msgr2=0x7f5fe40b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:05.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe37fe700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe40b4a10 0x7f5fe40b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:05.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe37fe700 1 -- 172.21.15.72:0/111001797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe415fae0 con 0x7f5fe40b2d30 2023-10-14T12:36:05.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe37fe700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fe40b2d30 0x7f5fe40b44d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc010870 tx=0x7f5fcc010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:36:05.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe0ff9700 1 -- 172.21.15.72:0/111001797 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00e860 con 0x7f5fe40b2d30 2023-10-14T12:36:05.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe0ff9700 1 -- 172.21.15.72:0/111001797 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5fcc00c050 con 0x7f5fe40b2d30 2023-10-14T12:36:05.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fe0ff9700 1 -- 172.21.15.72:0/111001797 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00ebc0 con 0x7f5fe40b2d30 2023-10-14T12:36:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe415fdc0 con 0x7f5fe40b2d30 2023-10-14T12:36:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.821+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe4160380 con 0x7f5fe40b2d30 2023-10-14T12:36:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.822+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe41606f0 con 0x7f5fe40b2d30 2023-10-14T12:36:05.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.822+0000 7f5fe0ff9700 1 -- 172.21.15.72:0/111001797 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5fcc00ed20 con 0x7f5fe40b2d30 2023-10-14T12:36:05.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.823+0000 7f5fe0ff9700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5fc406af00 0x7f5fc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:36:05.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.823+0000 7f5fe0ff9700 1 -- 172.21.15.72:0/111001797 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f5fcc089e80 con 0x7f5fe40b2d30 2023-10-14T12:36:05.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.823+0000 7f5fe3fff700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5fc406af00 0x7f5fc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:36:05.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.823+0000 7f5fe3fff700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5fc406af00 0x7f5fc406d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4000c00 tx=0x7f5fd4007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:36:05.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:05.827+0000 7f5fe0ff9700 1 -- 172.21.15.72:0/111001797 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fcc054d30 con 0x7f5fe40b2d30 2023-10-14T12:36:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.062+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fe404ebb0 con 0x7f5fe40b2d30 2023-10-14T12:36:06.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.063+0000 7f5fe0ff9700 1 -- 172.21.15.72:0/111001797 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4924 (secure 0 0 0) 0x7f5fcc009480 con 0x7f5fe40b2d30 2023-10-14T12:36:06.064 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T12:36:06.064 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/4258036152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4258036152},{"type":"v1","addr":"172.21.15.123:6834","nonce":4258036152}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1898946436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":1898946436},{"type":"v1","addr":"172.21.15.123:6835","nonce":1898946436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5256,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3912655583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3912655583},{"type":"v1","addr":"172.21.15.72:6837","nonce":3912655583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:34:44.116303+0000","modified":"2023-10-14T12:34:47.161994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5259},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5259":{"gid":5259,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6836/1876334136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1876334136},{"type":"v1","addr":"172.21.15.72:6836","nonce":1876334136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T12:36:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5fc406af00 msgr2=0x7f5fc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:06.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5fc406af00 0x7f5fc406d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4000c00 tx=0x7f5fd4007000 comp rx=0 tx=0).stop 2023-10-14T12:36:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fe40b2d30 msgr2=0x7f5fe40b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:36:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fe40b2d30 0x7f5fe40b44d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc010870 tx=0x7f5fcc010c30 comp rx=0 tx=0).stop 2023-10-14T12:36:06.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 shutdown_connections 2023-10-14T12:36:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:6832/2999014877,v1:172.21.15.72:6833/2999014877] conn(0x7f5fc406af00 0x7f5fc406d3c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5fe40b4a10 0x7f5fe40b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:06.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.123:3301/0,v1:172.21.15.123:6790/0] conn(0x7f5fd0003a00 0x7f5fe40b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 --2- 172.21.15.72:0/111001797 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fe40b2d30 0x7f5fe40b44d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:36:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 >> 172.21.15.72:0/111001797 conn(0x7f5fe40cc590 msgr2=0x7f5fe406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:36:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 shutdown_connections 2023-10-14T12:36:06.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T12:36:06.065+0000 7f5fea9b1700 1 -- 172.21.15.72:0/111001797 wait complete. 2023-10-14T12:36:06.069 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 18 2023-10-14T12:36:06.078 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T12:36:06.079 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T12:36:06.079 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T12:36:06.080 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.089 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T12:36:06.089 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T12:36:06.090 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.138 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T12:36:06.141 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T12:36:06.141 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.152 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T12:36:06.153 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T12:36:06.153 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.203 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T12:36:06.204 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T12:36:06.204 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T12:36:06.204 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.244 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T12:36:06.245 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T12:36:06.245 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.313 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T12:36:06.314 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T12:36:06.314 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.380 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T12:36:06.381 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T12:36:06.381 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.459 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T12:36:06.460 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T12:36:06.460 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.513 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T12:36:06.514 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T12:36:06.514 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.548 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T12:36:06.549 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T12:36:06.549 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.624 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T12:36:06.625 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T12:36:06.626 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.702 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T12:36:06.703 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T12:36:06.703 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T12:36:06.704 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.727 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T12:36:06.728 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T12:36:06.728 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.770 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T12:36:06.771 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T12:36:06.771 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T12:36:06.773 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.782 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T12:36:06.782 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T12:36:06.783 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.822 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T12:36:06.823 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T12:36:06.823 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:36:06.874 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T12:36:06.874 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T12:36:06.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2023-10-14T12:36:06.907 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:36:06.907 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T12:36:07.219 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:36:07.219 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T12:36:07.305 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:36:07.305 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T12:36:07.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:07.350 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:07.386 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:36:07.390 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T12:36:07.560 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:36:07.561 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T12:36:07.748 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:36:07.749 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T12:36:07.892 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:36:07.892 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T12:36:07.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:36:07.982 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T12:36:08.104 INFO:tasks.ceph:Archiving mon data... 2023-10-14T12:36:08.105 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/data/mon.a.tgz 2023-10-14T12:36:08.106 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-14T12:36:08.125 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.n3Axjkbn8f 2023-10-14T12:36:08.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.n3Axjkbn8f 2023-10-14T12:36:08.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.n3Axjkbn8f 2023-10-14T12:36:08.345 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.n3Axjkbn8f is 307KB 2023-10-14T12:36:08.440 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.n3Axjkbn8f 2023-10-14T12:36:08.457 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/data/mon.b.tgz 2023-10-14T12:36:08.458 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-10-14T12:36:08.478 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.FfvIFyXyxr 2023-10-14T12:36:08.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.FfvIFyXyxr 2023-10-14T12:36:08.635 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.FfvIFyXyxr 2023-10-14T12:36:08.721 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.FfvIFyXyxr is 415KB 2023-10-14T12:36:08.817 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.FfvIFyXyxr 2023-10-14T12:36:08.834 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/data/mon.c.tgz 2023-10-14T12:36:08.834 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2023-10-14T12:36:08.890 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.m7LCk8IoeL 2023-10-14T12:36:08.890 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.m7LCk8IoeL 2023-10-14T12:36:09.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.m7LCk8IoeL 2023-10-14T12:36:09.114 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.m7LCk8IoeL is 414KB 2023-10-14T12:36:09.211 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.m7LCk8IoeL 2023-10-14T12:36:09.230 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T12:36:09.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T12:36:09.234 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T12:36:09.295 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T12:36:09.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T12:36:09.306 DEBUG:teuthology.orchestra.run.smithi123:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T12:36:09.340 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T12:36:09.366 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T12:36:09.372 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T12:36:09.373 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/remote/smithi072/crash 2023-10-14T12:36:09.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T12:36:09.416 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/remote/smithi123/crash 2023-10-14T12:36:09.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T12:36:09.443 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T12:36:09.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:09.461 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:09.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:09.571 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:09.597 INFO:tasks.ceph:Compressing logs... 2023-10-14T12:36:09.598 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T12:36:09.613 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T12:36:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118231.log 2023-10-14T12:36:09.657 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114244.log 2023-10-14T12:36:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110146.log 2023-10-14T12:36:09.658 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118231.log.gz 2023-10-14T12:36:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119239.log 2023-10-14T12:36:09.658 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114244.log: /var/log/ceph/ceph-client.admin.110146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115997.log 2023-10-14T12:36:09.659 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114244.log.gz 2023-10-14T12:36:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119239.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110146.log.gz 2023-10-14T12:36:09.659 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117442.log 2023-10-14T12:36:09.660 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.119239.log.gz 2023-10-14T12:36:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.115997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119101.log 2023-10-14T12:36:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117442.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115997.log.gz 2023-10-14T12:36:09.660 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121525.log 2023-10-14T12:36:09.661 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117442.log.gz 2023-10-14T12:36:09.661 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111522.log 2023-10-14T12:36:09.661 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119101.log.gz 2023-10-14T12:36:09.662 INFO:teuthology.orchestra.run.smithi072.stderr:gzip /var/log/ceph/ceph-client.admin.121525.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.110528.log 2023-10-14T12:36:09.662 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104140.log 2023-10-14T12:36:09.662 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.121525.log.gz 2023-10-14T12:36:09.662 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114658.log 2023-10-14T12:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110528.log.gz 2023-10-14T12:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113023.log 2023-10-14T12:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.104140.log: /var/log/ceph/ceph-client.admin.114658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116340.log 2023-10-14T12:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.104140.log.gz 2023-10-14T12:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114658.log.gz 2023-10-14T12:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113023.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T12:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113023.log.gz 2023-10-14T12:36:09.665 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119573.log 2023-10-14T12:36:09.665 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116340.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110779.log 2023-10-14T12:36:09.665 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116340.log.gz 2023-10-14T12:36:09.665 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120646.log 2023-10-14T12:36:09.666 INFO:teuthology.orchestra.run.smithi072.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.111522.log.gz 2023-10-14T12:36:09.666 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119573.log.gz 2023-10-14T12:36:09.666 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113386.log 2023-10-14T12:36:09.666 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110779.log.gz 2023-10-14T12:36:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111744.log 2023-10-14T12:36:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120646.log: /var/log/ceph/ceph-client.admin.113386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122262.log 2023-10-14T12:36:09.667 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120646.log.gz 2023-10-14T12:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111744.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113386.log.gz 2023-10-14T12:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117315.log 2023-10-14T12:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111744.log.gz 2023-10-14T12:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117174.log 2023-10-14T12:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122262.log.gz 2023-10-14T12:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117315.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T12:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113784.log 2023-10-14T12:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117315.log.gz 2023-10-14T12:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117174.log.gz 2023-10-14T12:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120276.log 2023-10-14T12:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120554.log 2023-10-14T12:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113784.log.gz 2023-10-14T12:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114152.log 2023-10-14T12:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T12:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 88.6%--verbose -- /var/log/ceph/ceph-client.admin.119988.log -- replaced with /var/log/ceph/ceph-client.admin.120276.log.gz 2023-10-14T12:36:09.672 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-10-14T12:36:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120554.log: /var/log/ceph/ceph-client.admin.114152.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120554.log.gz 2023-10-14T12:36:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115110.log 2023-10-14T12:36:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118093.log 2023-10-14T12:36:09.673 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114152.log.gz 2023-10-14T12:36:09.673 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119988.log.gz 2023-10-14T12:36:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.115110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113017.log 2023-10-14T12:36:09.673 INFO:teuthology.orchestra.run.smithi072.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115110.log.gz 2023-10-14T12:36:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114336.log 2023-10-14T12:36:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113017.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118093.log.gz 2023-10-14T12:36:09.674 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111882.log 2023-10-14T12:36:09.675 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114336.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113017.log.gz 2023-10-14T12:36:09.675 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115340.log 2023-10-14T12:36:09.675 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111882.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114336.log.gz 2023-10-14T12:36:09.675 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113025.log 2023-10-14T12:36:09.676 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111882.log.gz 2023-10-14T12:36:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.115340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.115771.log 2023-10-14T12:36:09.676 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112633.log 2023-10-14T12:36:09.676 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115340.log.gz 2023-10-14T12:36:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.2.115771.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113025.log.gz 2023-10-14T12:36:09.677 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112679.log 2023-10-14T12:36:09.677 INFO:teuthology.orchestra.run.smithi072.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.115771.log.gz 2023-10-14T12:36:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114060.log 2023-10-14T12:36:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113387.log 2023-10-14T12:36:09.678 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112633.log.gz 2023-10-14T12:36:09.678 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114060.log: 88.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.112679.log.gz--verbose 2023-10-14T12:36:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.113019.log 2023-10-14T12:36:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113830.log 2023-10-14T12:36:09.679 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114060.log.gz 2023-10-14T12:36:09.679 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113019.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113387.log.gz 2023-10-14T12:36:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120082.log 2023-10-14T12:36:09.680 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113019.log.gz 2023-10-14T12:36:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116156.log 2023-10-14T12:36:09.680 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120082.log: gzip 88.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.113830.log.gz-- 2023-10-14T12:36:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110825.log 2023-10-14T12:36:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116156.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120082.log.gz 2023-10-14T12:36:09.681 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119619.log 2023-10-14T12:36:09.682 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110825.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116156.log.gz 2023-10-14T12:36:09.682 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117898.log 2023-10-14T12:36:09.682 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9%/var/log/ceph/ceph-client.admin.119619.log: -- replaced with /var/log/ceph/ceph-client.admin.110825.log.gz 2023-10-14T12:36:09.682 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T12:36:09.683 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116709.log 2023-10-14T12:36:09.683 INFO:teuthology.orchestra.run.smithi072.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119619.log.gz 2023-10-14T12:36:09.683 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117898.log.gz 2023-10-14T12:36:09.683 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117077.log 2023-10-14T12:36:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118641.log 2023-10-14T12:36:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117077.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116709.log.gz 2023-10-14T12:36:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114014.log 2023-10-14T12:36:09.684 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119467.log 2023-10-14T12:36:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118641.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117077.log.gz 2023-10-14T12:36:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114014.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118641.log.gz 2023-10-14T12:36:09.685 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116939.log 2023-10-14T12:36:09.686 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114014.log.gz 2023-10-14T12:36:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:gzip /var/log/ceph/ceph-client.admin.119467.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.121479.log 2023-10-14T12:36:09.686 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116939.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T12:36:09.686 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119467.log.gz 2023-10-14T12:36:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121479.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.116939.log.gz--verbose 2023-10-14T12:36:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.112085.log 2023-10-14T12:36:09.687 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121479.log.gz 2023-10-14T12:36:09.687 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118963.log 2023-10-14T12:36:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120034.log 2023-10-14T12:36:09.688 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112085.log: /var/log/ceph/ceph-client.admin.118963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120900.log 2023-10-14T12:36:09.688 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112085.log.gz 2023-10-14T12:36:09.689 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118963.log.gz 2023-10-14T12:36:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120784.log 2023-10-14T12:36:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120900.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120034.log.gz 2023-10-14T12:36:09.689 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120900.log.gz 2023-10-14T12:36:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120784.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120784.log.gz 2023-10-14T12:36:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120130.log 2023-10-14T12:36:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122215.log 2023-10-14T12:36:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117944.log 2023-10-14T12:36:09.691 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120130.log.gz 2023-10-14T12:36:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122215.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T12:36:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118549.log 2023-10-14T12:36:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117944.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122215.log.gz 2023-10-14T12:36:09.702 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111034.log 2023-10-14T12:36:09.702 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T12:36:09.702 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.3.111034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104279.log 2023-10-14T12:36:09.702 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111034.log.gz 2023-10-14T12:36:09.703 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T12:36:09.703 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104279.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T12:36:09.703 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.104279.log.gz 2023-10-14T12:36:09.704 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T12:36:09.704 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T12:36:09.704 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110398.log 2023-10-14T12:36:09.704 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.audit.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T12:36:09.705 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.1.110398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110398.log.gz 2023-10-14T12:36:09.705 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T12:36:09.705 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104181.log 2023-10-14T12:36:09.705 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.104181.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104181.log.gz 2023-10-14T12:36:09.706 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104136.log 2023-10-14T12:36:09.706 INFO:teuthology.orchestra.run.smithi123.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T12:36:09.706 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104226.log 2023-10-14T12:36:09.707 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103999.log 2023-10-14T12:36:09.707 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104226.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104136.log.gz 2023-10-14T12:36:09.707 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103999.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104226.log.gz 2023-10-14T12:36:09.707 INFO:teuthology.orchestra.run.smithi123.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.103999.log.gz 2023-10-14T12:36:09.708 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T12:36:09.708 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T12:36:09.708 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T12:36:09.708 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111038.log 2023-10-14T12:36:09.709 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T12:36:09.709 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.3.111038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111038.log.gz 2023-10-14T12:36:09.709 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T12:36:09.710 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103953.log 2023-10-14T12:36:09.710 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103953.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103953.log.gz 2023-10-14T12:36:09.710 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104090.log 2023-10-14T12:36:09.710 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104090.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104090.log.gz 2023-10-14T12:36:09.711 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104044.log 2023-10-14T12:36:09.711 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104044.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104044.log.gz 2023-10-14T12:36:09.711 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T12:36:09.711 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mds.b.log: 91.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T12:36:09.712 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110406.log 2023-10-14T12:36:09.712 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.1.110406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110406.log.gz 2023-10-14T12:36:09.714 INFO:teuthology.orchestra.run.smithi123.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-14T12:36:09.746 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117223.log 2023-10-14T12:36:09.747 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117944.log.gz 2023-10-14T12:36:09.747 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116525.log 2023-10-14T12:36:09.747 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.118549.log.gz 2023-10-14T12:36:09.747 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109814.log 2023-10-14T12:36:09.748 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117223.log.gz 2023-10-14T12:36:09.748 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116525.log: /var/log/ceph/ceph-client.admin.109814.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116525.log.gz 2023-10-14T12:36:09.748 INFO:teuthology.orchestra.run.smithi072.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T12:36:09.749 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109814.log.gz 2023-10-14T12:36:09.749 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116386.log 2023-10-14T12:36:09.749 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112726.log 2023-10-14T12:36:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110068.log 2023-10-14T12:36:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112726.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116386.log.gz 2023-10-14T12:36:09.750 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110068.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.112726.log.gz 2023-10-14T12:36:09.750 INFO:teuthology.orchestra.run.smithi072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110068.log.gz 2023-10-14T12:36:09.751 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121433.log 2023-10-14T12:36:09.751 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118687.log 2023-10-14T12:36:09.751 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121571.log 2023-10-14T12:36:09.752 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118687.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121433.log.gz 2023-10-14T12:36:09.752 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121571.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118687.log.gz 2023-10-14T12:36:09.752 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121571.log.gz 2023-10-14T12:36:09.752 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121387.log 2023-10-14T12:36:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112039.log 2023-10-14T12:36:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120230.log 2023-10-14T12:36:09.753 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121387.log.gz 2023-10-14T12:36:09.753 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112039.log: /var/log/ceph/ceph-client.admin.120230.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112039.log.gz 2023-10-14T12:36:09.754 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120230.log.gz 2023-10-14T12:36:09.754 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112818.log 2023-10-14T12:36:09.754 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116432.log 2023-10-14T12:36:09.754 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118277.log 2023-10-14T12:36:09.755 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112818.log.gz 2023-10-14T12:36:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121801.log 2023-10-14T12:36:09.755 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117672.log 2023-10-14T12:36:09.756 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118277.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116432.log.gz 2023-10-14T12:36:09.756 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112403.log 2023-10-14T12:36:09.756 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118277.log.gz 2023-10-14T12:36:09.756 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117672.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121801.log.gz 2023-10-14T12:36:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112131.log 2023-10-14T12:36:09.757 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117672.log.gz 2023-10-14T12:36:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110388.log 2023-10-14T12:36:09.757 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112131.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112403.log.gz 2023-10-14T12:36:09.758 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112131.log.gz 2023-10-14T12:36:09.758 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110388.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110388.log.gz 2023-10-14T12:36:09.758 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117626.log 2023-10-14T12:36:09.759 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117760.log 2023-10-14T12:36:09.759 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116893.log 2023-10-14T12:36:09.759 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117626.log.gz 2023-10-14T12:36:09.759 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114428.log 2023-10-14T12:36:09.760 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110246.log 2023-10-14T12:36:09.760 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116893.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117760.log.gz 2023-10-14T12:36:09.760 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114428.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T12:36:09.760 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116893.log.gz 2023-10-14T12:36:09.761 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110246.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114428.log.gz 2023-10-14T12:36:09.761 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117852.log 2023-10-14T12:36:09.761 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110246.log.gz 2023-10-14T12:36:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113378.log 2023-10-14T12:36:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122339.log 2023-10-14T12:36:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117852.log: /var/log/ceph/ceph-client.admin.113378.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117852.log.gz 2023-10-14T12:36:09.762 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122339.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113378.log.gz 2023-10-14T12:36:09.763 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-14T12:36:09.763 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122339.log.gz 2023-10-14T12:36:09.763 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116248.log 2023-10-14T12:36:09.764 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120830.log 2023-10-14T12:36:09.764 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117806.log 2023-10-14T12:36:09.764 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116248.log.gz 2023-10-14T12:36:09.764 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113391.log 2023-10-14T12:36:09.765 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121893.log 2023-10-14T12:36:09.765 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117806.log: /var/log/ceph/ceph-client.admin.113391.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117806.log.gz 2023-10-14T12:36:09.765 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.120830.log.gz 2023-10-14T12:36:09.765 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121893.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113391.log.gz 2023-10-14T12:36:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116110.log 2023-10-14T12:36:09.766 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.121893.log.gz 2023-10-14T12:36:09.766 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120324.log 2023-10-14T12:36:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119758.log 2023-10-14T12:36:09.767 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116110.log: /var/log/ceph/ceph-client.admin.120324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113738.log 2023-10-14T12:36:09.767 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116110.log.gz 2023-10-14T12:36:09.767 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120324.log.gz 2023-10-14T12:36:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116202.log 2023-10-14T12:36:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113738.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119758.log.gz 2023-10-14T12:36:09.768 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121709.log 2023-10-14T12:36:09.768 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1%/var/log/ceph/ceph-client.admin.116202.log: -- replaced with /var/log/ceph/ceph-client.admin.113738.log.gz 2023-10-14T12:36:09.769 INFO:teuthology.orchestra.run.smithi072.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116202.log.gz 2023-10-14T12:36:09.769 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121709.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121709.log.gz 2023-10-14T12:36:09.769 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121663.log 2023-10-14T12:36:09.769 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110008.log 2023-10-14T12:36:09.770 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119147.log 2023-10-14T12:36:09.770 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121663.log.gz 2023-10-14T12:36:09.770 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117031.log 2023-10-14T12:36:09.771 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119147.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110008.log.gz 2023-10-14T12:36:09.771 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117031.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119147.log.gz 2023-10-14T12:36:09.771 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117031.log.gz 2023-10-14T12:36:09.771 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T12:36:09.772 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113922.log 2023-10-14T12:36:09.772 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113015.log 2023-10-14T12:36:09.772 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113922.log: /var/log/ceph/ceph-client.admin.113015.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.113922.log.gz 2023-10-14T12:36:09.772 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113015.log.gz 2023-10-14T12:36:09.773 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T12:36:09.773 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113020.log 2023-10-14T12:36:09.773 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110574.log 2023-10-14T12:36:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120462.log 2023-10-14T12:36:09.774 INFO:teuthology.orchestra.run.smithi072.stderr: 87.2%/var/log/ceph/ceph-client.admin.110574.log: -- replaced with /var/log/ceph/ceph-client.admin.113020.log.gz 2023-10-14T12:36:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120462.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110574.log.gz 2023-10-14T12:36:09.774 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121755.log 2023-10-14T12:36:09.775 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120462.log.gz 2023-10-14T12:36:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119665.log 2023-10-14T12:36:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113623.log 2023-10-14T12:36:09.775 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114106.log 2023-10-14T12:36:09.776 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121755.log.gz 2023-10-14T12:36:09.776 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120692.log 2023-10-14T12:36:09.776 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119665.log.gz 2023-10-14T12:36:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121341.log 2023-10-14T12:36:09.777 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113623.log.gz 2023-10-14T12:36:09.777 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113389.log 2023-10-14T12:36:09.777 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114106.log.gz 2023-10-14T12:36:09.778 INFO:teuthology.orchestra.run.smithi072.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120692.log.gz 2023-10-14T12:36:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122169.log 2023-10-14T12:36:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116479.log 2023-10-14T12:36:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113389.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121341.log.gz 2023-10-14T12:36:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118411.log 2023-10-14T12:36:09.779 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113389.log.gz 2023-10-14T12:36:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119285.log 2023-10-14T12:36:09.780 INFO:teuthology.orchestra.run.smithi072.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.122169.log.gz 2023-10-14T12:36:09.780 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116479.log.gz 2023-10-14T12:36:09.780 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121847.log 2023-10-14T12:36:09.780 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119285.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118411.log.gz 2023-10-14T12:36:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118503.log 2023-10-14T12:36:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.121847.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119285.log.gz 2023-10-14T12:36:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119377.log 2023-10-14T12:36:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118503.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121847.log.gz 2023-10-14T12:36:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119377.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118503.log.gz 2023-10-14T12:36:09.782 INFO:teuthology.orchestra.run.smithi072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119377.log.gz 2023-10-14T12:36:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113379.log 2023-10-14T12:36:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120508.log 2023-10-14T12:36:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113876.log 2023-10-14T12:36:09.783 INFO:teuthology.orchestra.run.smithi072.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113379.log.gz 2023-10-14T12:36:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119193.log 2023-10-14T12:36:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120508.log: /var/log/ceph/ceph-client.admin.113876.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.120508.log.gz 2023-10-14T12:36:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119193.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113876.log.gz 2023-10-14T12:36:09.784 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119193.log.gz 2023-10-14T12:36:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120370.log 2023-10-14T12:36:09.785 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113622.log 2023-10-14T12:36:09.785 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122123.log 2023-10-14T12:36:09.785 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120370.log.gz 2023-10-14T12:36:09.785 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120738.log 2023-10-14T12:36:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110292.log 2023-10-14T12:36:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122123.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113622.log.gz 2023-10-14T12:36:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118733.log 2023-10-14T12:36:09.787 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122123.log.gz 2023-10-14T12:36:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110292.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120738.log.gz 2023-10-14T12:36:09.787 INFO:teuthology.orchestra.run.smithi072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110292.log.gz 2023-10-14T12:36:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118733.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118733.log.gz 2023-10-14T12:36:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117534.log 2023-10-14T12:36:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118185.log 2023-10-14T12:36:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116617.log 2023-10-14T12:36:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118185.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117534.log.gz 2023-10-14T12:36:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116617.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118185.log.gz 2023-10-14T12:36:09.789 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.116617.log.gz 2023-10-14T12:36:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.115775.log 2023-10-14T12:36:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113393.log 2023-10-14T12:36:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.2.115775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.115775.log.gz 2023-10-14T12:36:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119942.log 2023-10-14T12:36:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117123.log 2023-10-14T12:36:09.791 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113393.log: /var/log/ceph/ceph-client.admin.119942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110871.log 2023-10-14T12:36:09.791 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113393.log.gz 2023-10-14T12:36:09.791 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6%/var/log/ceph/ceph-client.admin.117123.log: -- replaced with /var/log/ceph/ceph-client.admin.119942.log.gz 2023-10-14T12:36:09.791 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117123.log.gz 2023-10-14T12:36:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110871.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.110871.log.gz 2023-10-14T12:36:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112223.log 2023-10-14T12:36:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109923.log 2023-10-14T12:36:09.792 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118825.log 2023-10-14T12:36:09.793 INFO:teuthology.orchestra.run.smithi072.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112223.log.gz 2023-10-14T12:36:09.793 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.109923.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T12:36:09.793 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120600.log 2023-10-14T12:36:09.793 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118825.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109923.log.gz 2023-10-14T12:36:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111836.log 2023-10-14T12:36:09.794 INFO:teuthology.orchestra.run.smithi072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118825.log.gz 2023-10-14T12:36:09.794 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118139.log 2023-10-14T12:36:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111836.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120600.log.gz 2023-10-14T12:36:09.795 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111836.log.gz 2023-10-14T12:36:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118139.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118139.log.gz 2023-10-14T12:36:09.795 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116663.log 2023-10-14T12:36:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121985.log 2023-10-14T12:36:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116663.log: /var/log/ceph/ceph-client.admin.121985.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116663.log.gz 2023-10-14T12:36:09.796 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104265.log 2023-10-14T12:36:09.796 INFO:teuthology.orchestra.run.smithi072.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121985.log.gz 2023-10-14T12:36:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116043.log 2023-10-14T12:36:09.797 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.104265.log: /var/log/ceph/ceph-client.admin.116043.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104265.log.gz 2023-10-14T12:36:09.797 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116043.log.gz 2023-10-14T12:36:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117488.log 2023-10-14T12:36:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119009.log 2023-10-14T12:36:09.798 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117488.log: /var/log/ceph/ceph-client.admin.119009.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.117488.log.gz 2023-10-14T12:36:09.798 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119009.log.gz 2023-10-14T12:36:09.799 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113385.log 2023-10-14T12:36:09.799 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110200.log 2023-10-14T12:36:09.799 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113385.log: /var/log/ceph/ceph-client.admin.110200.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113385.log.gz 2023-10-14T12:36:09.799 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110200.log.gz 2023-10-14T12:36:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114474.log 2023-10-14T12:36:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.97592.log 2023-10-14T12:36:09.800 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114474.log: /var/log/ceph/ceph.tmp-client.admin.97592.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.97592.log.gz 2023-10-14T12:36:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112587.log 2023-10-14T12:36:09.801 INFO:teuthology.orchestra.run.smithi072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.114474.log.gz 2023-10-14T12:36:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119331.log 2023-10-14T12:36:09.801 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112587.log: /var/log/ceph/ceph-client.admin.119331.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112587.log.gz 2023-10-14T12:36:09.802 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119331.log.gz 2023-10-14T12:36:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116294.log 2023-10-14T12:36:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113692.log 2023-10-14T12:36:09.802 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116294.log: /var/log/ceph/ceph-client.admin.113692.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116294.log.gz 2023-10-14T12:36:09.803 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113692.log.gz 2023-10-14T12:36:09.803 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122542.log 2023-10-14T12:36:09.803 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119896.log 2023-10-14T12:36:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122406.log 2023-10-14T12:36:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119896.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122542.log.gz 2023-10-14T12:36:09.804 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119896.log.gz 2023-10-14T12:36:09.804 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122406.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122406.log.gz 2023-10-14T12:36:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119712.log 2023-10-14T12:36:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118779.log 2023-10-14T12:36:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120416.log 2023-10-14T12:36:09.805 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118779.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119712.log.gz 2023-10-14T12:36:09.806 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120416.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118779.log.gz 2023-10-14T12:36:09.806 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120416.log.gz 2023-10-14T12:36:09.806 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112357.log 2023-10-14T12:36:09.806 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112449.log 2023-10-14T12:36:09.807 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112357.log: /var/log/ceph/ceph-client.admin.112449.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112357.log.gz 2023-10-14T12:36:09.807 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112449.log.gz 2023-10-14T12:36:09.807 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122031.log 2023-10-14T12:36:09.808 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114382.log 2023-10-14T12:36:09.808 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114290.log 2023-10-14T12:36:09.808 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.114382.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122031.log.gz 2023-10-14T12:36:09.808 INFO:teuthology.orchestra.run.smithi072.stderr: 88.6%/var/log/ceph/ceph-client.admin.114290.log: -- replaced with /var/log/ceph/ceph-client.admin.114382.log.gz 2023-10-14T12:36:09.809 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114290.log.gz 2023-10-14T12:36:09.809 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113968.log 2023-10-14T12:36:09.809 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116571.log 2023-10-14T12:36:09.809 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116801.log 2023-10-14T12:36:09.810 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116571.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113968.log.gz 2023-10-14T12:36:09.810 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116571.log.gz 2023-10-14T12:36:09.810 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110733.log 2023-10-14T12:36:09.811 INFO:teuthology.orchestra.run.smithi072.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116801.log.gz 2023-10-14T12:36:09.811 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112772.log 2023-10-14T12:36:09.811 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110733.log: /var/log/ceph/ceph-client.admin.112772.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110733.log.gz 2023-10-14T12:36:09.811 INFO:teuthology.orchestra.run.smithi072.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112772.log.gz 2023-10-14T12:36:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116985.log 2023-10-14T12:36:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110340.log 2023-10-14T12:36:09.812 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116985.log: /var/log/ceph/ceph-client.admin.110340.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116985.log.gz 2023-10-14T12:36:09.812 INFO:teuthology.orchestra.run.smithi072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110340.log.gz 2023-10-14T12:36:09.813 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111790.log 2023-10-14T12:36:09.813 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110434.log 2023-10-14T12:36:09.813 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111790.log: /var/log/ceph/ceph-client.admin.110434.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111790.log.gz 2023-10-14T12:36:09.813 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110434.log.gz 2023-10-14T12:36:09.814 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119055.log 2023-10-14T12:36:09.814 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110620.log 2023-10-14T12:36:09.814 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119055.log: /var/log/ceph/ceph-client.admin.110620.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119055.log.gz 2023-10-14T12:36:09.815 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110620.log.gz 2023-10-14T12:36:09.815 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117269.log 2023-10-14T12:36:09.815 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111928.log 2023-10-14T12:36:09.815 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117269.log: /var/log/ceph/ceph-client.admin.111928.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117269.log.gz 2023-10-14T12:36:09.816 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118323.log 2023-10-14T12:36:09.816 INFO:teuthology.orchestra.run.smithi072.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111928.log.gz 2023-10-14T12:36:09.816 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121617.log 2023-10-14T12:36:09.816 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118323.log: /var/log/ceph/ceph-client.admin.121617.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118323.log.gz 2023-10-14T12:36:09.817 INFO:teuthology.orchestra.run.smithi072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121617.log.gz 2023-10-14T12:36:09.817 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113016.log 2023-10-14T12:36:09.817 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113024.log 2023-10-14T12:36:09.817 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.113016.log: /var/log/ceph/ceph-client.admin.113024.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113016.log.gz 2023-10-14T12:36:09.818 INFO:teuthology.orchestra.run.smithi072.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113024.log.gz 2023-10-14T12:36:09.818 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112541.log 2023-10-14T12:36:09.818 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114198.log 2023-10-14T12:36:09.819 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112541.log: /var/log/ceph/ceph-client.admin.114198.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112541.log.gz 2023-10-14T12:36:09.819 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114198.log.gz 2023-10-14T12:36:09.819 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115118.log 2023-10-14T12:36:09.819 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121137.log 2023-10-14T12:36:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.115118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.115118.log.gz 2023-10-14T12:36:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.121137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121137.log.gz 2023-10-14T12:36:09.820 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117580.log 2023-10-14T12:36:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103832.log 2023-10-14T12:36:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117580.log: /var/log/ceph/ceph-client.admin.103832.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.117580.log.gz 2023-10-14T12:36:09.821 INFO:teuthology.orchestra.run.smithi072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.103832.log.gz 2023-10-14T12:36:09.821 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118457.log 2023-10-14T12:36:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.121133.log 2023-10-14T12:36:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118871.log 2023-10-14T12:36:09.822 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.0.121133.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118457.log.gz 2023-10-14T12:36:09.823 INFO:teuthology.orchestra.run.smithi072.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.121133.log.gz 2023-10-14T12:36:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118871.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118871.log.gz 2023-10-14T12:36:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111974.log 2023-10-14T12:36:09.823 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121939.log 2023-10-14T12:36:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.111974.log: /var/log/ceph/ceph-client.admin.121939.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111974.log.gz 2023-10-14T12:36:09.824 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121939.log.gz 2023-10-14T12:36:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112177.log 2023-10-14T12:36:09.824 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112269.log 2023-10-14T12:36:09.825 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.112177.log: /var/log/ceph/ceph-client.admin.112269.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112177.log.gz 2023-10-14T12:36:09.825 INFO:teuthology.orchestra.run.smithi072.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.112269.log.gz 2023-10-14T12:36:09.825 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119804.log 2023-10-14T12:36:09.825 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112495.log 2023-10-14T12:36:09.826 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119804.log: /var/log/ceph/ceph-client.admin.112495.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119804.log.gz 2023-10-14T12:36:09.826 INFO:teuthology.orchestra.run.smithi072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112495.log.gz 2023-10-14T12:36:09.826 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118917.log 2023-10-14T12:36:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T12:36:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.118917.log: /var/log/ceph/ceph-mon.a.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118917.log.gz 2023-10-14T12:36:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117990.log 2023-10-14T12:36:09.827 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110687.log 2023-10-14T12:36:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.117990.log: /var/log/ceph/ceph-client.admin.110687.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117990.log.gz 2023-10-14T12:36:09.828 INFO:teuthology.orchestra.run.smithi072.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110687.log.gz 2023-10-14T12:36:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120184.log 2023-10-14T12:36:09.828 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110480.log 2023-10-14T12:36:09.829 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.120184.log: /var/log/ceph/ceph-client.admin.110480.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120184.log.gz 2023-10-14T12:36:09.829 INFO:teuthology.orchestra.run.smithi072.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110480.log.gz 2023-10-14T12:36:09.829 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110941.log 2023-10-14T12:36:09.829 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116847.log 2023-10-14T12:36:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.110941.log: /var/log/ceph/ceph-client.admin.116847.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110941.log.gz 2023-10-14T12:36:09.830 INFO:teuthology.orchestra.run.smithi072.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116847.log.gz 2023-10-14T12:36:09.830 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122077.log 2023-10-14T12:36:09.831 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118595.log 2023-10-14T12:36:09.831 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122077.log: /var/log/ceph/ceph-client.admin.118595.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122077.log.gz 2023-10-14T12:36:09.831 INFO:teuthology.orchestra.run.smithi072.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.118595.log.gz 2023-10-14T12:36:09.831 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T12:36:09.832 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122496.log 2023-10-14T12:36:09.832 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.122496.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122496.log.gz 2023-10-14T12:36:09.832 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122452.log 2023-10-14T12:36:09.832 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.122452.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122452.log.gz 2023-10-14T12:36:09.833 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119850.log 2023-10-14T12:36:09.833 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.119850.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119850.log.gz 2023-10-14T12:36:09.833 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116755.log 2023-10-14T12:36:09.834 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.116755.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116755.log.gz 2023-10-14T12:36:09.834 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T12:36:09.835 INFO:teuthology.orchestra.run.smithi123.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T12:36:09.835 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T12:36:10.007 INFO:teuthology.orchestra.run.smithi072.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T12:36:10.276 INFO:teuthology.orchestra.run.smithi123.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T12:36:10.284 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T12:36:10.301 INFO:teuthology.orchestra.run.smithi072.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T12:36:10.317 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T12:36:10.319 INFO:teuthology.orchestra.run.smithi123.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T12:36:10.321 INFO:teuthology.orchestra.run.smithi123.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T12:36:10.332 INFO:teuthology.orchestra.run.smithi072.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T12:36:10.334 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-10-14T12:36:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m0.707s 2023-10-14T12:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m2.921s 2023-10-14T12:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m0.228s 2023-10-14T12:36:10.350 INFO:teuthology.orchestra.run.smithi123.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T12:36:10.352 INFO:teuthology.orchestra.run.smithi123.stderr: 2023-10-14T12:36:10.352 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m0.692s 2023-10-14T12:36:10.352 INFO:teuthology.orchestra.run.smithi123.stderr:user 0m2.724s 2023-10-14T12:36:10.353 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m0.113s 2023-10-14T12:36:10.353 INFO:tasks.ceph:Archiving logs... 2023-10-14T12:36:10.354 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/remote/smithi072/log 2023-10-14T12:36:10.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T12:36:10.989 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/remote/smithi123/log 2023-10-14T12:36:10.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T12:36:11.397 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T12:36:11.406 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T12:36:11.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T12:36:11.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T12:36:11.504 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T12:36:11.513 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T12:36:11.514 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:36:11.516 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:36:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-10-14T12:36:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:bash: ntpq: command not found 2023-10-14T12:36:11.536 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:36:11.536 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-10-14T12:36:11.537 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +620us[ +626us] +/- 97ms 2023-10-14T12:36:11.537 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -666us[ -666us] +/- 53ms 2023-10-14T12:36:11.537 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv03.front.sepia.ceph.com 3 6 377 25 +156us[ +162us] +/- 71ms 2023-10-14T12:36:11.537 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:36:11.539 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:36:11.539 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2023-10-14T12:36:11.539 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 +722us[ +669us] +/- 97ms 2023-10-14T12:36:11.540 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -587us[ -639us] +/- 53ms 2023-10-14T12:36:11.540 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv03.front.sepia.ceph.com 3 6 377 24 +257us[ +205us] +/- 71ms 2023-10-14T12:36:11.540 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:36:11.540 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T12:36:11.550 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T12:36:11.551 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T12:36:11.560 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T12:36:11.675 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T12:36:11.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:36:11.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:36:11.800 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:36:11.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:36:11.833 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T12:36:11.843 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T12:36:11.852 INFO:teuthology.task.internal:Duration was 898.818738 seconds 2023-10-14T12:36:11.853 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T12:36:11.863 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T12:36:11.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T12:36:11.866 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T12:36:11.910 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:36:11.919 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:36:12.180 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T12:36:12.181 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T12:36:12.181 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T12:36:12.203 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2023-10-14T12:36:12.203 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T12:36:12.225 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T12:36:12.225 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T12:36:12.245 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T12:36:12.305 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T12:36:12.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T12:36:12.328 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T12:36:12.419 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T12:36:12.430 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T12:36:12.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T12:36:12.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T12:36:12.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T12:36:12.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T12:36:12.500 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T12:36:12.523 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2023-10-14T12:36:12.551 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2023-10-14T12:36:12.565 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T12:36:12.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:36:12.594 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T12:36:12.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:36:12.622 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T12:36:12.635 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T12:36:12.636 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/remote/smithi072 2023-10-14T12:36:12.636 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T12:36:12.675 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322/remote/smithi123 2023-10-14T12:36:12.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T12:36:12.713 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T12:36:12.714 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T12:36:12.716 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T12:36:12.764 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T12:36:12.775 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T12:36:12.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T12:36:12.785 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T12:36:12.786 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T12:36:12.788 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T12:36:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: 262320 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 14 12:36 /home/ubuntu/cephtest 2023-10-14T12:36:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: 393242 4 d--------- 2 ubuntu ubuntu 4096 Oct 14 12:34 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:36:12.804 INFO:teuthology.orchestra.run.smithi072.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-10-14T12:36:12.804 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-14T12:36:12.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:36:12.807 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi072 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T12:36:12.816 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T12:36:12.827 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T12:36:12.841 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi072 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T12:36:12.842 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T12:36:12.850 INFO:teuthology.orchestra.run.smithi123.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 12:36 /home/ubuntu/cephtest 2023-10-14T12:36:12.882 DEBUG:teuthology.nuke:shortname: smithi072 2023-10-14T12:36:12.883 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T12:36:12.907 DEBUG:teuthology.nuke:shortname: smithi123 2023-10-14T12:36:12.908 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T12:36:12.912 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:15:32.137236', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T12:36:12.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425322', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:15:32.138779', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T12:36:12.969 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-14T12:36:12.971 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T12:36:12.995 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-14T12:36:12.996 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:36:13.011 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-14T12:36:13.012 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T12:36:13.022 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-14T12:36:13.036 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-14T12:36:13.036 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:36:13.064 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-14T12:36:17.024 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:36:17.135 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:36:17.146 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-14T12:36:17.246 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-14T12:36:21.147 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:36:21.248 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:36:21.258 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-14T12:36:21.359 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-14T12:36:25.262 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:36:25.360 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:36:25.373 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-14T12:36:25.472 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-14T12:36:25.475 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-14T12:36:25.574 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-14T12:36:25.682 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} duration: 898.8187382221222 failure_reason: 'Test failure: test_acls (tasks.cephfs.test_acls.TestACLs)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=69e6799bf7284c98a43bdbc1a4d76279 status: fail success: false 2023-10-14T12:36:25.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:36:25.757 INFO:teuthology.run:FAIL